-- Logs begin at Thu 2022-06-23 10:03:34 UTC, end at Thu 2022-06-23 11:16:29 UTC. -- Jun 23 10:38:14.999998 dv-cinder-846146-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 23 10:38:15.009067 dv-cinder-846146-4-smb devstack@keystone.service[91990]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 23 10:38:15.011114 dv-cinder-846146-4-smb devstack@keystone.service[91990]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 10:38:15 2022] *** Jun 23 10:38:15.011114 dv-cinder-846146-4-smb devstack@keystone.service[91990]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 10:38:15.011114 dv-cinder-846146-4-smb devstack@keystone.service[91990]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 10:38:15.011114 dv-cinder-846146-4-smb devstack@keystone.service[91990]: nodename: dv-cinder-846146-4-smb Jun 23 10:38:15.011114 dv-cinder-846146-4-smb devstack@keystone.service[91990]: machine: x86_64 Jun 23 10:38:15.011114 dv-cinder-846146-4-smb devstack@keystone.service[91990]: clock source: unix Jun 23 10:38:15.011114 dv-cinder-846146-4-smb devstack@keystone.service[91990]: pcre jit disabled Jun 23 10:38:15.011114 dv-cinder-846146-4-smb devstack@keystone.service[91990]: detected number of CPU cores: 4 Jun 23 10:38:15.011114 dv-cinder-846146-4-smb devstack@keystone.service[91990]: current working directory: / Jun 23 10:38:15.011114 dv-cinder-846146-4-smb devstack@keystone.service[91990]: detected binary path: /usr/bin/uwsgi-core Jun 23 10:38:15.011664 dv-cinder-846146-4-smb devstack@keystone.service[91990]: your processes number limit is 47680 Jun 23 10:38:15.011664 dv-cinder-846146-4-smb devstack@keystone.service[91990]: your memory page size is 4096 bytes Jun 23 10:38:15.011664 dv-cinder-846146-4-smb devstack@keystone.service[91990]: detected max file descriptor number: 2048 Jun 23 10:38:15.011664 dv-cinder-846146-4-smb devstack@keystone.service[91990]: lock engine: pthread robust mutexes Jun 23 10:38:15.011664 dv-cinder-846146-4-smb devstack@keystone.service[91990]: thunder lock: enabled Jun 23 10:38:15.011664 dv-cinder-846146-4-smb devstack@keystone.service[91990]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 23 10:38:15.011664 dv-cinder-846146-4-smb devstack@keystone.service[91990]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 10:38:15.057652 dv-cinder-846146-4-smb devstack@keystone.service[91990]: Python main interpreter initialized at 0x5571a0abb9c0 Jun 23 10:38:15.057652 dv-cinder-846146-4-smb devstack@keystone.service[91990]: python threads support enabled Jun 23 10:38:15.057652 dv-cinder-846146-4-smb devstack@keystone.service[91990]: your server socket listen backlog is limited to 100 connections Jun 23 10:38:15.057652 dv-cinder-846146-4-smb devstack@keystone.service[91990]: your mercy for graceful operations on workers is 90 seconds Jun 23 10:38:15.057995 dv-cinder-846146-4-smb devstack@keystone.service[91990]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 10:38:15.058070 dv-cinder-846146-4-smb devstack@keystone.service[91990]: *** Operational MODE: preforking *** Jun 23 10:38:15.058348 dv-cinder-846146-4-smb devstack@keystone.service[91990]: *** uWSGI is running in multiple interpreter mode *** Jun 23 10:38:15.058348 dv-cinder-846146-4-smb devstack@keystone.service[91990]: spawned uWSGI master process (pid: 91990) Jun 23 10:38:15.058548 dv-cinder-846146-4-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 23 10:38:15.062227 dv-cinder-846146-4-smb devstack@keystone.service[91990]: spawned uWSGI worker 1 (pid: 92003, cores: 1) Jun 23 10:38:15.062227 dv-cinder-846146-4-smb devstack@keystone.service[91990]: spawned uWSGI worker 2 (pid: 92004, cores: 1) Jun 23 10:38:15.062227 dv-cinder-846146-4-smb devstack@keystone.service[91990]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 10:38:20.511547 dv-cinder-846146-4-smb devstack@keystone.service[92004]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:38:20.511547 dv-cinder-846146-4-smb devstack@keystone.service[92004]: from cryptography.utils import int_from_bytes Jun 23 10:38:20.512497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:38:20.512497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: from cryptography.utils import int_from_bytes Jun 23 10:38:20.512606 dv-cinder-846146-4-smb devstack@keystone.service[92003]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:38:20.512606 dv-cinder-846146-4-smb devstack@keystone.service[92003]: from cryptography.utils import int_from_bytes Jun 23 10:38:20.513038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:38:20.513038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: from cryptography.utils import int_from_bytes Jun 23 10:38:20.561220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 10:38:20.561399 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 10:38:20.561482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 10:38:20.561576 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] command line args: [] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 10:38:20.561663 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 10:38:20.561831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] command line args: [] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 10:38:20.561920 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 10:38:20.561999 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ================================================================================ {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 10:38:20.562109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 10:38:20.562249 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] admin_token = **** {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.562339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ================================================================================ {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 10:38:20.562497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] config_dir = [] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.562580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] admin_token = **** {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.562684 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.562763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] config_dir = [] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.562864 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] config_source = [] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.562952 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.563029 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] debug = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.563099 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] config_source = [] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.563226 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.563496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] debug = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.563496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.563640 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.563706 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.563763 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.563940 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.564075 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.564198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.564313 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.564432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.564546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] list_limit = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.564680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] list_limit = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.564814 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] log_config_append = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.564932 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] log_config_append = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.565051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.565170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.565275 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] log_dir = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.565392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] log_dir = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.565513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] log_file = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.565627 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] log_file = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.565746 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.565865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.565981 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.566090 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.566198 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.566308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.566403 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.566524 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.566647 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.566772 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.566855 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.566979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.567061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.567183 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.567264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.567391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.567467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.567587 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.567662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.567781 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.567865 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.567941 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.568058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.568138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.568209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.568283 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.568363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.568439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.568513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.568659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.568917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.569104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] publish_errors = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.569191 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.569349 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] publish_errors = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.569537 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.569675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.569798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.569798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.570026 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.570026 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.570260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.570353 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.570435 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.570507 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.570634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] standard_threads = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.570722 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] standard_threads = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.570793 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.570858 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.570926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.570991 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.571058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.571164 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] use_journal = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.571243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.571339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] use_json = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.571422 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] use_journal = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.571513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] use_stderr = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.571590 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] use_json = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.571687 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] use_syslog = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.571765 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] use_stderr = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.571866 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] use_syslog = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.571948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.572106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:38:20.572183 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.572366 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.572446 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.572610 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.572707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.572878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.572964 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.573125 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.573202 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.573360 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.573436 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.573607 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.573683 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.573841 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.573919 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.574084 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.574154 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.574327 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.574418 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.575094 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.575232 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.575366 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.575509 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.575641 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.575751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.575826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.575904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.576030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.576112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.576274 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.576359 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.576510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.576587 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.576774 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.576853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.577027 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.577119 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.577271 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.577355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.577508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.577585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.577745 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.577828 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.578001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.578078 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.578248 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.578323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.578494 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.578649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.578730 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.578801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.578940 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.579018 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.579169 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.579257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.579400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.579483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.579636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.579713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.579878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.579964 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.580104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.580181 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.580332 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.580407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.580565 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.580673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.580831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.580906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.581066 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.581154 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.581311 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.581400 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.581540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.581616 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.581779 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.581856 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.582012 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.582096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.582243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.582326 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.582467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.582566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.582696 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.582766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.582926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.582993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.583161 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.583372 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.583506 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.583639 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.583639 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.583878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.583997 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.584116 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.584245 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.584378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.584520 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.584699 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.584826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.584947 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.585069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.585199 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.585329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.585456 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.585592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.585714 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.585841 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.585964 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.586093 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.586214 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.586336 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.586456 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.586580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.586729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.586853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.586975 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.587097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.587216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.587356 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.587501 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.587623 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.587744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.587863 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.587998 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.588124 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.588252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.588386 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.588520 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.588662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.588785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.588910 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.589043 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.589179 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.589305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.589427 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.589552 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.589676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.589800 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.589933 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.590058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.590803 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.591001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.591201 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.591411 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.591655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.591793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.592234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.592363 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.592496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.592623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.592807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.592890 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.593021 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.593153 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.593281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.593407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.593546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.593688 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.593827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.593954 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.594079 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.594204 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.594337 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.594471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.594596 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.594720 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.594846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.594971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.595096 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.595228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.595355 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.595480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.595606 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.595734 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.595860 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.595998 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.596129 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.596255 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.596382 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.596507 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.596646 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.596782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.596915 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.596915 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.597153 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.597292 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.597418 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.597552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.597677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.597802 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.597927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.598051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.598173 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.598303 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.598425 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.598553 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.598684 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.598810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.598935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.599078 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.599203 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.599203 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.599438 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.599438 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.599675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.599811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] auth.external = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.599936 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.600061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.600186 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.600186 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] auth.external = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.600421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.600560 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.600761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.600761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] auth.password = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.601026 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.601154 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] auth.token = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.601286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.601412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.601538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] auth.password = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.601673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.601799 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] auth.token = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.601933 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.602058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.602184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.602309 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.602442 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.602577 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.602705 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.602830 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.602956 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.603081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.603216 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] credential.caching = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.603342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.603467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.603599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.603726 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.603860 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] credential.caching = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.603985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.604108 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.604241 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.604376 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.604509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.604655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.604782 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.604904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.605026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.605147 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.605280 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.605415 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.605543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.605671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.605808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.605964 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.606180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.606397 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.606582 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.606717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.606848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.606972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.607095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.607305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.607436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.607560 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.607684 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] federation.caching = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.607806 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.607930 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.608061 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.608196 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.608332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] federation.caching = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.608922 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.609004 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.609066 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.609139 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.609202 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.609268 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.609333 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.609393 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.609451 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.609520 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.609581 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.609639 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.609697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.609755 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.609814 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.609814 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.609928 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.609987 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] identity.caching = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.610044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.610102 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.610166 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.610233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.610294 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.610352 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.610411 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] identity.caching = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.610468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.610532 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.610598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.610658 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.610723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.610783 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.610841 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.610898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.610977 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.611039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.611097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.611160 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.611225 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.611284 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.611349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.611409 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.611467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.611467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.611569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.611569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.611679 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.611739 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.611796 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.611854 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.611912 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.611981 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.612042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.612100 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.612157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.612215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.612272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.612338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.612399 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.612457 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.612514 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.612514 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.612616 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.612735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.612799 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.612857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.612932 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.612997 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.613056 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.613122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.613182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.613240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.613297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.613354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.613411 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.613476 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.613536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.613671 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.613743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.613905 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.613975 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.614150 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.614219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.614392 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.614461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.614620 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.614694 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.614855 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.614926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.615104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.615184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.615314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.615383 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.615976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.616040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.616099 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.616157 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.616247 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.616318 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.616378 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.616437 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.616495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.616553 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.616694 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.616788 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.616927 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.616997 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.617156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.617224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.617406 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.617482 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.617794 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.618940 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.618940 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.619178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.619304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.619438 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.619438 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.619678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.619804 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.user = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.619937 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.620070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.620203 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.620328 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.620454 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.620588 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.620726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.620858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.620995 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.user = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.621121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.621245 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.621369 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.621511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.621675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.621885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.622084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.622286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.622447 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.622577 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.622703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.622836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.622962 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.623088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.623212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.623338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.623338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.623592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.623731 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.623857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.623857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.624093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.624093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.624338 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.624470 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.624595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.624595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.624885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.625022 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.625149 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.625274 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.625399 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.625542 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.625667 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.625802 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.625926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.626050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.626176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.626550 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.626683 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.626820 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.626946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.627078 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.627202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.627327 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.627453 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.627595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.627727 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.627855 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.627979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.628104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.628267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.628469 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.628598 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.628744 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.628871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.628997 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.629122 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.629258 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.629394 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.629555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.629704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.629851 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.630006 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.630143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] resource.caching = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.630269 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.630395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.630519 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.630644 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.630771 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.630905 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.631033 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.631158 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.631293 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] resource.caching = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.631419 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.631542 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.631676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.631803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.631929 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.632055 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.632180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.632304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.632437 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.632562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.632702 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] role.caching = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.632826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.632952 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] role.driver = sql {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.633089 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.633225 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.633352 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.633477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.633602 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.633727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.633855 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] role.caching = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.633985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.634113 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] role.driver = sql {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.634240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.634365 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.634497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.634622 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.634764 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.634891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.635023 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.635157 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.635284 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.635409 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.635542 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.635668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.635794 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.635920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.636046 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.636172 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.636306 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.636431 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.636571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.636720 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.636795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.636870 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.636932 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.636994 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.637608 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.637717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.637975 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.638056 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.638118 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.638118 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.638223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.638300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.638471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.638567 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.638631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.638695 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.638754 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.638811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.638869 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.638935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.639261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.639414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.639582 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.639727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.639867 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.640004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.640130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.640258 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.640383 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.640516 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.640714 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.640855 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.640855 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.641094 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.641219 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.641219 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] token.caching = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.641457 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.641602 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.641730 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.641855 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.641979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.642103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.642226 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.642362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.642488 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.642615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.642740 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.642865 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.642990 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.643123 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.643249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] token.caching = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.643385 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.643510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.643636 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.643762 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.643895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.644022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.644146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.644272 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.644396 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.644396 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.644655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.644655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.644893 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.644893 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.645141 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.645279 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.645406 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.645406 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.645702 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.645832 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.645959 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.connection = **** {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.646098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.646232 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.646365 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.646491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.646616 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.646744 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.646869 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.647004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.647139 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.647263 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.647389 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.647513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.647513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.647751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.647884 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.648010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.connection = **** {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.648143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.648277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.648402 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.648528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.648716 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.648924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.649052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.649178 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.649305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.649429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.649553 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.649688 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.649815 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.649942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.650068 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.650194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.650320 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.650452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.650588 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.650715 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.650862 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 10:38:20.650989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.650989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.650989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.650989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.650989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.650989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.650989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.650989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:38:20.650989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 10:38:20.678029 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.678248 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.678468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.679382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.679618 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.679845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.687119 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.688403 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.715084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.716011 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.716972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.717208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.858739 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.859167 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.907912 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.908146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.909050 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.909292 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.972142 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.972373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.972600 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.972753 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.973093 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.973178 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.973250 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.973336 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.973411 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.973483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.973625 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.973845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.998453 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.998597 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.998678 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.998741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.998896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.998979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.999119 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.999199 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.999340 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.999420 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.999554 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.999643 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.999768 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:20.999848 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:21.011011 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:21.011212 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:21.023880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:21.024118 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:21.024213 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:21.024339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:21.024419 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:21.024557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:21.024680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:21.024801 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:21.024882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:21.025016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:21.025094 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:21.025228 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:21.025308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92003) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:21.025440 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92004) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:38:21.042956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.043173 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 10:38:21.043920 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.044124 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.044208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 10:38:21.044327 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 10:38:21.044482 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.044590 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.044708 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 10:38:21.044879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.044960 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.045139 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.045219 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.045396 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.045481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.045682 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.056171 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.056410 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.056490 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.056708 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.056791 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.056975 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.057055 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.057252 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.065829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92003) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.065998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92004) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.069114 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92003) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.069266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92004) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.069395 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.069543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.069678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.069819 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.069959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.070095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.070241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.070372 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.070499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.070627 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.070768 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.070889 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.071038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.071156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.071305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.071422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.071576 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.071692 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.071839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.071955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.099304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.099404 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.100596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92003) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.100908 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.100990 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92004) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.101197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.106263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92003) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.106489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92004) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.106656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.106877 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.106955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.107171 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.114214 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92003) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.114459 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.114540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92004) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.114738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.118938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92003) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.119224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.119303 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92004) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.119502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.119586 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.119778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.119857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.120048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.120136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.120321 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.120399 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.120589 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.120684 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.120880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.120961 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.121143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.141009 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.141277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.141358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.141622 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.145848 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92003) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.146291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92004) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.149457 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.149862 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.150026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.150259 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.155061 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92003) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.155353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92004) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.158665 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92003) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.158937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92004) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.162301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.162563 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.162645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.162861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.162952 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.163140 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.163220 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.163413 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.163493 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.163685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.163766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.163958 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.182604 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92003) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.182767 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92004) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.182886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.183047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.183162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.183313 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.183432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.183578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.191871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.191972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.193605 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.193688 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.193881 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.193961 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.197055 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92004) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.197144 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92003) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.197331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.197413 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.197607 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.197689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.197894 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.197973 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.198170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.198259 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.211827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92004) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.212036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92003) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.212119 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.212317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.212411 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.212608 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.212763 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.212912 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.214160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.214447 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.214529 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.214727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.214806 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.215025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.233436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92004) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.233913 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92003) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.236712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92004) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.237208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92003) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.239963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.240464 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.241687 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.242213 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.243316 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92004) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.243590 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.243847 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92003) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.243940 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.244127 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.244408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.252063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.252911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.253683 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92004) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.254514 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92003) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.256889 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.257185 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.257570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.257707 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.257846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.258005 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.258395 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.258683 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.267430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92004) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.267712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.267986 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.268265 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92003) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.268552 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.268857 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.275735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92004) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.276062 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.276271 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.276542 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.276622 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92003) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:38:21.276853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.276939 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.277206 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.277286 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.277483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.277572 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.277801 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.277882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.278074 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.278233 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.278382 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.278570 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.278660 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.278845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.278930 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.279111 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.279202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.279388 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.279470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92004) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.279672 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.279945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.280221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.280488 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92003) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:38:21.318271 dv-cinder-846146-4-smb devstack@keystone.service[92004]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5571a0abb9c0 pid: 92004 (default app) Jun 23 10:38:21.319508 dv-cinder-846146-4-smb devstack@keystone.service[92003]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5571a0abb9c0 pid: 92003 (default app) Jun 23 10:38:21.321630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08bb36-cbf7-4790-80ae-3c4b9b2c6e7c None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:21.321925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08bb36-cbf7-4790-80ae-3c4b9b2c6e7c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:21.322205 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08bb36-cbf7-4790-80ae-3c4b9b2c6e7c None None] PATH_INFO: `/v3` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:21.326548 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Thu Jun 23 10:38:21 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:29.953185 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed628b70-10b3-42f8-9e9d-433104ee4eb2 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:29.954224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed628b70-10b3-42f8-9e9d-433104ee4eb2 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:29.954224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed628b70-10b3-42f8-9e9d-433104ee4eb2 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:29.958731 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:38:29.964449 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2be2cf-bb6b-4048-adfb-4c6e6a5310ba None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:29.964853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2be2cf-bb6b-4048-adfb-4c6e6a5310ba None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:29.965066 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2be2cf-bb6b-4048-adfb-4c6e6a5310ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:30.036391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: INFO dbcounter [None req-cb2be2cf-bb6b-4048-adfb-4c6e6a5310ba None None] Registered counter for database keystone Jun 23 10:38:30.057620 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG oslo_db.sqlalchemy.engines [None req-cb2be2cf-bb6b-4048-adfb-4c6e6a5310ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92004) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:38:30.064575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writer thread running {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:38:30.245842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG passlib.handlers.bcrypt [None req-cb2be2cf-bb6b-4048-adfb-4c6e6a5310ba None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92004) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 10:38:30.246179 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG passlib.handlers.bcrypt [None req-cb2be2cf-bb6b-4048-adfb-4c6e6a5310ba None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92004) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 10:38:30.307131 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-cb2be2cf-bb6b-4048-adfb-4c6e6a5310ba None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:30.309179 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-cb2be2cf-bb6b-4048-adfb-4c6e6a5310ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:30.436516 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 10:38:30.587499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed628b70-10b3-42f8-9e9d-433104ee4eb2 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:30.659401 dv-cinder-846146-4-smb devstack@keystone.service[92003]: INFO dbcounter [None req-ed628b70-10b3-42f8-9e9d-433104ee4eb2 None None] Registered counter for database keystone Jun 23 10:38:30.679040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG oslo_db.sqlalchemy.engines [None req-ed628b70-10b3-42f8-9e9d-433104ee4eb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:38:30.686163 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writer thread running {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:38:30.808699 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed628b70-10b3-42f8-9e9d-433104ee4eb2 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:30.814031 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ef8d3-6cf4-4159-89e0-a8d7fd4d2dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:30.814704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ef8d3-6cf4-4159-89e0-a8d7fd4d2dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:30.814993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ef8d3-6cf4-4159-89e0-a8d7fd4d2dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:30.815277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ef8d3-6cf4-4159-89e0-a8d7fd4d2dc7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:30.823719 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ef8d3-6cf4-4159-89e0-a8d7fd4d2dc7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:30.877035 dv-cinder-846146-4-smb devstack@keystone.service[92003]: WARNING keystone.common.rbac_enforcer.enforcer [None req-504ef8d3-6cf4-4159-89e0-a8d7fd4d2dc7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 10:38:30.877377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ef8d3-6cf4-4159-89e0-a8d7fd4d2dc7 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:30.888023 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Thu Jun 23 10:38:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 10:38:30.894604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2be2cf-bb6b-4048-adfb-4c6e6a5310ba None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:30.910402 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2be2cf-bb6b-4048-adfb-4c6e6a5310ba None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:30.915320 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facd1e9-c987-4cf4-bcb5-2912304e60a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:30.916534 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facd1e9-c987-4cf4-bcb5-2912304e60a9 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:30.916853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facd1e9-c987-4cf4-bcb5-2912304e60a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:30.917216 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facd1e9-c987-4cf4-bcb5-2912304e60a9 admin admin] PATH_INFO: `/v3/projects/7866f693106e4323a208242e01a5fef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:30.922533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facd1e9-c987-4cf4-bcb5-2912304e60a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=7866f693106e4323a208242e01a5fef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:30.980440 dv-cinder-846146-4-smb devstack@keystone.service[92004]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8facd1e9-c987-4cf4-bcb5-2912304e60a9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 10:38:30.981136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facd1e9-c987-4cf4-bcb5-2912304e60a9 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:30.985641 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Thu Jun 23 10:38:30 2022] GET /identity/v3/projects/7866f693106e4323a208242e01a5fef9 => generated 344 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:33.005845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af64c43-12eb-4211-af60-7b397e4041e2 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:33.006339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af64c43-12eb-4211-af60-7b397e4041e2 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:33.006339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af64c43-12eb-4211-af60-7b397e4041e2 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:33.010659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:33.016749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8c984-ce06-49fd-9d81-5e59d39d5e47 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:33.017156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8c984-ce06-49fd-9d81-5e59d39d5e47 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:33.017309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8c984-ce06-49fd-9d81-5e59d39d5e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:33.035703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-4ed8c984-ce06-49fd-9d81-5e59d39d5e47 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:33.037257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4ed8c984-ce06-49fd-9d81-5e59d39d5e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:33.045032 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 10:38:33.067838 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af64c43-12eb-4211-af60-7b397e4041e2 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:33.080424 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af64c43-12eb-4211-af60-7b397e4041e2 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:33.084618 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288f21f-d2d3-4cb7-8ffd-922d4ab64220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:33.085339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288f21f-d2d3-4cb7-8ffd-922d4ab64220 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:33.085630 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288f21f-d2d3-4cb7-8ffd-922d4ab64220 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:33.085914 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288f21f-d2d3-4cb7-8ffd-922d4ab64220 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:33.093662 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288f21f-d2d3-4cb7-8ffd-922d4ab64220 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:33.095439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288f21f-d2d3-4cb7-8ffd-922d4ab64220 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:33.104077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Thu Jun 23 10:38:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 10:38:33.109834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8c984-ce06-49fd-9d81-5e59d39d5e47 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:33.118734 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8c984-ce06-49fd-9d81-5e59d39d5e47 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:33.123675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefb154-7336-4133-9668-65823e67e865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:33.124537 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefb154-7336-4133-9668-65823e67e865 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:33.124861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefb154-7336-4133-9668-65823e67e865 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:33.125144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefb154-7336-4133-9668-65823e67e865 admin admin] PATH_INFO: `/v3/users/587163b8ce4f4c51b7955cf5936eed6d` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:33.126528 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefb154-7336-4133-9668-65823e67e865 admin admin] RBAC: Authorizing `identity:get_user(user_id=587163b8ce4f4c51b7955cf5936eed6d)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:33.128668 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefb154-7336-4133-9668-65823e67e865 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:33.130223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Thu Jun 23 10:38:33 2022] GET /identity/v3/users/587163b8ce4f4c51b7955cf5936eed6d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:35.237538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03918cc-4583-4cda-bb9b-0cd1f1b98883 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:35.238048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03918cc-4583-4cda-bb9b-0cd1f1b98883 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:35.238164 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03918cc-4583-4cda-bb9b-0cd1f1b98883 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:35.239437 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:35.242140 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b3c42-e891-4daf-8dda-ee5cf13f0b02 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:35.242579 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b3c42-e891-4daf-8dda-ee5cf13f0b02 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:35.242846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b3c42-e891-4daf-8dda-ee5cf13f0b02 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:35.244117 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c12d33-b914-4234-bef8-f15ee8a5f648 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:35.244227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:38:35.244407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c12d33-b914-4234-bef8-f15ee8a5f648 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:35.244709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c12d33-b914-4234-bef8-f15ee8a5f648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:35.250044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7f458-d5ef-4211-90c6-fa290223c9b6 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:35.250337 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7f458-d5ef-4211-90c6-fa290223c9b6 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:35.250838 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7f458-d5ef-4211-90c6-fa290223c9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:35.267308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-71c7f458-d5ef-4211-90c6-fa290223c9b6 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:35.268512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-71c7f458-d5ef-4211-90c6-fa290223c9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:35.284130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG passlib.handlers.bcrypt [None req-91c12d33-b914-4234-bef8-f15ee8a5f648 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92003) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 10:38:35.284559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG passlib.handlers.bcrypt [None req-91c12d33-b914-4234-bef8-f15ee8a5f648 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92003) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 10:38:35.330058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-91c12d33-b914-4234-bef8-f15ee8a5f648 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:35.331643 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-91c12d33-b914-4234-bef8-f15ee8a5f648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:35.350110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:38:35.374994 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7f458-d5ef-4211-90c6-fa290223c9b6 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:35.398515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:35.431782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 6/13] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:38:35.453884 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c12d33-b914-4234-bef8-f15ee8a5f648 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:35.480507 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7f458-d5ef-4211-90c6-fa290223c9b6 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:35.513459 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff076e6b-f528-456f-9a53-bda5d35e247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:35.514195 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff076e6b-f528-456f-9a53-bda5d35e247b None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:35.514484 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff076e6b-f528-456f-9a53-bda5d35e247b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:35.514759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff076e6b-f528-456f-9a53-bda5d35e247b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:35.526037 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff076e6b-f528-456f-9a53-bda5d35e247b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:35.537736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-ff076e6b-f528-456f-9a53-bda5d35e247b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:35.537736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:35.537736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:35.537736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:35.537736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:35.537736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:35.537736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:35.537736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:35.537736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:35.537736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:35.537736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:35.537736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:35.537736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:35.537736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:35.537736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:35.537736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:35.538654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:35.538654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:35.538654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:35.538654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:35.538654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:35.538654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:35.538654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:35.538654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:35.538654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:35.538654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:35.538654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:35.538654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:35.538654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:35.538654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:35.538654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:35.538654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:35.539472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:35.539472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:35.539472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:35.539472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:35.539472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:35.539472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:35.539472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:35.539472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:35.539472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:35.539472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:35.539472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:35.539472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:38:35.539472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 8/14] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:38:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:38:35.545351 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff076e6b-f528-456f-9a53-bda5d35e247b None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:35.556556 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c12d33-b914-4234-bef8-f15ee8a5f648 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:35.558912 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:35.594179 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72fb42-7b32-4627-a618-b585585fef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:35.595068 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72fb42-7b32-4627-a618-b585585fef6e None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:35.595353 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72fb42-7b32-4627-a618-b585585fef6e None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:35.595630 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72fb42-7b32-4627-a618-b585585fef6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:35.627934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:35.645790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff076e6b-f528-456f-9a53-bda5d35e247b None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:35.665566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72fb42-7b32-4627-a618-b585585fef6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:35.667104 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72fb42-7b32-4627-a618-b585585fef6e None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:35.679751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9310f-bfbf-405d-bd34-15680dca7ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:35.680428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9310f-bfbf-405d-bd34-15680dca7ee1 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:35.680743 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9310f-bfbf-405d-bd34-15680dca7ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:35.681025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9310f-bfbf-405d-bd34-15680dca7ee1 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:35.681780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9310f-bfbf-405d-bd34-15680dca7ee1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:35.682112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9310f-bfbf-405d-bd34-15680dca7ee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:35.683509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9310f-bfbf-405d-bd34-15680dca7ee1 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:35.695122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 9/15] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:38:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:35.701231 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9310f-bfbf-405d-bd34-15680dca7ee1 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:35.765062 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 7/16] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:38:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 10:38:35.770534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72fb42-7b32-4627-a618-b585585fef6e None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:35.773288 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:35.798982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9310f-bfbf-405d-bd34-15680dca7ee1 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:35.832690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a9e9d-b72e-4386-adff-a3458fb49108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:35.833570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a9e9d-b72e-4386-adff-a3458fb49108 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:35.833857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a9e9d-b72e-4386-adff-a3458fb49108 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:35.834136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a9e9d-b72e-4386-adff-a3458fb49108 None admin] PATH_INFO: `/v3/users/587163b8ce4f4c51b7955cf5936eed6d` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:35.835350 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a9e9d-b72e-4386-adff-a3458fb49108 None admin] RBAC: Authorizing `identity:get_user(user_id=587163b8ce4f4c51b7955cf5936eed6d)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:35.836850 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a9e9d-b72e-4386-adff-a3458fb49108 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:35.838937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 10/17] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:35 2022] GET /identity/v3/users/587163b8ce4f4c51b7955cf5936eed6d => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:35.844360 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a9e9d-b72e-4386-adff-a3458fb49108 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:35.859059 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:35.867941 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72fb42-7b32-4627-a618-b585585fef6e None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:35.903520 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5a687-6e8f-4d83-ac10-4a1d81111c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:35.904524 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5a687-6e8f-4d83-ac10-4a1d81111c15 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:35.904847 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5a687-6e8f-4d83-ac10-4a1d81111c15 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:35.905133 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5a687-6e8f-4d83-ac10-4a1d81111c15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:35.925480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5a687-6e8f-4d83-ac10-4a1d81111c15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:35.926943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5a687-6e8f-4d83-ac10-4a1d81111c15 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:35.942351 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a9e9d-b72e-4386-adff-a3458fb49108 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:35.947531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-d7d5a687-6e8f-4d83-ac10-4a1d81111c15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:35.947531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:35.947531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:35.947531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:35.947531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:35.947531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:35.947531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:35.947531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:35.947531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:35.947531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:35.947531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:35.947531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:35.947531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:38:35.947531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:38:35.947531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:38:35.948505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:38:35.948505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:35.948505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:35.948505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:35.948505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:35.948505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:35.948505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:35.948505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:35.948505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:35.948505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:35.948505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:35.948505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:35.948505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:35.948505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:35.948505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:35.948505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:35.948505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:35.949537 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:38:35.949537 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:38:35.949537 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:35.949537 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:38:35.949537 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 8/18] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:38:35.956142 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5a687-6e8f-4d83-ac10-4a1d81111c15 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:35.978008 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea07aa2-69b4-4a1a-8116-3465a2f384ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:35.978812 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea07aa2-69b4-4a1a-8116-3465a2f384ca None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:35.979096 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea07aa2-69b4-4a1a-8116-3465a2f384ca None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:35.979372 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea07aa2-69b4-4a1a-8116-3465a2f384ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:35.980565 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea07aa2-69b4-4a1a-8116-3465a2f384ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:35.982983 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea07aa2-69b4-4a1a-8116-3465a2f384ca None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:35.984580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 11/19] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:35.990261 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea07aa2-69b4-4a1a-8116-3465a2f384ca None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:36.011805 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:36.058609 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5a687-6e8f-4d83-ac10-4a1d81111c15 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:36.070947 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:36.089180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea07aa2-69b4-4a1a-8116-3465a2f384ca None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:36.091383 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b5ff0-4b62-4922-ad2f-2e77997eb284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:36.092047 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b5ff0-4b62-4922-ad2f-2e77997eb284 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:36.092363 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b5ff0-4b62-4922-ad2f-2e77997eb284 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:36.092663 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b5ff0-4b62-4922-ad2f-2e77997eb284 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:36.093391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b5ff0-4b62-4922-ad2f-2e77997eb284 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:36.093703 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b5ff0-4b62-4922-ad2f-2e77997eb284 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:36.095096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b5ff0-4b62-4922-ad2f-2e77997eb284 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:36.112769 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 9/20] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:36.124138 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16843e-c825-40ac-84b1-80c6207abd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:36.124873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16843e-c825-40ac-84b1-80c6207abd32 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:36.125158 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16843e-c825-40ac-84b1-80c6207abd32 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:36.125434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16843e-c825-40ac-84b1-80c6207abd32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:36.126287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16843e-c825-40ac-84b1-80c6207abd32 None admin] RBAC: Adding query filter params (role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.domain.id=default, user.id=587163b8ce4f4c51b7955cf5936eed6d) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:36.126602 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16843e-c825-40ac-84b1-80c6207abd32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:36.128352 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16843e-c825-40ac-84b1-80c6207abd32 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:36.136008 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 12/21] 10.222.0.20 () {56 vars in 1322 bytes} [Thu Jun 23 10:38:35 2022] GET /identity/v3/role_assignments?user.id=587163b8ce4f4c51b7955cf5936eed6d&scope.domain.id=default&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:38.372234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca266d-383a-4325-a7a8-b3eff2adca1d None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:38.372805 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca266d-383a-4325-a7a8-b3eff2adca1d None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:38.373184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca266d-383a-4325-a7a8-b3eff2adca1d None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:38.374825 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 10/22] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:38.380494 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b846a9-260d-4add-93d4-d0635a91f820 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:38.380910 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b846a9-260d-4add-93d4-d0635a91f820 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:38.381093 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b846a9-260d-4add-93d4-d0635a91f820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:38.405666 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-38b846a9-260d-4add-93d4-d0635a91f820 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:38.406885 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-38b846a9-260d-4add-93d4-d0635a91f820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:38.506220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 13/23] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:38:38.540835 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca266d-383a-4325-a7a8-b3eff2adca1d None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:38.550419 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566496b-bfae-417f-a1a7-686761f01c10 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:38.550703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566496b-bfae-417f-a1a7-686761f01c10 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:38.550990 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566496b-bfae-417f-a1a7-686761f01c10 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:38.553135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 14/24] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:38:38.560860 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186510fd-7643-4a6f-8885-289811dc15bd None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:38.561159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186510fd-7643-4a6f-8885-289811dc15bd None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:38.561449 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186510fd-7643-4a6f-8885-289811dc15bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:38.591359 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-186510fd-7643-4a6f-8885-289811dc15bd None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:38.592839 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-186510fd-7643-4a6f-8885-289811dc15bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:38.719637 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca266d-383a-4325-a7a8-b3eff2adca1d None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:38.741967 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 15/25] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:38:38.748182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:38.781493 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186510fd-7643-4a6f-8885-289811dc15bd None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:38.786688 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181520a0-626c-4f78-bde6-bff2c6263c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:38.787039 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:38.787505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181520a0-626c-4f78-bde6-bff2c6263c0f None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:38.787804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181520a0-626c-4f78-bde6-bff2c6263c0f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:38.788096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181520a0-626c-4f78-bde6-bff2c6263c0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:38.815986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181520a0-626c-4f78-bde6-bff2c6263c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:38.825011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-181520a0-626c-4f78-bde6-bff2c6263c0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:38.825011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:38.825011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:38.825011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:38.825011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:38.825011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:38.825011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:38.825011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:38.825011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:38.825011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:38.825011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:38.825011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:38.825011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:38.825011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:38.825011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:38.825011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:38.825891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:38.825891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:38.825891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:38.825891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:38.825891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:38.825891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:38.825891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:38.825891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:38.825891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:38.825891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:38.825891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:38.825891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:38.825891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:38.825891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:38.825891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:38.825891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:38.826636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:38.826636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:38.826636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:38.826636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:38.826636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:38.826636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:38.826636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:38.826636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:38.826636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:38.826636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:38.826636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:38.826636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:38:38.829432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 11/26] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:38:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:38.837659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181520a0-626c-4f78-bde6-bff2c6263c0f None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:38.962639 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186510fd-7643-4a6f-8885-289811dc15bd None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:39.028922 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968b39b-8e00-4475-909f-5a1b5186a0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:39.030096 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968b39b-8e00-4475-909f-5a1b5186a0d6 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:39.031390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968b39b-8e00-4475-909f-5a1b5186a0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:39.032553 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968b39b-8e00-4475-909f-5a1b5186a0d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:39.053295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968b39b-8e00-4475-909f-5a1b5186a0d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:39.055191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968b39b-8e00-4475-909f-5a1b5186a0d6 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:39.072601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181520a0-626c-4f78-bde6-bff2c6263c0f None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:39.097167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-5968b39b-8e00-4475-909f-5a1b5186a0d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:39.097167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:39.097167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:39.097167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:39.097167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:39.097167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:39.097167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:39.097167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:39.097167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:39.097167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:39.097167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:39.097167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:39.097167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:38:39.097167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:38:39.097167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:38:39.098191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:38:39.098191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:39.098191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:39.098191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:39.098191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:39.098191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:39.098191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:39.098191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:39.098191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:39.098191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:39.098191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:39.098191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:39.098191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:39.098191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:39.098191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:39.098191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:39.098191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:39.099165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:38:39.099165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:38:39.099165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:39.099165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:38:39.105288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 16/27] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:38:39.110392 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be8723-eb4b-449d-896a-bfbb6c72f703 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:39.111036 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be8723-eb4b-449d-896a-bfbb6c72f703 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:39.112381 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be8723-eb4b-449d-896a-bfbb6c72f703 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:39.116146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 17/28] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:39.117135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be8723-eb4b-449d-896a-bfbb6c72f703 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:39.154222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fe219-a482-4782-87a0-e22621b647a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:39.154917 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fe219-a482-4782-87a0-e22621b647a3 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:39.155212 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fe219-a482-4782-87a0-e22621b647a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:39.155495 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fe219-a482-4782-87a0-e22621b647a3 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:39.156332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fe219-a482-4782-87a0-e22621b647a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:39.156577 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fe219-a482-4782-87a0-e22621b647a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:39.158004 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fe219-a482-4782-87a0-e22621b647a3 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:39.174761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 12/29] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:38:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:39.176684 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dd35e-0f17-44b0-84fd-be4e511c2ffd None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:39.177348 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dd35e-0f17-44b0-84fd-be4e511c2ffd None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:39.177834 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dd35e-0f17-44b0-84fd-be4e511c2ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:39.179431 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:39.199697 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-8c6dd35e-0f17-44b0-84fd-be4e511c2ffd None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:39.202254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-8c6dd35e-0f17-44b0-84fd-be4e511c2ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:39.227537 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be8723-eb4b-449d-896a-bfbb6c72f703 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:39.238007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:39.273549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bba69-7099-43b8-beaa-d8eb2efa0dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:39.274430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bba69-7099-43b8-beaa-d8eb2efa0dca None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:39.275058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bba69-7099-43b8-beaa-d8eb2efa0dca None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:39.275508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bba69-7099-43b8-beaa-d8eb2efa0dca None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:39.277346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bba69-7099-43b8-beaa-d8eb2efa0dca None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:39.277856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bba69-7099-43b8-beaa-d8eb2efa0dca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:39.279990 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bba69-7099-43b8-beaa-d8eb2efa0dca None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:39.284047 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 13/30] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:38:39.289968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c75b84-1247-4b0d-83f7-c8f2081e8b3c None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:39.290405 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c75b84-1247-4b0d-83f7-c8f2081e8b3c None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:39.290793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c75b84-1247-4b0d-83f7-c8f2081e8b3c None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:39.292466 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 14/31] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:39.293357 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c75b84-1247-4b0d-83f7-c8f2081e8b3c None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:39.300577 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 18/32] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:39.306283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7dc55-fd03-48d9-96ed-74e3e319999c None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:39.306791 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7dc55-fd03-48d9-96ed-74e3e319999c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:39.307459 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7dc55-fd03-48d9-96ed-74e3e319999c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:39.337647 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-91b7dc55-fd03-48d9-96ed-74e3e319999c None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:39.339406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-91b7dc55-fd03-48d9-96ed-74e3e319999c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:39.414899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 19/33] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 23 10:38:39.415924 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7dc55-fd03-48d9-96ed-74e3e319999c None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:39.440010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c75b84-1247-4b0d-83f7-c8f2081e8b3c None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:39.475086 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:39.483616 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0ca82-bda3-47a1-8c40-e952fd52178b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:39.484697 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0ca82-bda3-47a1-8c40-e952fd52178b None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:39.486343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0ca82-bda3-47a1-8c40-e952fd52178b None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:39.486343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0ca82-bda3-47a1-8c40-e952fd52178b None admin] PATH_INFO: `/v3/users/587163b8ce4f4c51b7955cf5936eed6d` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:39.488070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0ca82-bda3-47a1-8c40-e952fd52178b None admin] RBAC: Authorizing `identity:get_user(user_id=587163b8ce4f4c51b7955cf5936eed6d)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:39.490253 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0ca82-bda3-47a1-8c40-e952fd52178b None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:39.493104 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 15/34] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:39 2022] GET /identity/v3/users/587163b8ce4f4c51b7955cf5936eed6d => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:39.494014 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0ca82-bda3-47a1-8c40-e952fd52178b None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:39.534686 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:39.536625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7dc55-fd03-48d9-96ed-74e3e319999c None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:39.574930 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe44863-18e3-4ca3-8e79-b362034880f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:39.575950 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe44863-18e3-4ca3-8e79-b362034880f9 None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:39.576354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe44863-18e3-4ca3-8e79-b362034880f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:39.576772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe44863-18e3-4ca3-8e79-b362034880f9 None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:39.577603 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe44863-18e3-4ca3-8e79-b362034880f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:39.579197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe44863-18e3-4ca3-8e79-b362034880f9 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:39.603235 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0ca82-bda3-47a1-8c40-e952fd52178b None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:39.647602 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ce66c-51b0-4b32-a827-9022f56b55ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:39.648363 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ce66c-51b0-4b32-a827-9022f56b55ee None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:39.648682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ce66c-51b0-4b32-a827-9022f56b55ee None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:39.648971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ce66c-51b0-4b32-a827-9022f56b55ee None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:39.649776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ce66c-51b0-4b32-a827-9022f56b55ee None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:39.651183 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ce66c-51b0-4b32-a827-9022f56b55ee None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:39.801060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 20/35] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 23 10:38:39 2022] POST /identity/v3/projects => generated 301 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:38:39.802374 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe44863-18e3-4ca3-8e79-b362034880f9 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:39.868032 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 16/36] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jun 23 10:38:39 2022] POST /identity/v3/roles => generated 219 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:38:39.869611 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ce66c-51b0-4b32-a827-9022f56b55ee None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:40.017948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:40.023144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe44863-18e3-4ca3-8e79-b362034880f9 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:40.037130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:40.044790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ce66c-51b0-4b32-a827-9022f56b55ee None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:40.067380 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96133b1f-853d-4d9d-ac07-848366f9d560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:40.068429 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96133b1f-853d-4d9d-ac07-848366f9d560 None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:40.069184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96133b1f-853d-4d9d-ac07-848366f9d560 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:40.072793 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96133b1f-853d-4d9d-ac07-848366f9d560 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:40.072793 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96133b1f-853d-4d9d-ac07-848366f9d560 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:40.072793 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96133b1f-853d-4d9d-ac07-848366f9d560 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:40.087273 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343dd70-d312-4515-8844-a7b40cd4e26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:40.088117 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343dd70-d312-4515-8844-a7b40cd4e26b None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:40.088410 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343dd70-d312-4515-8844-a7b40cd4e26b None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:40.088739 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343dd70-d312-4515-8844-a7b40cd4e26b None admin] PATH_INFO: `/v3/domains/default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:40.090125 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343dd70-d312-4515-8844-a7b40cd4e26b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:40.092442 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343dd70-d312-4515-8844-a7b40cd4e26b None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:40.096752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 17/37] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:40.097941 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8253d2-78cc-429d-b15b-f315dac00fa2 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:40.097941 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8253d2-78cc-429d-b15b-f315dac00fa2 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:40.098187 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8253d2-78cc-429d-b15b-f315dac00fa2 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:40.099874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 18/38] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:40.104241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8253d2-78cc-429d-b15b-f315dac00fa2 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:40.154392 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 21/39] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jun 23 10:38:39 2022] POST /identity/v3/roles => generated 225 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:38:40.155829 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4847d-2ab6-407b-a79b-879cb37aacdc None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:40.156130 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4847d-2ab6-407b-a79b-879cb37aacdc None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:40.156416 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4847d-2ab6-407b-a79b-879cb37aacdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:40.238461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8253d2-78cc-429d-b15b-f315dac00fa2 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:40.282045 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a698c-75b4-48df-8db3-513a8e328473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:40.282953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a698c-75b4-48df-8db3-513a8e328473 None admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:40.283247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a698c-75b4-48df-8db3-513a8e328473 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:40.283535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a698c-75b4-48df-8db3-513a8e328473 None admin] PATH_INFO: `/v3/domains/default/users/587163b8ce4f4c51b7955cf5936eed6d/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:40.285805 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a698c-75b4-48df-8db3-513a8e328473 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=587163b8ce4f4c51b7955cf5936eed6d, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:40.286965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-fcf4847d-2ab6-407b-a79b-879cb37aacdc None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:40.287305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a698c-75b4-48df-8db3-513a8e328473 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:40.288555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-fcf4847d-2ab6-407b-a79b-879cb37aacdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:40.359964 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 22/40] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:38:40.361414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652140a-391f-4280-ad3a-8c7a8c24826a None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:40.361716 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652140a-391f-4280-ad3a-8c7a8c24826a None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:40.364060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652140a-391f-4280-ad3a-8c7a8c24826a None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:40.364060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 23/41] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:40.368600 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5dd09-84f9-48f2-b671-54f494926706 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:40.369018 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5dd09-84f9-48f2-b671-54f494926706 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:40.369310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5dd09-84f9-48f2-b671-54f494926706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:40.386793 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-0cb5dd09-84f9-48f2-b671-54f494926706 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:40.388566 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-0cb5dd09-84f9-48f2-b671-54f494926706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:40.396005 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 19/42] 10.222.0.20 () {58 vars in 1361 bytes} [Thu Jun 23 10:38:40 2022] PUT /identity/v3/domains/default/users/587163b8ce4f4c51b7955cf5936eed6d/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:38:40.397105 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a698c-75b4-48df-8db3-513a8e328473 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:40.431300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:40.472115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 24/43] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:38:40.495064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5dd09-84f9-48f2-b671-54f494926706 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:40.516620 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:40.516841 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a698c-75b4-48df-8db3-513a8e328473 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:40.563058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a6007-0cb8-4698-9d10-290571b0debb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:40.563870 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a6007-0cb8-4698-9d10-290571b0debb None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:40.564162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a6007-0cb8-4698-9d10-290571b0debb None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:40.564446 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a6007-0cb8-4698-9d10-290571b0debb None admin] PATH_INFO: `/v3/domains/default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:40.565674 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a6007-0cb8-4698-9d10-290571b0debb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:40.567151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a6007-0cb8-4698-9d10-290571b0debb None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:40.568817 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 20/44] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:40.575706 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a6007-0cb8-4698-9d10-290571b0debb None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:40.607158 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5dd09-84f9-48f2-b671-54f494926706 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:40.650729 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35b292-3c4c-4d39-bc35-30d5f62f1d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:40.651436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35b292-3c4c-4d39-bc35-30d5f62f1d64 None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:40.651730 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35b292-3c4c-4d39-bc35-30d5f62f1d64 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:40.652018 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35b292-3c4c-4d39-bc35-30d5f62f1d64 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:40.652839 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35b292-3c4c-4d39-bc35-30d5f62f1d64 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:40.654411 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35b292-3c4c-4d39-bc35-30d5f62f1d64 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:40.679748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:40.689045 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a6007-0cb8-4698-9d10-290571b0debb None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:40.729991 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 25/45] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jun 23 10:38:40 2022] POST /identity/v3/roles => generated 223 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:38:40.730225 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a1a11-f2a2-4a20-98be-2723125fcc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:40.730225 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a1a11-f2a2-4a20-98be-2723125fcc47 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:40.730225 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a1a11-f2a2-4a20-98be-2723125fcc47 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:40.730225 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a1a11-f2a2-4a20-98be-2723125fcc47 None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:40.730517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a1a11-f2a2-4a20-98be-2723125fcc47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:40.730517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a1a11-f2a2-4a20-98be-2723125fcc47 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:40.820288 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 21/46] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 23 10:38:40 2022] POST /identity/v3/projects => generated 312 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:38:42.444191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763acef-b08c-4d81-b0e7-749a32a31f66 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:42.444755 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763acef-b08c-4d81-b0e7-749a32a31f66 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:42.444852 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763acef-b08c-4d81-b0e7-749a32a31f66 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:42.446285 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 26/47] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:42.452134 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177af6e-984a-456a-9c71-6b73bc33fc82 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:42.452537 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177af6e-984a-456a-9c71-6b73bc33fc82 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:42.452738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177af6e-984a-456a-9c71-6b73bc33fc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:42.470103 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-b177af6e-984a-456a-9c71-6b73bc33fc82 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:42.471623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b177af6e-984a-456a-9c71-6b73bc33fc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:42.538465 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 22/48] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:38:42.561324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763acef-b08c-4d81-b0e7-749a32a31f66 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:42.643307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:42.664977 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763acef-b08c-4d81-b0e7-749a32a31f66 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:42.698642 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09d9b6-242e-46e7-a8da-ab239aa97a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:42.699372 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09d9b6-242e-46e7-a8da-ab239aa97a4a None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:42.699666 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09d9b6-242e-46e7-a8da-ab239aa97a4a None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:42.700539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09d9b6-242e-46e7-a8da-ab239aa97a4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:42.711311 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09d9b6-242e-46e7-a8da-ab239aa97a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:42.718896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-ff09d9b6-242e-46e7-a8da-ab239aa97a4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:42.718896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:42.718896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:42.718896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:42.718896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:42.718896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:42.718896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:42.718896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:42.718896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:42.718896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:42.718896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:42.718896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:42.718896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:42.718896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:42.718896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:42.718896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:42.719824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:42.719824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:42.719824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:42.719824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:42.719824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:42.719824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:42.719824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:42.719824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:42.719824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:42.719824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:42.719824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:42.719824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:42.719824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:42.719824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:42.719824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:42.719824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:42.720556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:42.720556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:42.720556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:42.720556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:42.720556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:42.720556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:42.720556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:42.720556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:42.720556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:42.720556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:42.720556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:42.720556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:38:42.720556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 27/49] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:38:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:42.725834 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177af6e-984a-456a-9c71-6b73bc33fc82 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:42.798099 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:42.823571 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177af6e-984a-456a-9c71-6b73bc33fc82 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:42.843315 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4123d-fff0-422c-a46e-21fc0c7d7c9c None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:42.843605 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4123d-fff0-422c-a46e-21fc0c7d7c9c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:42.843886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4123d-fff0-422c-a46e-21fc0c7d7c9c None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:42.845330 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 28/50] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:42.850230 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e82a8-355a-4b40-b5f2-5db61a20d310 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:42.850529 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e82a8-355a-4b40-b5f2-5db61a20d310 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:42.850816 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e82a8-355a-4b40-b5f2-5db61a20d310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:42.858424 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c61de-82c1-4e65-b341-ac08222be7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:42.859100 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c61de-82c1-4e65-b341-ac08222be7aa None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:42.859387 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c61de-82c1-4e65-b341-ac08222be7aa None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:42.859665 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c61de-82c1-4e65-b341-ac08222be7aa None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:42.860428 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c61de-82c1-4e65-b341-ac08222be7aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:42.860766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c61de-82c1-4e65-b341-ac08222be7aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:42.862154 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c61de-82c1-4e65-b341-ac08222be7aa None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:42.867146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-bf7e82a8-355a-4b40-b5f2-5db61a20d310 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:42.868339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-bf7e82a8-355a-4b40-b5f2-5db61a20d310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:42.871506 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 23/51] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:38:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:42.877646 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c61de-82c1-4e65-b341-ac08222be7aa None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:42.936459 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 29/52] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:38:42.960289 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e82a8-355a-4b40-b5f2-5db61a20d310 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:43.031164 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:43.068565 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e82a8-355a-4b40-b5f2-5db61a20d310 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:43.083424 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c61de-82c1-4e65-b341-ac08222be7aa None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:43.102442 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac346ec8-45ae-4e03-8dbf-d842b431c6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:43.103244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac346ec8-45ae-4e03-8dbf-d842b431c6fd None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:43.103535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac346ec8-45ae-4e03-8dbf-d842b431c6fd None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:43.103818 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac346ec8-45ae-4e03-8dbf-d842b431c6fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:43.105030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac346ec8-45ae-4e03-8dbf-d842b431c6fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:43.106578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac346ec8-45ae-4e03-8dbf-d842b431c6fd None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:43.108417 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 30/53] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:43.113780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac346ec8-45ae-4e03-8dbf-d842b431c6fd None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:43.118379 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b41f1-843c-4c7d-afbd-1309c5c36b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:43.119264 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b41f1-843c-4c7d-afbd-1309c5c36b2b None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:43.119555 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b41f1-843c-4c7d-afbd-1309c5c36b2b None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:43.119847 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b41f1-843c-4c7d-afbd-1309c5c36b2b None admin] PATH_INFO: `/v3/users/587163b8ce4f4c51b7955cf5936eed6d` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:43.121085 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b41f1-843c-4c7d-afbd-1309c5c36b2b None admin] RBAC: Authorizing `identity:get_user(user_id=587163b8ce4f4c51b7955cf5936eed6d)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:43.122678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b41f1-843c-4c7d-afbd-1309c5c36b2b None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:43.124326 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 24/54] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:42 2022] GET /identity/v3/users/587163b8ce4f4c51b7955cf5936eed6d => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:43.130027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b41f1-843c-4c7d-afbd-1309c5c36b2b None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:43.133459 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:43.211553 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac346ec8-45ae-4e03-8dbf-d842b431c6fd None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:43.236019 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b41f1-843c-4c7d-afbd-1309c5c36b2b None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:43.244080 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f0f5e-2706-486e-8211-344f9498a088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:43.244785 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f0f5e-2706-486e-8211-344f9498a088 None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:43.245099 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f0f5e-2706-486e-8211-344f9498a088 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:43.245384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f0f5e-2706-486e-8211-344f9498a088 None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:43.246120 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f0f5e-2706-486e-8211-344f9498a088 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:43.247866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f0f5e-2706-486e-8211-344f9498a088 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:43.252284 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:43.270085 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b9244-b0f3-4cab-a852-5fc5183bed4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:43.270874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b9244-b0f3-4cab-a852-5fc5183bed4f None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:43.271161 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b9244-b0f3-4cab-a852-5fc5183bed4f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:43.271440 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b9244-b0f3-4cab-a852-5fc5183bed4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:43.272700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b9244-b0f3-4cab-a852-5fc5183bed4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:43.274180 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b9244-b0f3-4cab-a852-5fc5183bed4f None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:43.275784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 25/55] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:43.282305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b9244-b0f3-4cab-a852-5fc5183bed4f None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:43.349156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:43.357657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 31/56] 10.222.0.20 () {60 vars in 1140 bytes} [Thu Jun 23 10:38:43 2022] POST /identity/v3/projects => generated 298 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:38:43.379419 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b9244-b0f3-4cab-a852-5fc5183bed4f None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:43.417795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46711c2d-f688-4c0a-a17e-6579b183957d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:43.418528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46711c2d-f688-4c0a-a17e-6579b183957d None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:43.418766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46711c2d-f688-4c0a-a17e-6579b183957d None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:43.419082 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46711c2d-f688-4c0a-a17e-6579b183957d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:43.420025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46711c2d-f688-4c0a-a17e-6579b183957d None admin] RBAC: Adding query filter params (role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.domain.id=default, user.id=587163b8ce4f4c51b7955cf5936eed6d) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:43.420347 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46711c2d-f688-4c0a-a17e-6579b183957d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:43.421870 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46711c2d-f688-4c0a-a17e-6579b183957d None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:43.430785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 26/57] 10.222.0.20 () {56 vars in 1322 bytes} [Thu Jun 23 10:38:43 2022] GET /identity/v3/role_assignments?user.id=587163b8ce4f4c51b7955cf5936eed6d&scope.domain.id=default&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:45.384786 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d7973-0b7b-421e-9123-8260a3902a35 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:45.385325 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d7973-0b7b-421e-9123-8260a3902a35 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:45.385325 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d7973-0b7b-421e-9123-8260a3902a35 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:45.386709 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 32/58] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:45.392472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7475ec-a692-458e-be91-239ec1e7bcae None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:45.392891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7475ec-a692-458e-be91-239ec1e7bcae None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:45.393079 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7475ec-a692-458e-be91-239ec1e7bcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:45.410105 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-8b7475ec-a692-458e-be91-239ec1e7bcae None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:45.411290 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-8b7475ec-a692-458e-be91-239ec1e7bcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:45.475286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 27/59] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:38:45.498922 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d7973-0b7b-421e-9123-8260a3902a35 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:45.598219 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d7973-0b7b-421e-9123-8260a3902a35 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:45.631641 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afd684-f68d-410f-8fd6-9d5009395133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:45.632439 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afd684-f68d-410f-8fd6-9d5009395133 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:45.632759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afd684-f68d-410f-8fd6-9d5009395133 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:45.633045 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afd684-f68d-410f-8fd6-9d5009395133 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:45.634259 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afd684-f68d-410f-8fd6-9d5009395133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:45.635773 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afd684-f68d-410f-8fd6-9d5009395133 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:45.637922 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 33/60] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:45.643345 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7475ec-a692-458e-be91-239ec1e7bcae None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:45.706743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:45.739668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7475ec-a692-458e-be91-239ec1e7bcae None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:45.773673 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1db700-b513-4d56-a911-08cf62f6fff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:45.774339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1db700-b513-4d56-a911-08cf62f6fff3 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:45.774628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1db700-b513-4d56-a911-08cf62f6fff3 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:45.774909 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1db700-b513-4d56-a911-08cf62f6fff3 None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:45.775623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1db700-b513-4d56-a911-08cf62f6fff3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:45.777116 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1db700-b513-4d56-a911-08cf62f6fff3 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:45.932263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 28/61] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 23 10:38:45 2022] POST /identity/v3/users => generated 275 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:38:49.166484 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff632acd-f106-40c6-8272-cfc89769c2dc None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:49.166484 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff632acd-f106-40c6-8272-cfc89769c2dc None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:49.166484 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff632acd-f106-40c6-8272-cfc89769c2dc None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:49.166484 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 34/62] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:49.172762 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d220e0-dcd4-4b00-8458-4b887464a20f None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:49.173554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d220e0-dcd4-4b00-8458-4b887464a20f None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:49.173986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d220e0-dcd4-4b00-8458-4b887464a20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:49.196023 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-53d220e0-dcd4-4b00-8458-4b887464a20f None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:49.197470 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-53d220e0-dcd4-4b00-8458-4b887464a20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:49.212622 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6dfa-a043-467f-9560-e606c2b11979 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:49.213178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6dfa-a043-467f-9560-e606c2b11979 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:49.213606 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6dfa-a043-467f-9560-e606c2b11979 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:49.215120 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 35/63] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:49.220214 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812cc67-9391-4f28-a3c5-43313d0c5e7e None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:49.220795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812cc67-9391-4f28-a3c5-43313d0c5e7e None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:49.221298 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812cc67-9391-4f28-a3c5-43313d0c5e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:49.248890 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-6812cc67-9391-4f28-a3c5-43313d0c5e7e None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:49.251685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-6812cc67-9391-4f28-a3c5-43313d0c5e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:49.326229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 29/64] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:38:49.350882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d220e0-dcd4-4b00-8458-4b887464a20f None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:49.357109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:49.386803 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 36/65] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:38:49.406111 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2d49a-dd88-48fd-9860-ab82b5259be8 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:49.406639 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2d49a-dd88-48fd-9860-ab82b5259be8 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:49.407067 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2d49a-dd88-48fd-9860-ab82b5259be8 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:49.410679 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 37/66] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:38:49.415086 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc0188-8c73-4c93-8a5f-d623dc679cb6 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:49.415618 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc0188-8c73-4c93-8a5f-d623dc679cb6 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:49.416104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc0188-8c73-4c93-8a5f-d623dc679cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:49.424421 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:49.436848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-bedc0188-8c73-4c93-8a5f-d623dc679cb6 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:49.438346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-bedc0188-8c73-4c93-8a5f-d623dc679cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:49.485621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d220e0-dcd4-4b00-8458-4b887464a20f None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:49.516746 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 38/67] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:38:49.524280 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754547d-b800-4b56-a886-64d1acc1e6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:49.525108 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754547d-b800-4b56-a886-64d1acc1e6c7 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:49.525394 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754547d-b800-4b56-a886-64d1acc1e6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:49.525576 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc0188-8c73-4c93-8a5f-d623dc679cb6 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:49.525956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754547d-b800-4b56-a886-64d1acc1e6c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:49.537690 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754547d-b800-4b56-a886-64d1acc1e6c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:49.546920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-3754547d-b800-4b56-a886-64d1acc1e6c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:38:49.546920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:49.546920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:49.546920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:49.546920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:49.546920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:49.546920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:49.546920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:49.546920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:49.546920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:49.546920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:49.546920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:49.546920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:49.546920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:49.546920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:49.546920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:49.547956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:49.547956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:49.547956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:49.547956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:49.547956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:49.547956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:49.547956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:49.547956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:49.547956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:49.547956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:49.547956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:49.547956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:49.547956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:49.547956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:49.547956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:49.547956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:49.548798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:49.548798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:49.548798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:49.548798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:49.548798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:49.548798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:49.548798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:49.548798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:49.548798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:49.548798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:49.548798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:38:49.548798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:38:49.554886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 30/68] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:38:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:38:49.554886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30067e21-a3f3-405d-90a4-b953872dadb8 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:49.554886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30067e21-a3f3-405d-90a4-b953872dadb8 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:49.554886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30067e21-a3f3-405d-90a4-b953872dadb8 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:49.556866 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 31/69] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:49.557575 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30067e21-a3f3-405d-90a4-b953872dadb8 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:49.642605 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc0188-8c73-4c93-8a5f-d623dc679cb6 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:49.659473 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:49.674128 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30067e21-a3f3-405d-90a4-b953872dadb8 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:49.677218 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d9463-9cea-4899-9ef1-6416846d54f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:49.677961 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d9463-9cea-4899-9ef1-6416846d54f7 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:49.678247 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d9463-9cea-4899-9ef1-6416846d54f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:49.678524 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d9463-9cea-4899-9ef1-6416846d54f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:49.686886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:49.688848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d9463-9cea-4899-9ef1-6416846d54f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:49.696455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-071d9463-9cea-4899-9ef1-6416846d54f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:49.696455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:49.696455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:49.696455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:49.696455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:49.696455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:49.696455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:49.696455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:49.696455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:49.696455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:49.696455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:49.696455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:49.696455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:49.696455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:49.696455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:49.696455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:49.698006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:49.698006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:49.698006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:49.698006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:49.698006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:49.698006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:49.698006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:49.698006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:49.698006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:49.698006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:49.698006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:49.698006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:49.698006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:49.698006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:49.698006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:49.698006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:49.698821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:49.698821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:49.698821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:49.698821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:49.698821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:49.698821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:49.698821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:49.698821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:49.698821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:49.698821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:49.698821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:49.698821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:38:49.698821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 39/70] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:38:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:49.698821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d9463-9cea-4899-9ef1-6416846d54f7 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:49.712825 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9c99b-fb80-4d9d-89b0-875269597532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:49.713655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9c99b-fb80-4d9d-89b0-875269597532 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:49.713950 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9c99b-fb80-4d9d-89b0-875269597532 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:49.714263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9c99b-fb80-4d9d-89b0-875269597532 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:49.725898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9c99b-fb80-4d9d-89b0-875269597532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:49.734882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-b8b9c99b-fb80-4d9d-89b0-875269597532 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:38:49.734882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:49.734882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:49.734882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:49.734882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:49.734882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:49.734882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:49.734882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:49.734882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:49.734882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:49.734882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:49.734882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:49.734882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:49.734882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:49.734882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:49.734882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:49.735790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:49.735790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:49.735790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:49.735790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:49.735790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:49.735790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:49.735790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:49.735790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:49.735790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:49.735790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:49.735790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:49.735790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:49.735790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:49.735790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:49.735790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:49.735790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:49.736526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:49.736526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:49.736526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:49.736526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:49.736526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:49.736526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:49.736526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:49.736526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:49.736526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:49.736526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:49.736526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:38:49.736526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:38:49.736526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 32/71] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:38:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:49.737603 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b057da6-8840-4bb4-b30f-6ce323bae089 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:49.737692 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b057da6-8840-4bb4-b30f-6ce323bae089 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:49.737910 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b057da6-8840-4bb4-b30f-6ce323bae089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:49.754757 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-8b057da6-8840-4bb4-b30f-6ce323bae089 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:49.755974 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-8b057da6-8840-4bb4-b30f-6ce323bae089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:49.802216 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d9463-9cea-4899-9ef1-6416846d54f7 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:49.826410 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 33/72] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:38:49.827817 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab4891-33d1-426e-a5fc-7fbea33dfb4c None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:49.828121 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab4891-33d1-426e-a5fc-7fbea33dfb4c None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:49.828410 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab4891-33d1-426e-a5fc-7fbea33dfb4c None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:49.829727 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 34/73] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:49.832880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab4891-33d1-426e-a5fc-7fbea33dfb4c None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:49.845303 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce3eb8-70d5-4dc4-b99e-ae27c57bcbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:49.846117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce3eb8-70d5-4dc4-b99e-ae27c57bcbb5 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:49.846406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce3eb8-70d5-4dc4-b99e-ae27c57bcbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:49.846694 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce3eb8-70d5-4dc4-b99e-ae27c57bcbb5 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:49.847451 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce3eb8-70d5-4dc4-b99e-ae27c57bcbb5 None admin] RBAC: Adding query filter params (name=member) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:49.847814 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce3eb8-70d5-4dc4-b99e-ae27c57bcbb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:49.849279 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce3eb8-70d5-4dc4-b99e-ae27c57bcbb5 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:49.858070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 40/74] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:38:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:49.858883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce3eb8-70d5-4dc4-b99e-ae27c57bcbb5 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:49.899209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:49.941790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab4891-33d1-426e-a5fc-7fbea33dfb4c None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:49.943347 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:49.958002 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce3eb8-70d5-4dc4-b99e-ae27c57bcbb5 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:49.978517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51c0b6-0622-47f3-a790-c0513d922803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:49.979350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51c0b6-0622-47f3-a790-c0513d922803 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:49.979645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51c0b6-0622-47f3-a790-c0513d922803 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:49.979937 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51c0b6-0622-47f3-a790-c0513d922803 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:49.980724 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51c0b6-0622-47f3-a790-c0513d922803 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:49.981100 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51c0b6-0622-47f3-a790-c0513d922803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:49.982846 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51c0b6-0622-47f3-a790-c0513d922803 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:49.990896 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 35/75] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:38:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:49.991178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de894a-c947-4123-aef7-42722060c2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:49.991862 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de894a-c947-4123-aef7-42722060c2f8 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:49.992157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de894a-c947-4123-aef7-42722060c2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:49.992248 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f392e06-72c3-4a79-af60-e0000b725f5d None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:49.992445 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de894a-c947-4123-aef7-42722060c2f8 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:49.992535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f392e06-72c3-4a79-af60-e0000b725f5d None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:49.992767 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f392e06-72c3-4a79-af60-e0000b725f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:49.993240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de894a-c947-4123-aef7-42722060c2f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:49.993556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de894a-c947-4123-aef7-42722060c2f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:49.994935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de894a-c947-4123-aef7-42722060c2f8 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:50.003430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 41/76] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:38:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:50.005260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de894a-c947-4123-aef7-42722060c2f8 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:50.009433 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-0f392e06-72c3-4a79-af60-e0000b725f5d None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:50.010633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-0f392e06-72c3-4a79-af60-e0000b725f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:50.077533 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 36/77] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:38:50.078378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f392e06-72c3-4a79-af60-e0000b725f5d None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:50.105201 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:50.108950 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de894a-c947-4123-aef7-42722060c2f8 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:50.143000 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd7657-c038-4883-9a8b-8f7f6d130e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:50.143802 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7657-c038-4883-9a8b-8f7f6d130e38 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:50.144088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7657-c038-4883-9a8b-8f7f6d130e38 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:50.144368 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7657-c038-4883-9a8b-8f7f6d130e38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:50.156606 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd7657-c038-4883-9a8b-8f7f6d130e38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:50.164297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-51dd7657-c038-4883-9a8b-8f7f6d130e38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:38:50.164297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:50.164297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:50.164297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:50.164297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:50.164297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:50.164297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:50.164297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:50.164297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:50.164297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:50.164297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:50.164297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:50.164297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:50.164297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:50.164297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:50.164297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:50.165227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:50.165227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:50.165227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:50.165227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:50.165227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:50.165227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:50.165227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:50.165227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:50.165227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:50.165227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:50.165227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:50.165227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:50.165227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:50.165227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:50.165227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:50.165227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:50.165965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:50.165965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:50.165965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:50.165965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:50.165965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:50.165965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:50.165965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:50.165965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:50.165965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:50.165965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:50.165965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:38:50.165965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:38:50.165965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 42/78] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:38:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:50.167013 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd7657-c038-4883-9a8b-8f7f6d130e38 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:50.175995 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:50.182630 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f392e06-72c3-4a79-af60-e0000b725f5d None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:50.217070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4297d-5440-4349-8420-d2704cc311a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:50.217878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4297d-5440-4349-8420-d2704cc311a1 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:50.218162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4297d-5440-4349-8420-d2704cc311a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:50.218440 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4297d-5440-4349-8420-d2704cc311a1 None admin] PATH_INFO: `/v3/users/58555002ddb548cb941a3a670b187b25` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:50.233165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4297d-5440-4349-8420-d2704cc311a1 None admin] RBAC: Authorizing `identity:get_user(user_id=58555002ddb548cb941a3a670b187b25)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:50.234618 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4297d-5440-4349-8420-d2704cc311a1 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:50.236276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 37/79] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:50 2022] GET /identity/v3/users/58555002ddb548cb941a3a670b187b25 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:50.237059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4297d-5440-4349-8420-d2704cc311a1 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:50.269976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd7657-c038-4883-9a8b-8f7f6d130e38 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:50.303411 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7c9a3-939c-48d3-b565-7cc69ba96923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:50.304289 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7c9a3-939c-48d3-b565-7cc69ba96923 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:50.304582 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7c9a3-939c-48d3-b565-7cc69ba96923 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:50.304895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7c9a3-939c-48d3-b565-7cc69ba96923 None admin] PATH_INFO: `/v3/users/587163b8ce4f4c51b7955cf5936eed6d` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:50.306095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7c9a3-939c-48d3-b565-7cc69ba96923 None admin] RBAC: Authorizing `identity:get_user(user_id=587163b8ce4f4c51b7955cf5936eed6d)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:50.307548 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7c9a3-939c-48d3-b565-7cc69ba96923 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:50.309235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 43/80] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:50 2022] GET /identity/v3/users/587163b8ce4f4c51b7955cf5936eed6d => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:50.310012 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7c9a3-939c-48d3-b565-7cc69ba96923 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:50.338272 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4297d-5440-4349-8420-d2704cc311a1 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:50.338427 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:50.371496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287513b-625c-4946-a30d-6e4b362587f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:50.372475 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287513b-625c-4946-a30d-6e4b362587f6 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:50.372811 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287513b-625c-4946-a30d-6e4b362587f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:50.373157 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287513b-625c-4946-a30d-6e4b362587f6 None admin] PATH_INFO: `/v3/users/58555002ddb548cb941a3a670b187b25` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:50.374364 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287513b-625c-4946-a30d-6e4b362587f6 None admin] RBAC: Authorizing `identity:get_user(user_id=58555002ddb548cb941a3a670b187b25)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:50.375813 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287513b-625c-4946-a30d-6e4b362587f6 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:50.377797 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 38/81] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:50 2022] GET /identity/v3/users/58555002ddb548cb941a3a670b187b25 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:50.378641 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287513b-625c-4946-a30d-6e4b362587f6 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:50.402219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:50.413955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7c9a3-939c-48d3-b565-7cc69ba96923 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:50.447167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613bd62-ff34-45fb-af10-79038ba52fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:50.447956 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613bd62-ff34-45fb-af10-79038ba52fc5 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:50.448241 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613bd62-ff34-45fb-af10-79038ba52fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:50.448514 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613bd62-ff34-45fb-af10-79038ba52fc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:50.449712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613bd62-ff34-45fb-af10-79038ba52fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:50.451881 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613bd62-ff34-45fb-af10-79038ba52fc5 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:50.453530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 44/82] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:50.457916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613bd62-ff34-45fb-af10-79038ba52fc5 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:50.480376 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287513b-625c-4946-a30d-6e4b362587f6 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:50.516543 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946abe2-581c-4795-87a9-bdb4f8f0f3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:50.517248 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946abe2-581c-4795-87a9-bdb4f8f0f3bd None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:50.517540 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946abe2-581c-4795-87a9-bdb4f8f0f3bd None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:50.517824 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946abe2-581c-4795-87a9-bdb4f8f0f3bd None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:50.518585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946abe2-581c-4795-87a9-bdb4f8f0f3bd None admin] RBAC: Adding query filter params (name=member) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:50.518906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946abe2-581c-4795-87a9-bdb4f8f0f3bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:50.520305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946abe2-581c-4795-87a9-bdb4f8f0f3bd None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:50.528776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 39/83] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:38:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:50.529576 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946abe2-581c-4795-87a9-bdb4f8f0f3bd None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:50.553480 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:50.559058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613bd62-ff34-45fb-af10-79038ba52fc5 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:50.597725 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffaa19-7d63-49ee-a4d6-27c82b924197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:50.598412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffaa19-7d63-49ee-a4d6-27c82b924197 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:50.598876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffaa19-7d63-49ee-a4d6-27c82b924197 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:50.599032 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffaa19-7d63-49ee-a4d6-27c82b924197 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:50.623719 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:50.642699 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946abe2-581c-4795-87a9-bdb4f8f0f3bd None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:50.678430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffaa19-7d63-49ee-a4d6-27c82b924197 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:50.679338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab29693-edbe-4cf9-9df2-89c70e880fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:50.679918 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffaa19-7d63-49ee-a4d6-27c82b924197 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:50.680008 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab29693-edbe-4cf9-9df2-89c70e880fff None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:50.680354 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab29693-edbe-4cf9-9df2-89c70e880fff None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:50.680671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab29693-edbe-4cf9-9df2-89c70e880fff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:50.751215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab29693-edbe-4cf9-9df2-89c70e880fff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:50.753418 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab29693-edbe-4cf9-9df2-89c70e880fff None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:50.779528 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:50.785898 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 45/84] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:38:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:38:50.786724 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffaa19-7d63-49ee-a4d6-27c82b924197 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:50.844069 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:50.867801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 40/85] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:38:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:38:50.868695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab29693-edbe-4cf9-9df2-89c70e880fff None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:50.901284 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffaa19-7d63-49ee-a4d6-27c82b924197 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:50.937015 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002bbe6-dba4-47e4-ab01-30b6a7257481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:50.937681 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002bbe6-dba4-47e4-ab01-30b6a7257481 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:50.937977 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002bbe6-dba4-47e4-ab01-30b6a7257481 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:50.938266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002bbe6-dba4-47e4-ab01-30b6a7257481 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:50.973194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab29693-edbe-4cf9-9df2-89c70e880fff None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:50.998828 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:51.005617 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002bbe6-dba4-47e4-ab01-30b6a7257481 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:51.006877 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf57422-7e0b-482b-9eff-fc25f7ccea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:51.007051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002bbe6-dba4-47e4-ab01-30b6a7257481 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:51.007613 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf57422-7e0b-482b-9eff-fc25f7ccea48 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:51.007900 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf57422-7e0b-482b-9eff-fc25f7ccea48 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:51.008208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf57422-7e0b-482b-9eff-fc25f7ccea48 None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:51.008968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf57422-7e0b-482b-9eff-fc25f7ccea48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:51.010414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf57422-7e0b-482b-9eff-fc25f7ccea48 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:51.102923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 46/86] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:38:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:38:51.103749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002bbe6-dba4-47e4-ab01-30b6a7257481 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:51.125287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 41/87] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 23 10:38:50 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:38:51.125287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf57422-7e0b-482b-9eff-fc25f7ccea48 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:51.170090 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:51.218364 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:51.224684 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002bbe6-dba4-47e4-ab01-30b6a7257481 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:51.244377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf57422-7e0b-482b-9eff-fc25f7ccea48 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:51.261826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61abb3-7246-43ed-8b97-64fe75c99613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:51.262685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61abb3-7246-43ed-8b97-64fe75c99613 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:51.263042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61abb3-7246-43ed-8b97-64fe75c99613 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:51.263315 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61abb3-7246-43ed-8b97-64fe75c99613 None admin] PATH_INFO: `/v3/users/58555002ddb548cb941a3a670b187b25` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:51.264559 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61abb3-7246-43ed-8b97-64fe75c99613 None admin] RBAC: Authorizing `identity:get_user(user_id=58555002ddb548cb941a3a670b187b25)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:51.266058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61abb3-7246-43ed-8b97-64fe75c99613 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:51.267715 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 47/88] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:51 2022] GET /identity/v3/users/58555002ddb548cb941a3a670b187b25 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:51.268485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61abb3-7246-43ed-8b97-64fe75c99613 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:51.295701 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20b2bf-f245-44ac-90ad-8a92352045f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:51.297656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20b2bf-f245-44ac-90ad-8a92352045f3 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:51.297961 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20b2bf-f245-44ac-90ad-8a92352045f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:51.298259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20b2bf-f245-44ac-90ad-8a92352045f3 None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:51.299535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20b2bf-f245-44ac-90ad-8a92352045f3 None admin] RBAC: Authorizing `identity:get_project(project_id=ab32a97afff44105a351deb0fa2e7609)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:51.301054 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20b2bf-f245-44ac-90ad-8a92352045f3 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:51.302794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 42/89] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:38:51 2022] GET /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:51.303598 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20b2bf-f245-44ac-90ad-8a92352045f3 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:51.386582 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61abb3-7246-43ed-8b97-64fe75c99613 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:51.433166 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae45016-4110-4d3f-8ad9-842e1c6156b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:51.434050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae45016-4110-4d3f-8ad9-842e1c6156b4 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:51.434377 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae45016-4110-4d3f-8ad9-842e1c6156b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:51.434723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae45016-4110-4d3f-8ad9-842e1c6156b4 None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:51.434892 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20b2bf-f245-44ac-90ad-8a92352045f3 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:51.435973 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae45016-4110-4d3f-8ad9-842e1c6156b4 None admin] RBAC: Authorizing `identity:get_project(project_id=ab32a97afff44105a351deb0fa2e7609)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:51.437494 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae45016-4110-4d3f-8ad9-842e1c6156b4 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:51.439543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 48/90] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:38:51 2022] GET /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:51.440400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae45016-4110-4d3f-8ad9-842e1c6156b4 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:51.442984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:51.476387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:51.494920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e56dc9-d37c-4cd7-871f-13d279da64ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:51.495961 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e56dc9-d37c-4cd7-871f-13d279da64ef None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:51.496545 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e56dc9-d37c-4cd7-871f-13d279da64ef None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:51.497029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e56dc9-d37c-4cd7-871f-13d279da64ef None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:51.498539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e56dc9-d37c-4cd7-871f-13d279da64ef None admin] RBAC: Authorizing `identity:get_project(project_id=ab32a97afff44105a351deb0fa2e7609)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:51.500556 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e56dc9-d37c-4cd7-871f-13d279da64ef None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:51.503398 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 43/91] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:38:51 2022] GET /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:51.504232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e56dc9-d37c-4cd7-871f-13d279da64ef None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:51.551136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae45016-4110-4d3f-8ad9-842e1c6156b4 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:51.609587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd86e5c-0761-4654-a202-d7f26849e0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:51.610785 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd86e5c-0761-4654-a202-d7f26849e0cf None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:51.611283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd86e5c-0761-4654-a202-d7f26849e0cf None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:51.614969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd86e5c-0761-4654-a202-d7f26849e0cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:51.626624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e56dc9-d37c-4cd7-871f-13d279da64ef None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:51.697021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d37d19-94a0-4ac0-b362-7f78fa3292f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:51.697694 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d37d19-94a0-4ac0-b362-7f78fa3292f1 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:51.697983 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d37d19-94a0-4ac0-b362-7f78fa3292f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:51.698286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d37d19-94a0-4ac0-b362-7f78fa3292f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:51.700178 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d37d19-94a0-4ac0-b362-7f78fa3292f1 None admin] RBAC: Adding query filter params (role.id=14edb03a6a644798bdbf762bb59f6ef9, scope.project.id=ab32a97afff44105a351deb0fa2e7609, user.id=58555002ddb548cb941a3a670b187b25) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:51.700531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d37d19-94a0-4ac0-b362-7f78fa3292f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:51.702250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d37d19-94a0-4ac0-b362-7f78fa3292f1 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:51.709407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 44/92] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:38:51 2022] GET /identity/v3/role_assignments?user.id=58555002ddb548cb941a3a670b187b25&scope.project.id=ab32a97afff44105a351deb0fa2e7609&role.id=14edb03a6a644798bdbf762bb59f6ef9 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:51.710308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d37d19-94a0-4ac0-b362-7f78fa3292f1 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:51.771567 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd86e5c-0761-4654-a202-d7f26849e0cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:51.773261 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd86e5c-0761-4654-a202-d7f26849e0cf None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:51.773884 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:51.834923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:51.893248 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d37d19-94a0-4ac0-b362-7f78fa3292f1 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:51.933586 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 49/93] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:38:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:38:51.934989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd86e5c-0761-4654-a202-d7f26849e0cf None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:51.961433 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfec2a8-3fcc-4ee5-8660-9bd21cdf96e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:51.962111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfec2a8-3fcc-4ee5-8660-9bd21cdf96e6 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:51.962442 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfec2a8-3fcc-4ee5-8660-9bd21cdf96e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:51.962769 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfec2a8-3fcc-4ee5-8660-9bd21cdf96e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:51.963827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfec2a8-3fcc-4ee5-8660-9bd21cdf96e6 None admin] RBAC: Adding query filter params (role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.project.id=ab32a97afff44105a351deb0fa2e7609, user.id=587163b8ce4f4c51b7955cf5936eed6d) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:51.964153 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfec2a8-3fcc-4ee5-8660-9bd21cdf96e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:51.966648 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfec2a8-3fcc-4ee5-8660-9bd21cdf96e6 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:51.981951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 45/94] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:38:51 2022] GET /identity/v3/role_assignments?user.id=587163b8ce4f4c51b7955cf5936eed6d&scope.project.id=ab32a97afff44105a351deb0fa2e7609&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:51.982830 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfec2a8-3fcc-4ee5-8660-9bd21cdf96e6 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:52.120735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd86e5c-0761-4654-a202-d7f26849e0cf None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:52.155898 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:52.169391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059562d-9b2a-4ec5-b7c2-70e3d8e3cae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:52.170075 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059562d-9b2a-4ec5-b7c2-70e3d8e3cae6 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:52.178097 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfec2a8-3fcc-4ee5-8660-9bd21cdf96e6 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:52.178225 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059562d-9b2a-4ec5-b7c2-70e3d8e3cae6 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:52.178225 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059562d-9b2a-4ec5-b7c2-70e3d8e3cae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:52.178350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:52.178414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059562d-9b2a-4ec5-b7c2-70e3d8e3cae6 None admin] RBAC: Adding query filter params (role.id=f86a1d8dfb24430a98414eab048c4be9, scope.project.id=ab32a97afff44105a351deb0fa2e7609, user.id=58555002ddb548cb941a3a670b187b25) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:52.178414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059562d-9b2a-4ec5-b7c2-70e3d8e3cae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:52.178414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059562d-9b2a-4ec5-b7c2-70e3d8e3cae6 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:52.189138 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 50/95] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:38:51 2022] GET /identity/v3/role_assignments?user.id=58555002ddb548cb941a3a670b187b25&scope.project.id=ab32a97afff44105a351deb0fa2e7609&role.id=f86a1d8dfb24430a98414eab048c4be9 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:52.209178 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad514a5c-f85f-4f81-992f-ac6409fd2463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:52.210088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad514a5c-f85f-4f81-992f-ac6409fd2463 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:52.210378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad514a5c-f85f-4f81-992f-ac6409fd2463 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:52.210660 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad514a5c-f85f-4f81-992f-ac6409fd2463 None admin] PATH_INFO: `/v3/projects/a0b92103e14c4fbf92f174a45058e732` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:52.212091 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad514a5c-f85f-4f81-992f-ac6409fd2463 None admin] RBAC: Authorizing `identity:get_project(project_id=a0b92103e14c4fbf92f174a45058e732)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:52.213646 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad514a5c-f85f-4f81-992f-ac6409fd2463 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:52.216304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 46/96] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:38:51 2022] GET /identity/v3/projects/a0b92103e14c4fbf92f174a45058e732 => generated 312 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:52.223015 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059562d-9b2a-4ec5-b7c2-70e3d8e3cae6 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:52.367979 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059562d-9b2a-4ec5-b7c2-70e3d8e3cae6 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:52.407419 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68fb30-c13a-46f9-9265-5b5a6a8ac18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:52.408025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68fb30-c13a-46f9-9265-5b5a6a8ac18b None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:52.408317 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68fb30-c13a-46f9-9265-5b5a6a8ac18b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:52.408604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68fb30-c13a-46f9-9265-5b5a6a8ac18b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:52.409504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68fb30-c13a-46f9-9265-5b5a6a8ac18b None admin] RBAC: Adding query filter params (role.id=14edb03a6a644798bdbf762bb59f6ef9, scope.project.id=a0b92103e14c4fbf92f174a45058e732, user.id=58555002ddb548cb941a3a670b187b25) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:52.409832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68fb30-c13a-46f9-9265-5b5a6a8ac18b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:52.411330 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68fb30-c13a-46f9-9265-5b5a6a8ac18b None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:52.417809 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 51/97] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:38:52 2022] GET /identity/v3/role_assignments?user.id=58555002ddb548cb941a3a670b187b25&scope.project.id=a0b92103e14c4fbf92f174a45058e732&role.id=14edb03a6a644798bdbf762bb59f6ef9 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:53.842549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377fd4a-220b-4120-85e7-0621a8b83cb6 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:53.843040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377fd4a-220b-4120-85e7-0621a8b83cb6 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:53.843146 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377fd4a-220b-4120-85e7-0621a8b83cb6 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:53.844630 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 47/98] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:53.859977 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8452a-117b-4bf5-b68a-dd645cf1bf13 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:53.860913 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8452a-117b-4bf5-b68a-dd645cf1bf13 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:53.861422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8452a-117b-4bf5-b68a-dd645cf1bf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:53.883682 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-e2b8452a-117b-4bf5-b68a-dd645cf1bf13 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:53.885279 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e2b8452a-117b-4bf5-b68a-dd645cf1bf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:53.945686 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:53.957660 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 52/99] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:38:53.983038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377fd4a-220b-4120-85e7-0621a8b83cb6 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:54.114279 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377fd4a-220b-4120-85e7-0621a8b83cb6 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:54.159571 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e38c79-2220-4729-b2c0-b9feb7a1e445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:54.160287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e38c79-2220-4729-b2c0-b9feb7a1e445 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:54.160576 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e38c79-2220-4729-b2c0-b9feb7a1e445 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:54.160886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e38c79-2220-4729-b2c0-b9feb7a1e445 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:54.173293 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e38c79-2220-4729-b2c0-b9feb7a1e445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:54.181130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-04e38c79-2220-4729-b2c0-b9feb7a1e445 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:38:54.181130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:54.181130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:54.181130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:54.181130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:54.181130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:54.181130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:54.181130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:54.181130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:54.181130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:54.181130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:54.181130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:54.181130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:54.181130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:54.181130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:54.181130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:54.181963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:54.181963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:54.181963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:54.181963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:54.181963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:54.181963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:54.181963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:54.181963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:54.181963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:54.181963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:54.181963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:54.181963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:54.181963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:54.181963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:54.181963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:54.181963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:54.182744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:54.182744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:54.182744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:54.182744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:54.182744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:54.182744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:54.182744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:54.182744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:54.182744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:54.182744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:54.182744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:38:54.182744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:38:54.182744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 48/100] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:38:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:54.190055 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8452a-117b-4bf5-b68a-dd645cf1bf13 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:54.319778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8452a-117b-4bf5-b68a-dd645cf1bf13 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:54.358663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbdd85-ad1b-446a-83ec-d81a408ded7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:54.359584 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbdd85-ad1b-446a-83ec-d81a408ded7d None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:54.360020 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbdd85-ad1b-446a-83ec-d81a408ded7d None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:54.360447 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbdd85-ad1b-446a-83ec-d81a408ded7d None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:54.361378 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbdd85-ad1b-446a-83ec-d81a408ded7d None admin] RBAC: Adding query filter params (name=reader) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:54.361859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbdd85-ad1b-446a-83ec-d81a408ded7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:54.363400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbdd85-ad1b-446a-83ec-d81a408ded7d None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:54.373080 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 53/101] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:38:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:54.378956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e38c79-2220-4729-b2c0-b9feb7a1e445 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:54.424814 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:54.515748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e38c79-2220-4729-b2c0-b9feb7a1e445 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:54.560856 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83482e-39b7-468d-be66-a093644f4510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:54.561752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83482e-39b7-468d-be66-a093644f4510 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:54.562108 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83482e-39b7-468d-be66-a093644f4510 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:54.562397 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83482e-39b7-468d-be66-a093644f4510 None admin] PATH_INFO: `/v3/users/1aadf7cef8494df4a0f2ff7b5b37113c` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:54.581388 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83482e-39b7-468d-be66-a093644f4510 None admin] RBAC: Authorizing `identity:get_user(user_id=1aadf7cef8494df4a0f2ff7b5b37113c)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:54.582881 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83482e-39b7-468d-be66-a093644f4510 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:54.584663 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 49/102] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:54 2022] GET /identity/v3/users/1aadf7cef8494df4a0f2ff7b5b37113c => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:54.590430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbdd85-ad1b-446a-83ec-d81a408ded7d None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:54.634614 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc67e6-f421-4bd5-a3fd-a8264c611e38 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:54.634904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc67e6-f421-4bd5-a3fd-a8264c611e38 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:54.635374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc67e6-f421-4bd5-a3fd-a8264c611e38 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:54.636929 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 50/103] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:54.643021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed55e74-9b37-4d63-bb27-98a812aa7dc4 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:54.643531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed55e74-9b37-4d63-bb27-98a812aa7dc4 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:54.643983 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed55e74-9b37-4d63-bb27-98a812aa7dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:54.721943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-3ed55e74-9b37-4d63-bb27-98a812aa7dc4 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:54.723075 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-3ed55e74-9b37-4d63-bb27-98a812aa7dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:54.725253 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:54.814643 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbdd85-ad1b-446a-83ec-d81a408ded7d None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:54.862282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 51/104] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:38:54.864521 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04fe08-f022-43d2-adae-90fc0f34e15a None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:54.864986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04fe08-f022-43d2-adae-90fc0f34e15a None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:54.865417 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04fe08-f022-43d2-adae-90fc0f34e15a None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:54.866887 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 52/105] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:54.873689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fc489-09aa-45d9-8a11-d59a3dfa826e None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:54.874184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fc489-09aa-45d9-8a11-d59a3dfa826e None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:54.874617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fc489-09aa-45d9-8a11-d59a3dfa826e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:54.896710 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9e49a-500f-40bb-a4d3-6416158dcaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:54.898258 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9e49a-500f-40bb-a4d3-6416158dcaac None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:54.898740 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9e49a-500f-40bb-a4d3-6416158dcaac None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:54.899761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9e49a-500f-40bb-a4d3-6416158dcaac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:54.917708 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-1a3fc489-09aa-45d9-8a11-d59a3dfa826e None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:54.919531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-1a3fc489-09aa-45d9-8a11-d59a3dfa826e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:54.961010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:54.990651 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9e49a-500f-40bb-a4d3-6416158dcaac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:54.992595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9e49a-500f-40bb-a4d3-6416158dcaac None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:55.026965 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 53/106] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:38:55.028086 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fc489-09aa-45d9-8a11-d59a3dfa826e None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:55.049953 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:55.108283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 54/107] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:38:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:38:55.109535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9e49a-500f-40bb-a4d3-6416158dcaac None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:55.149660 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fc489-09aa-45d9-8a11-d59a3dfa826e None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:55.191359 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e39cb-acb0-49f4-b904-fce6b04eea89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:55.192194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e39cb-acb0-49f4-b904-fce6b04eea89 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:55.192494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e39cb-acb0-49f4-b904-fce6b04eea89 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:55.192845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e39cb-acb0-49f4-b904-fce6b04eea89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:55.194123 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e39cb-acb0-49f4-b904-fce6b04eea89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:55.195597 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e39cb-acb0-49f4-b904-fce6b04eea89 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:55.197271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 54/108] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:55.203180 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51508924-b435-400a-b643-02146fac317f None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:55.203483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51508924-b435-400a-b643-02146fac317f None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:55.203773 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51508924-b435-400a-b643-02146fac317f None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:55.205267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 55/109] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:55.206235 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6951d-c986-4b3b-b3ba-b3e877836fb2 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:55.206472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6951d-c986-4b3b-b3ba-b3e877836fb2 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:55.206757 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6951d-c986-4b3b-b3ba-b3e877836fb2 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:55.208122 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 56/110] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:55.212558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6951d-c986-4b3b-b3ba-b3e877836fb2 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:55.222852 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9e49a-500f-40bb-a4d3-6416158dcaac None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:55.232297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:55.261348 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a517d4-241c-4ca3-aefa-b5bf466fe3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:55.262079 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a517d4-241c-4ca3-aefa-b5bf466fe3d0 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:55.262399 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a517d4-241c-4ca3-aefa-b5bf466fe3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:55.262690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a517d4-241c-4ca3-aefa-b5bf466fe3d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:55.274650 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a517d4-241c-4ca3-aefa-b5bf466fe3d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:55.283296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-e4a517d4-241c-4ca3-aefa-b5bf466fe3d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:38:55.283296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:55.283296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:55.283296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:55.283296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:55.283296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:55.283296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:55.283296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:55.283296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:55.283296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:55.283296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:55.283296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:55.283296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:55.283296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:55.283296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:55.283296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:55.284117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:55.284117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:55.284117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:55.284117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:55.284117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:55.284117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:55.284117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:55.284117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:55.284117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:55.284117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:55.284117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:55.284117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:55.284117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:55.284117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:55.284117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:55.284117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:55.284904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:55.284904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:55.284904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:55.284904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:55.284904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:55.284904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:55.284904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:55.284904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:55.284904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:55.284904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:55.284904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:38:55.284904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:38:55.284904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 55/111] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:38:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:55.285517 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a517d4-241c-4ca3-aefa-b5bf466fe3d0 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:55.301369 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:55.328506 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6951d-c986-4b3b-b3ba-b3e877836fb2 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:55.365529 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3ddb3-d286-480f-907d-ea2e779c5ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:55.366407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3ddb3-d286-480f-907d-ea2e779c5ffb None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:55.366697 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3ddb3-d286-480f-907d-ea2e779c5ffb None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:55.366982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3ddb3-d286-480f-907d-ea2e779c5ffb None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:55.368183 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3ddb3-d286-480f-907d-ea2e779c5ffb None admin] RBAC: Authorizing `identity:get_project(project_id=ab32a97afff44105a351deb0fa2e7609)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:55.369683 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3ddb3-d286-480f-907d-ea2e779c5ffb None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:55.371566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 57/112] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:38:55 2022] GET /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:55.373676 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d7b6b-ee51-4989-b5bc-6eb262eb01ca None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:55.373970 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d7b6b-ee51-4989-b5bc-6eb262eb01ca None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:55.374257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d7b6b-ee51-4989-b5bc-6eb262eb01ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:55.391233 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-ef8d7b6b-ee51-4989-b5bc-6eb262eb01ca None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:55.392430 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ef8d7b6b-ee51-4989-b5bc-6eb262eb01ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:55.399647 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a517d4-241c-4ca3-aefa-b5bf466fe3d0 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:55.437828 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af964c7-9ee0-4f17-bb25-6f503b9233eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:55.438503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af964c7-9ee0-4f17-bb25-6f503b9233eb None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:55.438797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af964c7-9ee0-4f17-bb25-6f503b9233eb None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:55.439220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af964c7-9ee0-4f17-bb25-6f503b9233eb None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:55.439794 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af964c7-9ee0-4f17-bb25-6f503b9233eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:55.441308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af964c7-9ee0-4f17-bb25-6f503b9233eb None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:55.462767 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 58/113] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:38:55.468825 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff798a9-386d-4373-a13e-a97053335683 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:55.468825 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff798a9-386d-4373-a13e-a97053335683 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:55.468825 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff798a9-386d-4373-a13e-a97053335683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:55.483878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-eff798a9-386d-4373-a13e-a97053335683 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:55.485107 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-eff798a9-386d-4373-a13e-a97053335683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:55.494823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:55.535032 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 56/114] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 23 10:38:55 2022] POST /identity/v3/projects => generated 302 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:38:55.535829 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af964c7-9ee0-4f17-bb25-6f503b9233eb None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:55.559065 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 59/115] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:38:55.565727 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff798a9-386d-4373-a13e-a97053335683 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:55.625998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:55.669830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af964c7-9ee0-4f17-bb25-6f503b9233eb None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:55.687387 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff798a9-386d-4373-a13e-a97053335683 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:55.708956 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc0d0d-b61f-42e2-bced-813b67423900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:55.709646 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc0d0d-b61f-42e2-bced-813b67423900 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:55.709938 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc0d0d-b61f-42e2-bced-813b67423900 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:55.710214 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc0d0d-b61f-42e2-bced-813b67423900 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:55.710977 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc0d0d-b61f-42e2-bced-813b67423900 None admin] RBAC: Adding query filter params (name=member) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:55.711289 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc0d0d-b61f-42e2-bced-813b67423900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:55.713485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc0d0d-b61f-42e2-bced-813b67423900 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:55.722440 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 57/116] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:38:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:55.723248 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc0d0d-b61f-42e2-bced-813b67423900 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:55.725160 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a9087-2e63-404e-888a-005afa064b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:55.725924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a9087-2e63-404e-888a-005afa064b85 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:55.726218 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a9087-2e63-404e-888a-005afa064b85 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:55.726503 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a9087-2e63-404e-888a-005afa064b85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:55.727358 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a9087-2e63-404e-888a-005afa064b85 None admin] RBAC: Adding query filter params (role.id=4b240816f7ab46a8b8674d54c63a9f03, scope.project.id=ab32a97afff44105a351deb0fa2e7609, user.id=1aadf7cef8494df4a0f2ff7b5b37113c) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:55.728651 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a9087-2e63-404e-888a-005afa064b85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:55.731996 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a9087-2e63-404e-888a-005afa064b85 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:55.736872 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 60/117] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:38:55 2022] GET /identity/v3/role_assignments?user.id=1aadf7cef8494df4a0f2ff7b5b37113c&scope.project.id=ab32a97afff44105a351deb0fa2e7609&role.id=4b240816f7ab46a8b8674d54c63a9f03 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:55.738249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73aa47-0037-40cc-8278-9defae989112 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:55.738705 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73aa47-0037-40cc-8278-9defae989112 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:55.739172 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73aa47-0037-40cc-8278-9defae989112 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:55.740567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 61/118] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:55.741543 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73aa47-0037-40cc-8278-9defae989112 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:55.753689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:55.864149 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73aa47-0037-40cc-8278-9defae989112 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:55.868911 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc0d0d-b61f-42e2-bced-813b67423900 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:55.900092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:55.915317 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28a067-e410-4eeb-a30f-86ad713ced51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:55.916506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28a067-e410-4eeb-a30f-86ad713ced51 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:55.916961 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dac11-f802-418e-8976-aa8955ac2926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:55.917324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28a067-e410-4eeb-a30f-86ad713ced51 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:55.917762 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dac11-f802-418e-8976-aa8955ac2926 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:55.918033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28a067-e410-4eeb-a30f-86ad713ced51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:55.918129 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dac11-f802-418e-8976-aa8955ac2926 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:55.918316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dac11-f802-418e-8976-aa8955ac2926 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:55.929664 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106dac11-f802-418e-8976-aa8955ac2926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:55.933300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28a067-e410-4eeb-a30f-86ad713ced51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:55.937776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-106dac11-f802-418e-8976-aa8955ac2926 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:38:55.937776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:55.937776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:55.937776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:55.937776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:55.937776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:55.937776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:55.937776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:55.937776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:55.937776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:55.937776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:55.937776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:55.937776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:55.937776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:55.937776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:55.937776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:55.938617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:55.938617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:55.938617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:55.938617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:55.938617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:55.938617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:55.938617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:55.938617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:55.938617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:55.938617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:55.938617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:55.938617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:55.938617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:55.938617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:55.938617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:55.938617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:55.939350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:55.939350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:55.939350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:55.939350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:55.939350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:55.939350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:55.939350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:55.939350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:55.939350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:55.939350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:55.939350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:38:55.939350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:38:55.941750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 62/119] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:38:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:55.942552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-dd28a067-e410-4eeb-a30f-86ad713ced51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:55.942552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:55.942552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:55.942552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:55.942552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:55.942552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:55.942552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:55.942552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:55.942552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:55.942552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:55.942552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:55.942552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:55.942552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:55.942552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:55.942552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:55.942552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:55.943481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:55.943481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:55.943481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:55.943481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:55.943481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:55.943481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:55.943481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:55.943481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:55.943481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:55.943481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:55.943481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:55.943481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:55.943481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:55.943481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:55.943481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:55.943481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:55.944496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:55.944496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:55.944496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:55.944496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:55.944496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:55.944496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:55.944496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:55.944496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:55.944496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:55.944496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:55.944496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:55.944496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:38:55.944496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 58/120] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:38:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:55.945921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dac11-f802-418e-8976-aa8955ac2926 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:55.952110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ecd67-8a2c-4c9d-af47-629d4912d4ba None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:55.952428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ecd67-8a2c-4c9d-af47-629d4912d4ba None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:55.952736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ecd67-8a2c-4c9d-af47-629d4912d4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:55.976512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-960ecd67-8a2c-4c9d-af47-629d4912d4ba None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:55.978104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-960ecd67-8a2c-4c9d-af47-629d4912d4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:56.022892 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:56.062707 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dac11-f802-418e-8976-aa8955ac2926 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:56.072955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 59/121] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:38:56.074604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ecd67-8a2c-4c9d-af47-629d4912d4ba None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:56.101270 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc332a5-bb6b-4683-b5fb-42ccc365076d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:56.102132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc332a5-bb6b-4683-b5fb-42ccc365076d None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:56.102418 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc332a5-bb6b-4683-b5fb-42ccc365076d None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:56.102698 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc332a5-bb6b-4683-b5fb-42ccc365076d None admin] PATH_INFO: `/v3/users/58555002ddb548cb941a3a670b187b25` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:56.103975 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc332a5-bb6b-4683-b5fb-42ccc365076d None admin] RBAC: Authorizing `identity:get_user(user_id=58555002ddb548cb941a3a670b187b25)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:56.105636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc332a5-bb6b-4683-b5fb-42ccc365076d None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:56.108245 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 63/122] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:55 2022] GET /identity/v3/users/58555002ddb548cb941a3a670b187b25 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:56.109321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc332a5-bb6b-4683-b5fb-42ccc365076d None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:56.184168 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ecd67-8a2c-4c9d-af47-629d4912d4ba None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:56.202073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:56.217787 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc332a5-bb6b-4683-b5fb-42ccc365076d None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:56.221359 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab166c1a-5dc7-4941-a9aa-e720827411e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:56.222285 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab166c1a-5dc7-4941-a9aa-e720827411e5 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:56.222765 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab166c1a-5dc7-4941-a9aa-e720827411e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:56.223313 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab166c1a-5dc7-4941-a9aa-e720827411e5 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:56.224262 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab166c1a-5dc7-4941-a9aa-e720827411e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:56.224817 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab166c1a-5dc7-4941-a9aa-e720827411e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:56.226480 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab166c1a-5dc7-4941-a9aa-e720827411e5 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:56.236549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 60/123] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:38:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:56.237753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab166c1a-5dc7-4941-a9aa-e720827411e5 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:56.255708 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7a37d-5405-406a-9bf0-403615e24313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:56.256397 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7a37d-5405-406a-9bf0-403615e24313 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:56.256707 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7a37d-5405-406a-9bf0-403615e24313 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:56.257046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7a37d-5405-406a-9bf0-403615e24313 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:56.257871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7a37d-5405-406a-9bf0-403615e24313 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:56.258233 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7a37d-5405-406a-9bf0-403615e24313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:56.259676 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7a37d-5405-406a-9bf0-403615e24313 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:56.262080 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:56.270103 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 64/124] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:38:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:56.270981 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7a37d-5405-406a-9bf0-403615e24313 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:56.360694 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab166c1a-5dc7-4941-a9aa-e720827411e5 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:56.386692 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7a37d-5405-406a-9bf0-403615e24313 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:56.404312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd917d-51e5-4f14-bcfe-1e45d5a0b97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:56.405672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd917d-51e5-4f14-bcfe-1e45d5a0b97a None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:56.406111 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd917d-51e5-4f14-bcfe-1e45d5a0b97a None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:56.406670 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd917d-51e5-4f14-bcfe-1e45d5a0b97a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:56.421247 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd917d-51e5-4f14-bcfe-1e45d5a0b97a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:56.425892 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31cf42-0503-42d3-94f6-fa46d54d9909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:56.427146 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31cf42-0503-42d3-94f6-fa46d54d9909 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:56.427685 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31cf42-0503-42d3-94f6-fa46d54d9909 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:56.428212 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31cf42-0503-42d3-94f6-fa46d54d9909 None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:56.429656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31cf42-0503-42d3-94f6-fa46d54d9909 None admin] RBAC: Authorizing `identity:get_project(project_id=ab32a97afff44105a351deb0fa2e7609)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:56.429758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-cbcd917d-51e5-4f14-bcfe-1e45d5a0b97a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:38:56.429758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:56.429758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:56.429758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:56.429758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:56.429758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:56.429758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:56.429758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:56.429758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:56.429758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:56.429758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:56.429758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:56.429758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:56.429758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:56.429758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:56.429758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:56.430575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:56.430575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:56.430575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:56.430575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:56.430575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:56.430575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:56.430575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:56.430575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:56.430575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:56.430575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:56.430575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:56.430575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:56.430575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:56.430575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:56.430575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:56.430575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:56.431985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:56.431985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:56.431985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:56.431985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:56.431985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:56.431985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:56.431985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:56.431985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:56.431985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:56.431985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:56.431985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:38:56.431985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:38:56.431985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 61/125] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:38:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:56.431985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd917d-51e5-4f14-bcfe-1e45d5a0b97a None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:56.434762 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31cf42-0503-42d3-94f6-fa46d54d9909 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:56.436858 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 65/126] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:38:56 2022] GET /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:56.437624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31cf42-0503-42d3-94f6-fa46d54d9909 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:56.483081 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:56.527682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:56.549121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd917d-51e5-4f14-bcfe-1e45d5a0b97a None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:56.571549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31cf42-0503-42d3-94f6-fa46d54d9909 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:56.587600 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0f412-8788-42bd-8317-808f41c36f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:56.588968 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0f412-8788-42bd-8317-808f41c36f44 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:56.589493 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0f412-8788-42bd-8317-808f41c36f44 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:56.589981 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0f412-8788-42bd-8317-808f41c36f44 None admin] PATH_INFO: `/v3/users/58555002ddb548cb941a3a670b187b25` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:56.592184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0f412-8788-42bd-8317-808f41c36f44 None admin] RBAC: Authorizing `identity:get_user(user_id=58555002ddb548cb941a3a670b187b25)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:56.594007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0f412-8788-42bd-8317-808f41c36f44 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:56.595949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 62/127] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:56 2022] GET /identity/v3/users/58555002ddb548cb941a3a670b187b25 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:56.597149 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0f412-8788-42bd-8317-808f41c36f44 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:56.620513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110d8e8-e5d0-411e-afeb-1f182209118c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:56.621658 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110d8e8-e5d0-411e-afeb-1f182209118c None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:56.622159 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110d8e8-e5d0-411e-afeb-1f182209118c None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:56.623150 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110d8e8-e5d0-411e-afeb-1f182209118c None admin] PATH_INFO: `/v3/users/587163b8ce4f4c51b7955cf5936eed6d` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:56.628171 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110d8e8-e5d0-411e-afeb-1f182209118c None admin] RBAC: Authorizing `identity:get_user(user_id=587163b8ce4f4c51b7955cf5936eed6d)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:56.628171 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110d8e8-e5d0-411e-afeb-1f182209118c None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:56.630476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 66/128] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:56 2022] GET /identity/v3/users/587163b8ce4f4c51b7955cf5936eed6d => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:56.631657 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110d8e8-e5d0-411e-afeb-1f182209118c None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:56.726723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0f412-8788-42bd-8317-808f41c36f44 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:56.736261 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:56.747555 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110d8e8-e5d0-411e-afeb-1f182209118c None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:56.770091 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a88c26-98e7-4f80-81ea-54430284fa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:56.771380 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a88c26-98e7-4f80-81ea-54430284fa81 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:56.772295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a88c26-98e7-4f80-81ea-54430284fa81 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:56.772834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a88c26-98e7-4f80-81ea-54430284fa81 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:56.773852 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a88c26-98e7-4f80-81ea-54430284fa81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:56.774366 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a88c26-98e7-4f80-81ea-54430284fa81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:56.776833 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a88c26-98e7-4f80-81ea-54430284fa81 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:56.788626 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 63/129] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:38:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:56.789881 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a88c26-98e7-4f80-81ea-54430284fa81 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:56.791035 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480766ef-c57c-4096-a0f0-ebeba38c29a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:56.791994 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480766ef-c57c-4096-a0f0-ebeba38c29a0 None admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:56.792288 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480766ef-c57c-4096-a0f0-ebeba38c29a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:56.792569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480766ef-c57c-4096-a0f0-ebeba38c29a0 None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609/users/58555002ddb548cb941a3a670b187b25/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:56.796931 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480766ef-c57c-4096-a0f0-ebeba38c29a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab32a97afff44105a351deb0fa2e7609, user_id=58555002ddb548cb941a3a670b187b25, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:56.798409 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480766ef-c57c-4096-a0f0-ebeba38c29a0 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:56.801286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:56.901440 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a88c26-98e7-4f80-81ea-54430284fa81 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:56.924311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 67/130] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:38:56 2022] PUT /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609/users/58555002ddb548cb941a3a670b187b25/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:38:56.926093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480766ef-c57c-4096-a0f0-ebeba38c29a0 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:56.959322 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf947c60-fbe1-4251-b007-f2708c7c3896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:56.960592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf947c60-fbe1-4251-b007-f2708c7c3896 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:56.961285 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf947c60-fbe1-4251-b007-f2708c7c3896 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:56.961795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf947c60-fbe1-4251-b007-f2708c7c3896 None admin] PATH_INFO: `/v3/projects/a0b92103e14c4fbf92f174a45058e732` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:56.963433 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf947c60-fbe1-4251-b007-f2708c7c3896 None admin] RBAC: Authorizing `identity:get_project(project_id=a0b92103e14c4fbf92f174a45058e732)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:56.965305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf947c60-fbe1-4251-b007-f2708c7c3896 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:56.968136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 64/131] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:38:56 2022] GET /identity/v3/projects/a0b92103e14c4fbf92f174a45058e732 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:56.969338 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf947c60-fbe1-4251-b007-f2708c7c3896 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:57.039846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:57.064858 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480766ef-c57c-4096-a0f0-ebeba38c29a0 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:57.110028 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a9399-b425-45b1-a481-9f0a7f5647f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:57.110920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a9399-b425-45b1-a481-9f0a7f5647f5 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:57.111210 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a9399-b425-45b1-a481-9f0a7f5647f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:57.111545 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a9399-b425-45b1-a481-9f0a7f5647f5 None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:57.112796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a9399-b425-45b1-a481-9f0a7f5647f5 None admin] RBAC: Authorizing `identity:get_project(project_id=ab32a97afff44105a351deb0fa2e7609)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:57.114269 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a9399-b425-45b1-a481-9f0a7f5647f5 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:57.115987 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 68/132] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:38:56 2022] GET /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:57.116964 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a9399-b425-45b1-a481-9f0a7f5647f5 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:57.157085 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf947c60-fbe1-4251-b007-f2708c7c3896 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:57.193782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:57.201406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd4a1d-48f2-4413-9712-37960f13257c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:57.202586 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd4a1d-48f2-4413-9712-37960f13257c None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:57.202879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd4a1d-48f2-4413-9712-37960f13257c None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:57.203332 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd4a1d-48f2-4413-9712-37960f13257c None admin] PATH_INFO: `/v3/users/58555002ddb548cb941a3a670b187b25` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:57.205382 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd4a1d-48f2-4413-9712-37960f13257c None admin] RBAC: Authorizing `identity:get_user(user_id=58555002ddb548cb941a3a670b187b25)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:57.206871 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd4a1d-48f2-4413-9712-37960f13257c None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:57.208533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 65/133] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:56 2022] GET /identity/v3/users/58555002ddb548cb941a3a670b187b25 => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:57.209732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd4a1d-48f2-4413-9712-37960f13257c None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:57.242424 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a9399-b425-45b1-a481-9f0a7f5647f5 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:57.317486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3606d4-7385-43f8-95e0-a37f20de0853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:57.318373 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3606d4-7385-43f8-95e0-a37f20de0853 None admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:57.318665 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3606d4-7385-43f8-95e0-a37f20de0853 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:57.318949 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3606d4-7385-43f8-95e0-a37f20de0853 None admin] PATH_INFO: `/v3/projects/a0b92103e14c4fbf92f174a45058e732/users/58555002ddb548cb941a3a670b187b25/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:57.322589 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3606d4-7385-43f8-95e0-a37f20de0853 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0b92103e14c4fbf92f174a45058e732, user_id=58555002ddb548cb941a3a670b187b25, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:57.324076 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3606d4-7385-43f8-95e0-a37f20de0853 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:57.368092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd4a1d-48f2-4413-9712-37960f13257c None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:57.385040 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:57.406219 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa64de2-eb72-4899-a1aa-962de23d943b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:57.407131 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa64de2-eb72-4899-a1aa-962de23d943b None admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:57.407425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa64de2-eb72-4899-a1aa-962de23d943b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:57.407714 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa64de2-eb72-4899-a1aa-962de23d943b None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609/users/587163b8ce4f4c51b7955cf5936eed6d/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:57.409833 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa64de2-eb72-4899-a1aa-962de23d943b None admin] RBAC: Authorizing `identity:create_grant(project_id=ab32a97afff44105a351deb0fa2e7609, user_id=587163b8ce4f4c51b7955cf5936eed6d, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:57.411390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa64de2-eb72-4899-a1aa-962de23d943b None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:57.437079 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 69/134] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:38:57 2022] PUT /identity/v3/projects/a0b92103e14c4fbf92f174a45058e732/users/58555002ddb548cb941a3a670b187b25/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:38:57.439837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3606d4-7385-43f8-95e0-a37f20de0853 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:57.521975 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 66/135] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:38:57 2022] PUT /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609/users/587163b8ce4f4c51b7955cf5936eed6d/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:38:57.571838 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3606d4-7385-43f8-95e0-a37f20de0853 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:57.607591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:57.633734 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa37ae-0968-4fc1-a5f6-83a06cc6a253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:57.634690 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa37ae-0968-4fc1-a5f6-83a06cc6a253 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:57.634946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa37ae-0968-4fc1-a5f6-83a06cc6a253 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:57.635234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa37ae-0968-4fc1-a5f6-83a06cc6a253 None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:57.640887 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa37ae-0968-4fc1-a5f6-83a06cc6a253 None admin] RBAC: Authorizing `identity:get_project(project_id=ab32a97afff44105a351deb0fa2e7609)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:57.642505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa37ae-0968-4fc1-a5f6-83a06cc6a253 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:57.644367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 70/136] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:38:57 2022] GET /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:57.650651 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa64de2-eb72-4899-a1aa-962de23d943b None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:57.787781 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa64de2-eb72-4899-a1aa-962de23d943b None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:57.829364 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36faa564-f645-43fd-8391-4db4915773dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:57.830191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faa564-f645-43fd-8391-4db4915773dc None admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:57.830480 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faa564-f645-43fd-8391-4db4915773dc None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:57.830763 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faa564-f645-43fd-8391-4db4915773dc None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609/users/58555002ddb548cb941a3a670b187b25/roles/f86a1d8dfb24430a98414eab048c4be9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:57.833060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36faa564-f645-43fd-8391-4db4915773dc None admin] RBAC: Authorizing `identity:create_grant(project_id=ab32a97afff44105a351deb0fa2e7609, user_id=58555002ddb548cb941a3a670b187b25, role_id=f86a1d8dfb24430a98414eab048c4be9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:57.834544 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36faa564-f645-43fd-8391-4db4915773dc None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:57.915296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85180f0-69f9-4b00-b153-f3efdef93f0e None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:57.915927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85180f0-69f9-4b00-b153-f3efdef93f0e None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:57.916423 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85180f0-69f9-4b00-b153-f3efdef93f0e None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:57.918140 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 71/137] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:38:57.922463 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 67/138] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:38:57 2022] PUT /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609/users/58555002ddb548cb941a3a670b187b25/roles/f86a1d8dfb24430a98414eab048c4be9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:38:57.924483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9f755-bcf4-489c-9706-3772361b7fb9 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:57.925392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9f755-bcf4-489c-9706-3772361b7fb9 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:57.925911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9f755-bcf4-489c-9706-3772361b7fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:57.946236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-f3e9f755-bcf4-489c-9706-3772361b7fb9 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:57.947764 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-f3e9f755-bcf4-489c-9706-3772361b7fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:58.051103 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 72/139] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:38:58.091850 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36faa564-f645-43fd-8391-4db4915773dc None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:58.131054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:58.189321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca32208-1fa2-486d-bdd5-d84c94be0f5b None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:58.189940 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca32208-1fa2-486d-bdd5-d84c94be0f5b None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:58.190439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca32208-1fa2-486d-bdd5-d84c94be0f5b None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:58.192196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 73/140] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:38:58.197966 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58030e41-d83b-42a6-9a32-dc8d1714230b None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:58.199401 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58030e41-d83b-42a6-9a32-dc8d1714230b None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:58.199896 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58030e41-d83b-42a6-9a32-dc8d1714230b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:58.218461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-58030e41-d83b-42a6-9a32-dc8d1714230b None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:58.219989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-58030e41-d83b-42a6-9a32-dc8d1714230b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:58.248547 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36faa564-f645-43fd-8391-4db4915773dc None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:58.315593 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 74/141] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:38:58.328317 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea8d17-9b22-4234-af35-cbba6e509622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:58.329169 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea8d17-9b22-4234-af35-cbba6e509622 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:58.329464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea8d17-9b22-4234-af35-cbba6e509622 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:58.329751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea8d17-9b22-4234-af35-cbba6e509622 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:58.330978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea8d17-9b22-4234-af35-cbba6e509622 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:58.332456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea8d17-9b22-4234-af35-cbba6e509622 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:58.334126 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 68/142] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:58.339627 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58030e41-d83b-42a6-9a32-dc8d1714230b None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:58.366252 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea8d17-9b22-4234-af35-cbba6e509622 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:58.436494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:58.546110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58030e41-d83b-42a6-9a32-dc8d1714230b None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:58.564996 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:58.574984 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea8d17-9b22-4234-af35-cbba6e509622 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:58.627987 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f11b6-887c-41a0-a0db-2699f4f50499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:58.628584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f11b6-887c-41a0-a0db-2699f4f50499 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:58.628899 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f11b6-887c-41a0-a0db-2699f4f50499 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:58.629179 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f11b6-887c-41a0-a0db-2699f4f50499 None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:58.629923 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f11b6-887c-41a0-a0db-2699f4f50499 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:58.632997 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f11b6-887c-41a0-a0db-2699f4f50499 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:58.655262 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dda1c4-8fc6-417d-be60-275a1b9a0d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:58.656197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dda1c4-8fc6-417d-be60-275a1b9a0d7f None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:58.656498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dda1c4-8fc6-417d-be60-275a1b9a0d7f None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:58.656820 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dda1c4-8fc6-417d-be60-275a1b9a0d7f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:58.668610 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dda1c4-8fc6-417d-be60-275a1b9a0d7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:58.677510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-32dda1c4-8fc6-417d-be60-275a1b9a0d7f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:38:58.677510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:58.677510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:58.677510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:58.677510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:58.677510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:58.677510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:58.677510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:58.677510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:58.677510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:58.677510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:58.677510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:58.677510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:58.677510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:58.677510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:58.677510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:58.678371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:58.678371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:58.678371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:58.678371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:58.678371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:58.678371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:58.678371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:58.678371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:58.678371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:58.678371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:58.678371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:58.678371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:58.678371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:58.678371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:58.678371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:58.678371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:58.679107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:58.679107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:58.679107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:58.679107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:58.679107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:58.679107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:58.679107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:58.679107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:58.679107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:58.679107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:58.679107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:38:58.679107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:38:58.679107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 69/143] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:38:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:38:58.685400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dda1c4-8fc6-417d-be60-275a1b9a0d7f None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:58.751117 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 75/144] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 23 10:38:58 2022] POST /identity/v3/users => generated 283 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:38:58.822744 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dda1c4-8fc6-417d-be60-275a1b9a0d7f None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:58.873558 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40189c5c-4cda-4b88-bf9f-d34f72d70f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:58.874256 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40189c5c-4cda-4b88-bf9f-d34f72d70f81 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:58.874544 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40189c5c-4cda-4b88-bf9f-d34f72d70f81 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:58.874825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40189c5c-4cda-4b88-bf9f-d34f72d70f81 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:58.875628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40189c5c-4cda-4b88-bf9f-d34f72d70f81 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:58.875907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40189c5c-4cda-4b88-bf9f-d34f72d70f81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:58.877592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40189c5c-4cda-4b88-bf9f-d34f72d70f81 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:58.893424 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 70/145] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:38:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:58.898825 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f11b6-887c-41a0-a0db-2699f4f50499 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:59.046941 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f11b6-887c-41a0-a0db-2699f4f50499 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:59.058782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:59.091446 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea133d6-4b63-4085-821f-699ae160b7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:59.092331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea133d6-4b63-4085-821f-699ae160b7bc None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:59.092610 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea133d6-4b63-4085-821f-699ae160b7bc None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:59.092906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea133d6-4b63-4085-821f-699ae160b7bc None admin] PATH_INFO: `/v3/users/1aadf7cef8494df4a0f2ff7b5b37113c` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:59.097445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea133d6-4b63-4085-821f-699ae160b7bc None admin] RBAC: Authorizing `identity:get_user(user_id=1aadf7cef8494df4a0f2ff7b5b37113c)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:59.098909 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea133d6-4b63-4085-821f-699ae160b7bc None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:59.100570 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 76/146] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:58 2022] GET /identity/v3/users/1aadf7cef8494df4a0f2ff7b5b37113c => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:59.107245 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40189c5c-4cda-4b88-bf9f-d34f72d70f81 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:59.136266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:59.250701 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40189c5c-4cda-4b88-bf9f-d34f72d70f81 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:59.291604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be13d0-1e4e-467a-930a-149c62848e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:59.292487 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be13d0-1e4e-467a-930a-149c62848e19 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:59.292835 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be13d0-1e4e-467a-930a-149c62848e19 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:59.293113 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be13d0-1e4e-467a-930a-149c62848e19 None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:59.295177 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be13d0-1e4e-467a-930a-149c62848e19 None admin] RBAC: Authorizing `identity:get_project(project_id=ab32a97afff44105a351deb0fa2e7609)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:59.296657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be13d0-1e4e-467a-930a-149c62848e19 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:59.298562 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 71/147] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:38:59 2022] GET /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:59.304140 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea133d6-4b63-4085-821f-699ae160b7bc None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:59.415960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea133d6-4b63-4085-821f-699ae160b7bc None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:59.469100 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808344c-7f6c-429e-958f-ddc26f3781c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:59.470022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808344c-7f6c-429e-958f-ddc26f3781c8 None admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:59.470306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808344c-7f6c-429e-958f-ddc26f3781c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:59.470584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808344c-7f6c-429e-958f-ddc26f3781c8 None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609/users/1aadf7cef8494df4a0f2ff7b5b37113c/roles/4b240816f7ab46a8b8674d54c63a9f03` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:59.472613 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808344c-7f6c-429e-958f-ddc26f3781c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab32a97afff44105a351deb0fa2e7609, user_id=1aadf7cef8494df4a0f2ff7b5b37113c, role_id=4b240816f7ab46a8b8674d54c63a9f03)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:59.474160 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808344c-7f6c-429e-958f-ddc26f3781c8 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:59.573923 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 77/148] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:38:59 2022] PUT /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609/users/1aadf7cef8494df4a0f2ff7b5b37113c/roles/4b240816f7ab46a8b8674d54c63a9f03 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:39:00.011289 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb70cd-079c-4a31-832c-4fda820ca752 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:00.011685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb70cd-079c-4a31-832c-4fda820ca752 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:00.011884 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb70cd-079c-4a31-832c-4fda820ca752 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:00.013729 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 72/149] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:00.019080 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922515b1-e2ef-48b9-aa2c-61dc8b72141a None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:00.019379 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922515b1-e2ef-48b9-aa2c-61dc8b72141a None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:00.019664 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922515b1-e2ef-48b9-aa2c-61dc8b72141a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:00.040857 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-922515b1-e2ef-48b9-aa2c-61dc8b72141a None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:00.042054 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-922515b1-e2ef-48b9-aa2c-61dc8b72141a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:00.080439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:00.127220 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 78/150] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:00.181296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb70cd-079c-4a31-832c-4fda820ca752 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:00.300729 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:00.314085 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb70cd-079c-4a31-832c-4fda820ca752 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:00.358588 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b0f91-b19b-4012-9f62-69809a6d9144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:00.359397 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b0f91-b19b-4012-9f62-69809a6d9144 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:00.359683 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b0f91-b19b-4012-9f62-69809a6d9144 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:00.359962 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b0f91-b19b-4012-9f62-69809a6d9144 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:00.370859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b0f91-b19b-4012-9f62-69809a6d9144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:00.379030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-ad6b0f91-b19b-4012-9f62-69809a6d9144 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:00.379030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:00.379030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:00.379030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:00.379030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:00.379030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:00.379030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:00.379030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:00.379030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:00.379030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:00.379030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:00.379030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:00.379030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:00.379030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:00.379030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:00.379030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:00.379925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:00.379925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:00.379925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:00.379925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:00.379925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:00.379925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:00.379925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:00.379925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:00.379925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:00.379925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:00.379925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:00.379925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:00.379925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:00.379925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:00.379925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:00.379925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:00.380761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:00.380761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:00.380761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:00.380761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:00.380761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:00.380761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:00.380761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:00.380761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:00.380761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:00.380761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:00.380761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:00.380761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:00.380761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 73/151] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:00.388345 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922515b1-e2ef-48b9-aa2c-61dc8b72141a None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:00.507605 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922515b1-e2ef-48b9-aa2c-61dc8b72141a None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:00.548488 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5b37d-163b-47ef-b486-d384ee2af7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:00.549205 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5b37d-163b-47ef-b486-d384ee2af7dc None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:00.549494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5b37d-163b-47ef-b486-d384ee2af7dc None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:00.549775 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5b37d-163b-47ef-b486-d384ee2af7dc None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:00.550546 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5b37d-163b-47ef-b486-d384ee2af7dc None admin] RBAC: Adding query filter params (name=member) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:00.550917 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5b37d-163b-47ef-b486-d384ee2af7dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:00.552269 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5b37d-163b-47ef-b486-d384ee2af7dc None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:00.565382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 79/152] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:00.571114 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b0f91-b19b-4012-9f62-69809a6d9144 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:00.694517 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b0f91-b19b-4012-9f62-69809a6d9144 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:00.730754 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a8730-e9db-496d-ad97-6a25788fd3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:00.731779 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a8730-e9db-496d-ad97-6a25788fd3a5 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:00.732271 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a8730-e9db-496d-ad97-6a25788fd3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:00.732656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a8730-e9db-496d-ad97-6a25788fd3a5 None admin] PATH_INFO: `/v3/users/58555002ddb548cb941a3a670b187b25` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:00.733891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a8730-e9db-496d-ad97-6a25788fd3a5 None admin] RBAC: Authorizing `identity:get_user(user_id=58555002ddb548cb941a3a670b187b25)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:00.735433 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a8730-e9db-496d-ad97-6a25788fd3a5 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:00.737155 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 74/153] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:00 2022] GET /identity/v3/users/58555002ddb548cb941a3a670b187b25 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:00.742644 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5b37d-163b-47ef-b486-d384ee2af7dc None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:00.754502 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873ddad-1891-4806-bf4a-967b08e92bbc None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:00.754792 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873ddad-1891-4806-bf4a-967b08e92bbc None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:00.755067 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873ddad-1891-4806-bf4a-967b08e92bbc None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:00.756437 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 75/154] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:00.760731 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a196b-1109-436b-8583-228f842b5afd None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:00.761022 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a196b-1109-436b-8583-228f842b5afd None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:00.761303 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a196b-1109-436b-8583-228f842b5afd None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:00.762627 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 76/155] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:00.764286 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e93205-f363-47a0-b27c-b867ee02e070 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:00.764575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e93205-f363-47a0-b27c-b867ee02e070 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:00.764879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e93205-f363-47a0-b27c-b867ee02e070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:00.785004 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:00.792863 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-79e93205-f363-47a0-b27c-b867ee02e070 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:00.794674 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-79e93205-f363-47a0-b27c-b867ee02e070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:00.811561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:00.931175 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5b37d-163b-47ef-b486-d384ee2af7dc None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:00.967482 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 77/156] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:00.968810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f66dff-0bf7-4e62-937b-d29561271955 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:00.969101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f66dff-0bf7-4e62-937b-d29561271955 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:00.969377 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f66dff-0bf7-4e62-937b-d29561271955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:01.010562 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-20f66dff-0bf7-4e62-937b-d29561271955 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:01.011753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-20f66dff-0bf7-4e62-937b-d29561271955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:01.025359 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc2acb-0ead-411d-acdf-94877f24add6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:01.026034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc2acb-0ead-411d-acdf-94877f24add6 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:01.026317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc2acb-0ead-411d-acdf-94877f24add6 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:01.026590 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc2acb-0ead-411d-acdf-94877f24add6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:01.158153 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc2acb-0ead-411d-acdf-94877f24add6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:01.159649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc2acb-0ead-411d-acdf-94877f24add6 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:01.167047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 78/157] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:01.167932 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f66dff-0bf7-4e62-937b-d29561271955 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:01.206258 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:01.268749 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 80/158] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:01.270284 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6db267-149c-45e8-8a69-1bd8450279aa None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:01.270581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6db267-149c-45e8-8a69-1bd8450279aa None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:01.270859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6db267-149c-45e8-8a69-1bd8450279aa None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:01.272145 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 81/159] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:01.272877 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6db267-149c-45e8-8a69-1bd8450279aa None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:01.322623 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:01.379209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f66dff-0bf7-4e62-937b-d29561271955 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:01.392702 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6db267-149c-45e8-8a69-1bd8450279aa None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:01.425168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:01.433989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c27657-0aef-4a13-ad63-d8bed6392f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:01.435872 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c27657-0aef-4a13-ad63-d8bed6392f72 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:01.437712 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c27657-0aef-4a13-ad63-d8bed6392f72 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:01.443140 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c27657-0aef-4a13-ad63-d8bed6392f72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:01.448529 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308334b-ae7b-4fa0-b24d-c99fb20159d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:01.449367 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308334b-ae7b-4fa0-b24d-c99fb20159d4 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:01.449655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308334b-ae7b-4fa0-b24d-c99fb20159d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:01.449966 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308334b-ae7b-4fa0-b24d-c99fb20159d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:01.452260 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c27657-0aef-4a13-ad63-d8bed6392f72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:01.461202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-14c27657-0aef-4a13-ad63-d8bed6392f72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:01.461202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:01.461202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:01.461202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:01.461202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:01.461202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:01.461202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:01.461202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:01.461202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:01.461202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:01.461202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:01.461202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:01.461202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:01.461202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:01.461202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:01.461202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:01.462088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:01.462088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:01.462088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:01.462088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:01.462088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:01.462088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:01.462088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:01.462088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:01.462088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:01.462088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:01.462088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:01.462088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:01.462088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:01.462088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:01.462088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:01.462088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:01.462836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:01.462836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:01.462836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:01.462836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:01.462836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:01.462836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:01.462836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:01.462836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:01.462836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:01.462836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:01.462836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:01.462836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:01.465938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 82/160] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:39:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:01.467735 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb802a-83f2-4714-a495-deb09140915a None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:01.468235 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb802a-83f2-4714-a495-deb09140915a None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:01.468745 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb802a-83f2-4714-a495-deb09140915a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:01.470616 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308334b-ae7b-4fa0-b24d-c99fb20159d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:01.488675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-9308334b-ae7b-4fa0-b24d-c99fb20159d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:01.488675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:01.488675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:01.488675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:01.488675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:01.488675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:01.488675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:01.488675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:01.488675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:01.488675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:01.488675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:01.488675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:01.488675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:01.488675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:01.488675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:01.488675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:01.489634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:01.489634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:01.489634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:01.489634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:01.489634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:01.489634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:01.489634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:01.489634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:01.489634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:01.489634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:01.489634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:01.489634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:01.489634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:01.489634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:01.489634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:01.489634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:01.490387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:01.490387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:01.490387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:01.490387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:01.490387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:01.490387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:01.490387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:01.490387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:01.490387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:01.490387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:01.490387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:01.490387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:01.490387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 79/161] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:39:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:01.490387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308334b-ae7b-4fa0-b24d-c99fb20159d4 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:01.505771 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-d4bb802a-83f2-4714-a495-deb09140915a None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:01.507377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d4bb802a-83f2-4714-a495-deb09140915a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:01.619458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 83/162] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:01.620721 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb802a-83f2-4714-a495-deb09140915a None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:01.687895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308334b-ae7b-4fa0-b24d-c99fb20159d4 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:01.723948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:01.729974 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb802a-83f2-4714-a495-deb09140915a None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:01.745933 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaeb143-5a22-49b5-9056-557c97f805ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:01.746949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaeb143-5a22-49b5-9056-557c97f805ad None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:01.747368 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaeb143-5a22-49b5-9056-557c97f805ad None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:01.747707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaeb143-5a22-49b5-9056-557c97f805ad None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:01.753421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaeb143-5a22-49b5-9056-557c97f805ad None admin] RBAC: Authorizing `identity:get_project(project_id=ab32a97afff44105a351deb0fa2e7609)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:01.754937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaeb143-5a22-49b5-9056-557c97f805ad None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:01.756691 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 80/163] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:01 2022] GET /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:01.757435 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:01.757547 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaeb143-5a22-49b5-9056-557c97f805ad None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:01.769174 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863c70a-46ed-44ba-94a6-3d9cd65fdb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:01.770194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863c70a-46ed-44ba-94a6-3d9cd65fdb9b None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:01.770636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863c70a-46ed-44ba-94a6-3d9cd65fdb9b None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:01.771073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863c70a-46ed-44ba-94a6-3d9cd65fdb9b None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:01.772960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863c70a-46ed-44ba-94a6-3d9cd65fdb9b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:01.772960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863c70a-46ed-44ba-94a6-3d9cd65fdb9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:01.774286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863c70a-46ed-44ba-94a6-3d9cd65fdb9b None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:01.784127 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 84/164] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:01.785484 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863c70a-46ed-44ba-94a6-3d9cd65fdb9b None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:01.888453 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863c70a-46ed-44ba-94a6-3d9cd65fdb9b None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:01.925904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb70fa-01d4-479b-9975-54af4dbdbdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:01.927129 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb70fa-01d4-479b-9975-54af4dbdbdcd None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:01.927600 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb70fa-01d4-479b-9975-54af4dbdbdcd None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:01.928065 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb70fa-01d4-479b-9975-54af4dbdbdcd None admin] PATH_INFO: `/v3/roles/member` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:01.939234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb70fa-01d4-479b-9975-54af4dbdbdcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:01.947656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-8bdb70fa-01d4-479b-9975-54af4dbdbdcd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:01.947656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:01.947656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:01.947656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:01.947656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:01.947656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:01.947656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:01.947656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:01.947656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:01.947656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:01.947656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:01.947656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:01.947656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:01.947656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:01.947656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:01.947656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:01.948922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:01.948922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:01.948922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:01.948922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:01.948922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:01.948922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:01.948922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:01.948922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:01.948922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:01.948922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:01.948922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:01.948922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:01.948922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:01.948922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:01.948922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:01.948922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:01.949902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:01.949902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:01.949902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:01.949902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:01.949902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:01.949902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:01.949902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:01.949902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:01.949902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:01.949902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:01.949902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:01.949902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:01.952549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 85/165] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:01.953647 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb70fa-01d4-479b-9975-54af4dbdbdcd None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:01.958645 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaeb143-5a22-49b5-9056-557c97f805ad None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:02.005002 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:02.063605 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb70fa-01d4-479b-9975-54af4dbdbdcd None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:02.098312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a30d2f-4bec-4da3-ae52-5d12e35bfb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:02.099243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a30d2f-4bec-4da3-ae52-5d12e35bfb32 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:02.099666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a30d2f-4bec-4da3-ae52-5d12e35bfb32 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:02.100082 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a30d2f-4bec-4da3-ae52-5d12e35bfb32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:02.101184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a30d2f-4bec-4da3-ae52-5d12e35bfb32 None admin] RBAC: Adding query filter params (role.id=14edb03a6a644798bdbf762bb59f6ef9, scope.project.id=ab32a97afff44105a351deb0fa2e7609, user.id=58555002ddb548cb941a3a670b187b25) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:02.101668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a30d2f-4bec-4da3-ae52-5d12e35bfb32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:02.103254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a30d2f-4bec-4da3-ae52-5d12e35bfb32 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:02.105944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc8365-059d-4ab3-9fec-9a8b12311277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:02.107410 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc8365-059d-4ab3-9fec-9a8b12311277 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:02.107410 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc8365-059d-4ab3-9fec-9a8b12311277 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:02.107890 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc8365-059d-4ab3-9fec-9a8b12311277 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:02.108791 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc8365-059d-4ab3-9fec-9a8b12311277 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:02.109004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc8365-059d-4ab3-9fec-9a8b12311277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:02.110409 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc8365-059d-4ab3-9fec-9a8b12311277 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:02.111313 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 86/166] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:01 2022] GET /identity/v3/role_assignments?user.id=58555002ddb548cb941a3a670b187b25&scope.project.id=ab32a97afff44105a351deb0fa2e7609&role.id=14edb03a6a644798bdbf762bb59f6ef9 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:02.112261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a30d2f-4bec-4da3-ae52-5d12e35bfb32 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:02.139198 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 81/167] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:02.140156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc8365-059d-4ab3-9fec-9a8b12311277 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:02.245076 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a30d2f-4bec-4da3-ae52-5d12e35bfb32 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:02.247942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:02.277035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:02.302346 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a444899-7ff7-49c7-ac66-1b46b319a48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:02.303238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a444899-7ff7-49c7-ac66-1b46b319a48c None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:02.303519 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a444899-7ff7-49c7-ac66-1b46b319a48c None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:02.303797 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a444899-7ff7-49c7-ac66-1b46b319a48c None admin] PATH_INFO: `/v3/users/58555002ddb548cb941a3a670b187b25` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:02.305050 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a444899-7ff7-49c7-ac66-1b46b319a48c None admin] RBAC: Authorizing `identity:get_user(user_id=58555002ddb548cb941a3a670b187b25)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:02.306505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a444899-7ff7-49c7-ac66-1b46b319a48c None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:02.308323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 87/168] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:02 2022] GET /identity/v3/users/58555002ddb548cb941a3a670b187b25 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:02.308940 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a444899-7ff7-49c7-ac66-1b46b319a48c None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:02.328249 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc8365-059d-4ab3-9fec-9a8b12311277 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:02.370455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148beae3-1281-4f25-9064-a747b719b556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:02.371148 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148beae3-1281-4f25-9064-a747b719b556 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:02.371437 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148beae3-1281-4f25-9064-a747b719b556 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:02.371720 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148beae3-1281-4f25-9064-a747b719b556 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:02.372849 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148beae3-1281-4f25-9064-a747b719b556 None admin] RBAC: Adding query filter params (name=member) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:02.375519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148beae3-1281-4f25-9064-a747b719b556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:02.376998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148beae3-1281-4f25-9064-a747b719b556 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:02.399168 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 82/169] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:02.401827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148beae3-1281-4f25-9064-a747b719b556 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:02.516733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a444899-7ff7-49c7-ac66-1b46b319a48c None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:02.590727 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ad68f-1392-4120-8804-1817bb7fdb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:02.592152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ad68f-1392-4120-8804-1817bb7fdb1a None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:02.592442 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ad68f-1392-4120-8804-1817bb7fdb1a None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:02.592746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ad68f-1392-4120-8804-1817bb7fdb1a None admin] PATH_INFO: `/v3/users/587163b8ce4f4c51b7955cf5936eed6d` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:02.594159 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ad68f-1392-4120-8804-1817bb7fdb1a None admin] RBAC: Authorizing `identity:get_user(user_id=587163b8ce4f4c51b7955cf5936eed6d)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:02.595791 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ad68f-1392-4120-8804-1817bb7fdb1a None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:02.598139 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 88/170] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:02 2022] GET /identity/v3/users/587163b8ce4f4c51b7955cf5936eed6d => generated 247 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:02.598839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ad68f-1392-4120-8804-1817bb7fdb1a None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:02.626610 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148beae3-1281-4f25-9064-a747b719b556 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:02.676999 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:02.688622 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:02.710880 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc218f-688a-4abb-a4e6-49e3d61a2139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:02.711615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc218f-688a-4abb-a4e6-49e3d61a2139 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:02.711908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc218f-688a-4abb-a4e6-49e3d61a2139 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:02.712186 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc218f-688a-4abb-a4e6-49e3d61a2139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:02.821551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc218f-688a-4abb-a4e6-49e3d61a2139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:02.822978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc218f-688a-4abb-a4e6-49e3d61a2139 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:02.850836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ad68f-1392-4120-8804-1817bb7fdb1a None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:02.922145 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858f771-1334-4a5e-bdaf-c6a29de79593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:02.923093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858f771-1334-4a5e-bdaf-c6a29de79593 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:02.923378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858f771-1334-4a5e-bdaf-c6a29de79593 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:02.923661 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858f771-1334-4a5e-bdaf-c6a29de79593 None admin] PATH_INFO: `/v3/users/58555002ddb548cb941a3a670b187b25` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:02.925199 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858f771-1334-4a5e-bdaf-c6a29de79593 None admin] RBAC: Authorizing `identity:get_user(user_id=58555002ddb548cb941a3a670b187b25)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:02.926665 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858f771-1334-4a5e-bdaf-c6a29de79593 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:02.932749 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 89/171] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:02 2022] GET /identity/v3/users/58555002ddb548cb941a3a670b187b25 => generated 275 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:02.933558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858f771-1334-4a5e-bdaf-c6a29de79593 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:03.002374 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 83/172] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:03.003501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc218f-688a-4abb-a4e6-49e3d61a2139 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:03.052093 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:03.110292 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858f771-1334-4a5e-bdaf-c6a29de79593 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:03.129006 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:03.146881 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7eca7e-99b1-4331-ac1b-43c4e3b036ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:03.147550 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eca7e-99b1-4331-ac1b-43c4e3b036ec None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:03.147836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eca7e-99b1-4331-ac1b-43c4e3b036ec None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:03.148112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eca7e-99b1-4331-ac1b-43c4e3b036ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:03.220556 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7eca7e-99b1-4331-ac1b-43c4e3b036ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:03.222105 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7eca7e-99b1-4331-ac1b-43c4e3b036ec None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:03.257768 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc218f-688a-4abb-a4e6-49e3d61a2139 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:03.313783 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa269b4-2509-44a6-b59b-859180bdff27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:03.314456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa269b4-2509-44a6-b59b-859180bdff27 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:03.314744 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa269b4-2509-44a6-b59b-859180bdff27 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:03.315023 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa269b4-2509-44a6-b59b-859180bdff27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:03.330193 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 90/173] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:03.331044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7eca7e-99b1-4331-ac1b-43c4e3b036ec None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:03.353740 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:03.402844 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa269b4-2509-44a6-b59b-859180bdff27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:03.406953 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa269b4-2509-44a6-b59b-859180bdff27 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:03.439281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:03.440138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7eca7e-99b1-4331-ac1b-43c4e3b036ec None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:03.476720 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3f6e4-4605-4511-9ad2-799964d6c735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:03.477697 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3f6e4-4605-4511-9ad2-799964d6c735 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:03.478044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3f6e4-4605-4511-9ad2-799964d6c735 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:03.478389 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3f6e4-4605-4511-9ad2-799964d6c735 None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:03.479639 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3f6e4-4605-4511-9ad2-799964d6c735 None admin] RBAC: Authorizing `identity:get_project(project_id=ab32a97afff44105a351deb0fa2e7609)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:03.481257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3f6e4-4605-4511-9ad2-799964d6c735 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:03.487867 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 91/174] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:03 2022] GET /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:03.487867 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13002452-dbbc-4dd0-b8a5-8914ae04c694 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:03.487867 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13002452-dbbc-4dd0-b8a5-8914ae04c694 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:03.487867 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13002452-dbbc-4dd0-b8a5-8914ae04c694 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:03.487867 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 92/175] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:03.487867 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af97f0-001f-43a3-bc45-eb2e3e7b1c49 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:03.488321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af97f0-001f-43a3-bc45-eb2e3e7b1c49 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:03.488321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af97f0-001f-43a3-bc45-eb2e3e7b1c49 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:03.489275 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 93/176] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:03.494012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af97f0-001f-43a3-bc45-eb2e3e7b1c49 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:03.542460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 84/177] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:03.543760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa269b4-2509-44a6-b59b-859180bdff27 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:03.591382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:03.623143 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af97f0-001f-43a3-bc45-eb2e3e7b1c49 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:03.656347 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa269b4-2509-44a6-b59b-859180bdff27 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:03.662503 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ebbdd-ad2c-4611-baf6-341fa47a0df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:03.663384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ebbdd-ad2c-4611-baf6-341fa47a0df5 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:03.663823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ebbdd-ad2c-4611-baf6-341fa47a0df5 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:03.664229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ebbdd-ad2c-4611-baf6-341fa47a0df5 None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:03.665483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ebbdd-ad2c-4611-baf6-341fa47a0df5 None admin] RBAC: Authorizing `identity:get_project(project_id=ab32a97afff44105a351deb0fa2e7609)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:03.667307 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ebbdd-ad2c-4611-baf6-341fa47a0df5 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:03.674173 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 94/178] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:03 2022] GET /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:03.675772 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fbff1-f5a4-43cb-8819-b19e4f575785 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:03.676066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fbff1-f5a4-43cb-8819-b19e4f575785 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:03.676350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fbff1-f5a4-43cb-8819-b19e4f575785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:03.684934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:03.696401 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-e94fbff1-f5a4-43cb-8819-b19e4f575785 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:03.698939 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e94fbff1-f5a4-43cb-8819-b19e4f575785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:03.703236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8017d8-e436-4a9c-a8d2-a529a0c691d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:03.704180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8017d8-e436-4a9c-a8d2-a529a0c691d3 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:03.704707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8017d8-e436-4a9c-a8d2-a529a0c691d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:03.705209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8017d8-e436-4a9c-a8d2-a529a0c691d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:03.706247 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8017d8-e436-4a9c-a8d2-a529a0c691d3 None admin] RBAC: Adding query filter params (role.id=f86a1d8dfb24430a98414eab048c4be9, scope.project.id=ab32a97afff44105a351deb0fa2e7609, user.id=58555002ddb548cb941a3a670b187b25) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:03.706767 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8017d8-e436-4a9c-a8d2-a529a0c691d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:03.708816 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8017d8-e436-4a9c-a8d2-a529a0c691d3 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:03.720498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 85/179] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:03 2022] GET /identity/v3/role_assignments?user.id=58555002ddb548cb941a3a670b187b25&scope.project.id=ab32a97afff44105a351deb0fa2e7609&role.id=f86a1d8dfb24430a98414eab048c4be9 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:03.720498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc65ae-8dde-4d95-905d-7db8ccc5d04d None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:03.720498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc65ae-8dde-4d95-905d-7db8ccc5d04d None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:03.720498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc65ae-8dde-4d95-905d-7db8ccc5d04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:03.739054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-2dcc65ae-8dde-4d95-905d-7db8ccc5d04d None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:03.740394 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-2dcc65ae-8dde-4d95-905d-7db8ccc5d04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:03.786608 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 95/180] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:03.794833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fbff1-f5a4-43cb-8819-b19e4f575785 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:03.825604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 86/181] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:03.833796 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc65ae-8dde-4d95-905d-7db8ccc5d04d None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:03.878495 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:03.913000 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fbff1-f5a4-43cb-8819-b19e4f575785 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:03.953294 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc65ae-8dde-4d95-905d-7db8ccc5d04d None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:03.955083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f87ca-e16b-4bc5-b818-8945c72d35c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:03.956812 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f87ca-e16b-4bc5-b818-8945c72d35c1 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:03.957100 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f87ca-e16b-4bc5-b818-8945c72d35c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:03.957368 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f87ca-e16b-4bc5-b818-8945c72d35c1 None admin] PATH_INFO: `/v3/projects/a0b92103e14c4fbf92f174a45058e732` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:03.958575 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f87ca-e16b-4bc5-b818-8945c72d35c1 None admin] RBAC: Authorizing `identity:get_project(project_id=a0b92103e14c4fbf92f174a45058e732)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:03.960022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f87ca-e16b-4bc5-b818-8945c72d35c1 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:03.961922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 96/182] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:03 2022] GET /identity/v3/projects/a0b92103e14c4fbf92f174a45058e732 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:03.962934 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c028899-0355-4343-b1ef-9106c1b54155 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:03.963217 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c028899-0355-4343-b1ef-9106c1b54155 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:03.963488 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c028899-0355-4343-b1ef-9106c1b54155 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:03.964737 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 97/183] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:03.966614 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfd2d5-1afd-4c51-8649-fbe871efbac5 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:03.966965 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfd2d5-1afd-4c51-8649-fbe871efbac5 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:03.967404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfd2d5-1afd-4c51-8649-fbe871efbac5 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:03.968623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 98/184] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:03.971203 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfd2d5-1afd-4c51-8649-fbe871efbac5 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:03.977084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:03.995144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec04338-ce5c-4b22-8e4a-27567837ba0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:03.995808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec04338-ce5c-4b22-8e4a-27567837ba0b None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:03.996122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec04338-ce5c-4b22-8e4a-27567837ba0b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:03.996405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec04338-ce5c-4b22-8e4a-27567837ba0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:03.997504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec04338-ce5c-4b22-8e4a-27567837ba0b None admin] RBAC: Adding query filter params (role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.project.id=ab32a97afff44105a351deb0fa2e7609, user.id=587163b8ce4f4c51b7955cf5936eed6d) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:03.997826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec04338-ce5c-4b22-8e4a-27567837ba0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:03.999292 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec04338-ce5c-4b22-8e4a-27567837ba0b None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:04.005579 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 87/185] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:03 2022] GET /identity/v3/role_assignments?user.id=587163b8ce4f4c51b7955cf5936eed6d&scope.project.id=ab32a97afff44105a351deb0fa2e7609&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:04.006424 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec04338-ce5c-4b22-8e4a-27567837ba0b None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:04.086231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfd2d5-1afd-4c51-8649-fbe871efbac5 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:04.120752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec04338-ce5c-4b22-8e4a-27567837ba0b None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:04.124943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c046b6-d451-45c1-b626-933203abc7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:04.125762 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c046b6-d451-45c1-b626-933203abc7ad None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:04.126048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c046b6-d451-45c1-b626-933203abc7ad None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:04.126330 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c046b6-d451-45c1-b626-933203abc7ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:04.135149 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:04.138959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c046b6-d451-45c1-b626-933203abc7ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:04.146829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-28c046b6-d451-45c1-b626-933203abc7ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:04.146829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:04.146829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:04.146829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:04.146829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:04.146829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:04.146829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:04.146829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:04.146829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:04.146829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:04.146829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:04.146829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:04.146829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:04.146829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:04.146829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:04.146829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:04.147761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:04.147761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:04.147761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:04.147761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:04.147761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:04.147761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:04.147761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:04.147761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:04.147761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:04.147761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:04.147761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:04.147761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:04.147761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:04.147761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:04.147761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:04.147761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:04.148584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:04.148584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:04.148584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:04.148584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:04.148584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:04.148584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:04.148584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:04.148584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:04.148584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:04.148584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:04.148584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:04.148584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:04.148584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 99/186] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:39:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:04.149263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c046b6-d451-45c1-b626-933203abc7ad None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:04.170672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd96c2-535d-42dc-ad60-18332aa8e6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:04.171412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd96c2-535d-42dc-ad60-18332aa8e6f7 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:04.171699 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd96c2-535d-42dc-ad60-18332aa8e6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:04.171977 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd96c2-535d-42dc-ad60-18332aa8e6f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:04.183878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd96c2-535d-42dc-ad60-18332aa8e6f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:04.191808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-6fcd96c2-535d-42dc-ad60-18332aa8e6f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:39:04.191808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:04.191808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:04.191808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:04.191808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:04.191808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:04.191808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:04.191808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:04.191808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:04.191808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:04.191808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:04.191808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:04.191808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:04.191808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:04.191808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:04.191808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:04.192721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:04.192721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:04.192721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:04.192721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:04.192721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:04.192721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:04.192721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:04.192721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:04.192721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:04.192721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:04.192721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:04.192721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:04.192721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:04.192721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:04.192721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:04.192721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:04.193513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:04.193513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:04.193513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:04.193513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:04.193513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:04.193513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:04.193513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:04.193513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:04.193513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:04.193513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:04.193513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:39:04.193513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:04.194110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 88/187] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:04.196387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e0c40-d6cc-484c-a621-4bab7b91b6a0 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:04.196387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e0c40-d6cc-484c-a621-4bab7b91b6a0 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:04.196387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e0c40-d6cc-484c-a621-4bab7b91b6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:04.214940 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-827e0c40-d6cc-484c-a621-4bab7b91b6a0 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:04.216754 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-827e0c40-d6cc-484c-a621-4bab7b91b6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:04.255309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:04.268478 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c046b6-d451-45c1-b626-933203abc7ad None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:04.290437 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 89/188] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:04.291701 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b18bef-d90f-4e0c-8171-3f2cb42c8110 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:04.292000 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b18bef-d90f-4e0c-8171-3f2cb42c8110 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:04.292284 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b18bef-d90f-4e0c-8171-3f2cb42c8110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:04.303044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6a3c8-cf1a-43d3-bf5c-4273a3e09eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:04.303706 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6a3c8-cf1a-43d3-bf5c-4273a3e09eef None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:04.303996 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6a3c8-cf1a-43d3-bf5c-4273a3e09eef None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:04.304278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6a3c8-cf1a-43d3-bf5c-4273a3e09eef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:04.305177 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6a3c8-cf1a-43d3-bf5c-4273a3e09eef None admin] RBAC: Adding query filter params (role.id=14edb03a6a644798bdbf762bb59f6ef9, scope.project.id=a0b92103e14c4fbf92f174a45058e732, user.id=58555002ddb548cb941a3a670b187b25) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:04.305481 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6a3c8-cf1a-43d3-bf5c-4273a3e09eef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:04.306931 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6a3c8-cf1a-43d3-bf5c-4273a3e09eef None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:04.308292 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-b5b18bef-d90f-4e0c-8171-3f2cb42c8110 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:04.309550 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-b5b18bef-d90f-4e0c-8171-3f2cb42c8110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:04.313527 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 100/189] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:04 2022] GET /identity/v3/role_assignments?user.id=58555002ddb548cb941a3a670b187b25&scope.project.id=a0b92103e14c4fbf92f174a45058e732&role.id=14edb03a6a644798bdbf762bb59f6ef9 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:04.321730 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6a3c8-cf1a-43d3-bf5c-4273a3e09eef None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:04.395858 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:04.397366 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 90/190] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:04.398084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b18bef-d90f-4e0c-8171-3f2cb42c8110 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:04.455821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6a3c8-cf1a-43d3-bf5c-4273a3e09eef None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:04.496347 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78d735-ba9f-43e5-8634-44cacb684c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:04.497757 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78d735-ba9f-43e5-8634-44cacb684c86 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:04.498093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78d735-ba9f-43e5-8634-44cacb684c86 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:04.498376 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78d735-ba9f-43e5-8634-44cacb684c86 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:04.499138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78d735-ba9f-43e5-8634-44cacb684c86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:04.499449 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78d735-ba9f-43e5-8634-44cacb684c86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:04.500892 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78d735-ba9f-43e5-8634-44cacb684c86 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:04.514930 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 101/191] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:04.515757 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78d735-ba9f-43e5-8634-44cacb684c86 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:04.516532 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:04.521381 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b18bef-d90f-4e0c-8171-3f2cb42c8110 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:04.561383 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d48919-e36e-467f-8729-a8e62c7edb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:04.562064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d48919-e36e-467f-8729-a8e62c7edb36 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:04.562348 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d48919-e36e-467f-8729-a8e62c7edb36 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:04.562628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d48919-e36e-467f-8729-a8e62c7edb36 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:04.563384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d48919-e36e-467f-8729-a8e62c7edb36 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:04.563692 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d48919-e36e-467f-8729-a8e62c7edb36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:04.565135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d48919-e36e-467f-8729-a8e62c7edb36 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:04.573299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 91/192] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:04.574087 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d48919-e36e-467f-8729-a8e62c7edb36 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:04.626243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78d735-ba9f-43e5-8634-44cacb684c86 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:04.651800 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:04.660112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf4d3d-81f8-413f-b0d7-463e8e912ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:04.664959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf4d3d-81f8-413f-b0d7-463e8e912ced None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:04.664959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf4d3d-81f8-413f-b0d7-463e8e912ced None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:04.664959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf4d3d-81f8-413f-b0d7-463e8e912ced None admin] PATH_INFO: `/v3/domains/default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:04.664959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf4d3d-81f8-413f-b0d7-463e8e912ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:04.664959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf4d3d-81f8-413f-b0d7-463e8e912ced None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:04.670607 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 102/193] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:04.670607 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf4d3d-81f8-413f-b0d7-463e8e912ced None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:04.673812 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d48919-e36e-467f-8729-a8e62c7edb36 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:04.706762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39fa3c-8400-4393-8d6d-ce24f0639cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:04.707494 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39fa3c-8400-4393-8d6d-ce24f0639cf9 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:04.707776 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39fa3c-8400-4393-8d6d-ce24f0639cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:04.708056 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39fa3c-8400-4393-8d6d-ce24f0639cf9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:04.718162 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39fa3c-8400-4393-8d6d-ce24f0639cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:04.727307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-8b39fa3c-8400-4393-8d6d-ce24f0639cf9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:04.727307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:04.727307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:04.727307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:04.727307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:04.727307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:04.727307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:04.727307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:04.727307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:04.727307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:04.727307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:04.727307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:04.727307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:04.727307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:04.727307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:04.727307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:04.728272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:04.728272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:04.728272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:04.728272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:04.728272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:04.728272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:04.728272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:04.728272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:04.728272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:04.728272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:04.728272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:04.728272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:04.728272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:04.728272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:04.728272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:04.728272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:04.734235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:04.734235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:04.734235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:04.734235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:04.734235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:04.734235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:04.734235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:04.734235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:04.734235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:04.734235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:04.734235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:04.734235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:04.734235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 92/194] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:39:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:04.734235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39fa3c-8400-4393-8d6d-ce24f0639cf9 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:04.758900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:04.767875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf4d3d-81f8-413f-b0d7-463e8e912ced None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:04.800811 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871831f1-356f-41bf-a614-823b5bebfd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:04.801699 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871831f1-356f-41bf-a614-823b5bebfd1c None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:04.801986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871831f1-356f-41bf-a614-823b5bebfd1c None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:04.802276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871831f1-356f-41bf-a614-823b5bebfd1c None admin] PATH_INFO: `/v3/users/05c43177e9f040d5884daf7b40149a9e` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:04.815686 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871831f1-356f-41bf-a614-823b5bebfd1c None admin] RBAC: Authorizing `identity:get_user(user_id=05c43177e9f040d5884daf7b40149a9e)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:04.817182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871831f1-356f-41bf-a614-823b5bebfd1c None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:04.818862 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 103/195] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:04 2022] GET /identity/v3/users/05c43177e9f040d5884daf7b40149a9e => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:04.819601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871831f1-356f-41bf-a614-823b5bebfd1c None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:04.832505 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39fa3c-8400-4393-8d6d-ce24f0639cf9 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:04.866648 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a73965-d3b9-49ce-9b1f-3cded7291c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:04.867725 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a73965-d3b9-49ce-9b1f-3cded7291c6a None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:04.868014 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a73965-d3b9-49ce-9b1f-3cded7291c6a None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:04.868294 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a73965-d3b9-49ce-9b1f-3cded7291c6a None admin] PATH_INFO: `/v3/users/1aadf7cef8494df4a0f2ff7b5b37113c` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:04.869526 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a73965-d3b9-49ce-9b1f-3cded7291c6a None admin] RBAC: Authorizing `identity:get_user(user_id=1aadf7cef8494df4a0f2ff7b5b37113c)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:04.870963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a73965-d3b9-49ce-9b1f-3cded7291c6a None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:04.873446 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 93/196] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:04 2022] GET /identity/v3/users/1aadf7cef8494df4a0f2ff7b5b37113c => generated 289 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:04.874050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a73965-d3b9-49ce-9b1f-3cded7291c6a None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:04.875484 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:04.924726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871831f1-356f-41bf-a614-823b5bebfd1c None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:04.957781 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df07004-dfc4-4588-8083-1b4a34ca093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:04.958383 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07004-dfc4-4588-8083-1b4a34ca093d None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:04.958671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07004-dfc4-4588-8083-1b4a34ca093d None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:04.958947 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07004-dfc4-4588-8083-1b4a34ca093d None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:04.959655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df07004-dfc4-4588-8083-1b4a34ca093d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:04.961145 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df07004-dfc4-4588-8083-1b4a34ca093d None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:04.961424 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:04.970622 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a73965-d3b9-49ce-9b1f-3cded7291c6a None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:05.004963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc25065-844e-4441-916a-81d2fc25ea51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:05.005625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc25065-844e-4441-916a-81d2fc25ea51 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:05.005906 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc25065-844e-4441-916a-81d2fc25ea51 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:05.006183 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc25065-844e-4441-916a-81d2fc25ea51 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:05.006981 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc25065-844e-4441-916a-81d2fc25ea51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:05.007290 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc25065-844e-4441-916a-81d2fc25ea51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:05.008688 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc25065-844e-4441-916a-81d2fc25ea51 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:05.016696 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 94/197] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:05.018614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc25065-844e-4441-916a-81d2fc25ea51 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:05.030416 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 104/198] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 23 10:39:04 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:39:05.031266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df07004-dfc4-4588-8083-1b4a34ca093d None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:05.138481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc25065-844e-4441-916a-81d2fc25ea51 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:05.141975 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df07004-dfc4-4588-8083-1b4a34ca093d None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:05.152048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:05.175847 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f893c-f89e-420f-a582-0433544dc44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:05.176519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f893c-f89e-420f-a582-0433544dc44a None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:05.176879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f893c-f89e-420f-a582-0433544dc44a None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:05.177162 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f893c-f89e-420f-a582-0433544dc44a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:05.181766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14194dc2-5eae-454c-9892-bf28225fe8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:05.183016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14194dc2-5eae-454c-9892-bf28225fe8e0 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:05.183303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14194dc2-5eae-454c-9892-bf28225fe8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:05.183581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14194dc2-5eae-454c-9892-bf28225fe8e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:05.201651 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:05.255098 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f893c-f89e-420f-a582-0433544dc44a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:05.256500 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f893c-f89e-420f-a582-0433544dc44a None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:05.274201 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14194dc2-5eae-454c-9892-bf28225fe8e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:05.275696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14194dc2-5eae-454c-9892-bf28225fe8e0 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:05.378244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 95/199] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:05.379499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f893c-f89e-420f-a582-0433544dc44a None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:05.393250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 105/200] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:05.397519 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14194dc2-5eae-454c-9892-bf28225fe8e0 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:05.413162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:05.439315 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:05.504351 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f893c-f89e-420f-a582-0433544dc44a None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:05.520057 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14194dc2-5eae-454c-9892-bf28225fe8e0 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:05.548319 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c4667-b53d-4c10-bd95-e612ee9dd74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:05.549915 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c4667-b53d-4c10-bd95-e612ee9dd74c None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:05.550399 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c4667-b53d-4c10-bd95-e612ee9dd74c None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:05.550884 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c4667-b53d-4c10-bd95-e612ee9dd74c None admin] PATH_INFO: `/v3/users/05c43177e9f040d5884daf7b40149a9e` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:05.552326 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c4667-b53d-4c10-bd95-e612ee9dd74c None admin] RBAC: Authorizing `identity:get_user(user_id=05c43177e9f040d5884daf7b40149a9e)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:05.555008 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c4667-b53d-4c10-bd95-e612ee9dd74c None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:05.557869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 96/201] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:05 2022] GET /identity/v3/users/05c43177e9f040d5884daf7b40149a9e => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:05.558872 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c4667-b53d-4c10-bd95-e612ee9dd74c None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:05.572133 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2604b8e-4a3b-498e-b3df-83b629574f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:05.573060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2604b8e-4a3b-498e-b3df-83b629574f02 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:05.573353 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2604b8e-4a3b-498e-b3df-83b629574f02 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:05.573634 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2604b8e-4a3b-498e-b3df-83b629574f02 None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:05.575920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2604b8e-4a3b-498e-b3df-83b629574f02 None admin] RBAC: Authorizing `identity:get_project(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:05.577909 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2604b8e-4a3b-498e-b3df-83b629574f02 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:05.584720 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 106/202] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:05 2022] GET /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:05.585778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2604b8e-4a3b-498e-b3df-83b629574f02 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:05.686089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c4667-b53d-4c10-bd95-e612ee9dd74c None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:05.710497 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:05.725506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:05.734175 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2604b8e-4a3b-498e-b3df-83b629574f02 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:05.744090 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d9cea-1f70-4996-9a1f-3bb3eea74707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:05.746157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d9cea-1f70-4996-9a1f-3bb3eea74707 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:05.746588 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d9cea-1f70-4996-9a1f-3bb3eea74707 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:05.747891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d9cea-1f70-4996-9a1f-3bb3eea74707 None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:05.749301 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d9cea-1f70-4996-9a1f-3bb3eea74707 None admin] RBAC: Authorizing `identity:get_project(project_id=ab32a97afff44105a351deb0fa2e7609)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:05.751833 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d9cea-1f70-4996-9a1f-3bb3eea74707 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:05.754773 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 97/203] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:05 2022] GET /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:05.755708 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d9cea-1f70-4996-9a1f-3bb3eea74707 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:05.778921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51490363-688e-4448-be0a-8f14f78588e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:05.779374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51490363-688e-4448-be0a-8f14f78588e8 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:05.779725 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51490363-688e-4448-be0a-8f14f78588e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:05.780064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51490363-688e-4448-be0a-8f14f78588e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:05.859453 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51490363-688e-4448-be0a-8f14f78588e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:05.861077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51490363-688e-4448-be0a-8f14f78588e8 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:05.889485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d9cea-1f70-4996-9a1f-3bb3eea74707 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:05.937978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82f810-468c-4a6a-bfe1-3504707e0779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:05.938916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82f810-468c-4a6a-bfe1-3504707e0779 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:05.939343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82f810-468c-4a6a-bfe1-3504707e0779 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:05.939759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82f810-468c-4a6a-bfe1-3504707e0779 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:05.941314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82f810-468c-4a6a-bfe1-3504707e0779 None admin] RBAC: Adding query filter params (role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf, user.id=05c43177e9f040d5884daf7b40149a9e) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:05.941637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82f810-468c-4a6a-bfe1-3504707e0779 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:05.943091 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82f810-468c-4a6a-bfe1-3504707e0779 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:05.947991 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:05.949388 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 98/204] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:05 2022] GET /identity/v3/role_assignments?user.id=05c43177e9f040d5884daf7b40149a9e&scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:05.951204 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82f810-468c-4a6a-bfe1-3504707e0779 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:05.980984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 107/205] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:05.988687 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51490363-688e-4448-be0a-8f14f78588e8 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:06.025168 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:06.117105 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82f810-468c-4a6a-bfe1-3504707e0779 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:06.168662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c72c9-d3c6-4460-95c5-427827cdf6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:06.168662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c72c9-d3c6-4460-95c5-427827cdf6d2 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:06.168662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c72c9-d3c6-4460-95c5-427827cdf6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:06.168662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c72c9-d3c6-4460-95c5-427827cdf6d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:06.169139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c72c9-d3c6-4460-95c5-427827cdf6d2 None admin] RBAC: Adding query filter params (role.id=4b240816f7ab46a8b8674d54c63a9f03, scope.project.id=ab32a97afff44105a351deb0fa2e7609, user.id=1aadf7cef8494df4a0f2ff7b5b37113c) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:06.169139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c72c9-d3c6-4460-95c5-427827cdf6d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:06.169608 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c72c9-d3c6-4460-95c5-427827cdf6d2 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:06.183092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 99/206] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:05 2022] GET /identity/v3/role_assignments?user.id=1aadf7cef8494df4a0f2ff7b5b37113c&scope.project.id=ab32a97afff44105a351deb0fa2e7609&role.id=4b240816f7ab46a8b8674d54c63a9f03 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:06.186521 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51490363-688e-4448-be0a-8f14f78588e8 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:06.225618 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c80a8-3701-4779-8da5-cabf583363a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:06.226852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c80a8-3701-4779-8da5-cabf583363a0 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:06.227347 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c80a8-3701-4779-8da5-cabf583363a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:06.227834 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c80a8-3701-4779-8da5-cabf583363a0 None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:06.229255 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c80a8-3701-4779-8da5-cabf583363a0 None admin] RBAC: Authorizing `identity:get_project(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:06.231024 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c80a8-3701-4779-8da5-cabf583363a0 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:06.233773 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 108/207] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:05 2022] GET /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:06.240678 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c72c9-d3c6-4460-95c5-427827cdf6d2 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:06.366433 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c72c9-d3c6-4460-95c5-427827cdf6d2 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:06.385408 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:06.405098 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f887e-5557-41e4-b120-7f553d3fd245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:06.405782 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f887e-5557-41e4-b120-7f553d3fd245 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:06.412615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f887e-5557-41e4-b120-7f553d3fd245 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:06.412615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f887e-5557-41e4-b120-7f553d3fd245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:06.412615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f887e-5557-41e4-b120-7f553d3fd245 None admin] RBAC: Adding query filter params (role.id=f86a1d8dfb24430a98414eab048c4be9, scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf, user.id=05c43177e9f040d5884daf7b40149a9e) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:06.412615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f887e-5557-41e4-b120-7f553d3fd245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:06.412615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f887e-5557-41e4-b120-7f553d3fd245 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:06.415584 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 100/208] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:06 2022] GET /identity/v3/role_assignments?user.id=05c43177e9f040d5884daf7b40149a9e&scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf&role.id=f86a1d8dfb24430a98414eab048c4be9 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:07.236750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f4ce7-9b54-45dd-b796-1e4f8196ad19 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:07.237262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f4ce7-9b54-45dd-b796-1e4f8196ad19 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:07.237336 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f4ce7-9b54-45dd-b796-1e4f8196ad19 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:07.238677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 109/209] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:07.244395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fed1b4-894e-4696-80c6-ff202fc38eb6 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:07.244924 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fed1b4-894e-4696-80c6-ff202fc38eb6 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:07.244999 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fed1b4-894e-4696-80c6-ff202fc38eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:07.262155 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-29fed1b4-894e-4696-80c6-ff202fc38eb6 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:07.263917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-29fed1b4-894e-4696-80c6-ff202fc38eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:07.330430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 101/210] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:39:07.355127 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f4ce7-9b54-45dd-b796-1e4f8196ad19 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:07.404139 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:07.461356 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f4ce7-9b54-45dd-b796-1e4f8196ad19 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:07.479502 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416a9e1-a31f-493c-9047-2bc592c0195b None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:07.480093 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416a9e1-a31f-493c-9047-2bc592c0195b None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:07.480590 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416a9e1-a31f-493c-9047-2bc592c0195b None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:07.483028 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 102/211] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:07.488189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bdc3f-5bad-4cee-9172-dc3bc6a21c53 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:07.488811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bdc3f-5bad-4cee-9172-dc3bc6a21c53 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:07.489290 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bdc3f-5bad-4cee-9172-dc3bc6a21c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:07.496259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb10fd-b337-468c-af42-b8b5c86a2893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:07.497620 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb10fd-b337-468c-af42-b8b5c86a2893 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:07.497974 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb10fd-b337-468c-af42-b8b5c86a2893 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:07.498255 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb10fd-b337-468c-af42-b8b5c86a2893 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:07.509067 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-281bdc3f-5bad-4cee-9172-dc3bc6a21c53 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:07.509237 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb10fd-b337-468c-af42-b8b5c86a2893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:07.510617 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-281bdc3f-5bad-4cee-9172-dc3bc6a21c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:07.517580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-65eb10fd-b337-468c-af42-b8b5c86a2893 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:07.517580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:07.517580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:07.517580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:07.517580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:07.517580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:07.517580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:07.517580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:07.517580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:07.517580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:07.517580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:07.517580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:07.517580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:07.517580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:07.517580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:07.517580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:07.518432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:07.518432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:07.518432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:07.518432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:07.518432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:07.518432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:07.518432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:07.518432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:07.518432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:07.518432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:07.518432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:07.518432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:07.518432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:07.518432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:07.518432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:07.518432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:07.519189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:07.519189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:07.519189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:07.519189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:07.519189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:07.519189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:07.519189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:07.519189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:07.519189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:07.519189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:07.519189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:07.519189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:07.519189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 110/212] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:07.526164 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb10fd-b337-468c-af42-b8b5c86a2893 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:07.588421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 103/213] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:39:07.617806 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bdc3f-5bad-4cee-9172-dc3bc6a21c53 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:07.665511 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:07.667623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb10fd-b337-468c-af42-b8b5c86a2893 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:07.671376 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:07.715362 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add23d6-a6b3-4d98-9995-103dbf0f6676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:07.717389 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add23d6-a6b3-4d98-9995-103dbf0f6676 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:07.718663 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add23d6-a6b3-4d98-9995-103dbf0f6676 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:07.719158 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add23d6-a6b3-4d98-9995-103dbf0f6676 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:07.720833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add23d6-a6b3-4d98-9995-103dbf0f6676 None admin] RBAC: Adding query filter params (name=member) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:07.721417 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add23d6-a6b3-4d98-9995-103dbf0f6676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:07.723851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add23d6-a6b3-4d98-9995-103dbf0f6676 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:07.733518 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bdc3f-5bad-4cee-9172-dc3bc6a21c53 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:07.738771 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 111/214] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:07.739817 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add23d6-a6b3-4d98-9995-103dbf0f6676 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:07.771643 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a7156-815a-49b5-9187-2cc206a8a306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:07.772805 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a7156-815a-49b5-9187-2cc206a8a306 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:07.773287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a7156-815a-49b5-9187-2cc206a8a306 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:07.773768 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a7156-815a-49b5-9187-2cc206a8a306 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:07.775139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a7156-815a-49b5-9187-2cc206a8a306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:07.776815 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a7156-815a-49b5-9187-2cc206a8a306 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:07.784173 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 104/215] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:07.785275 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a7156-815a-49b5-9187-2cc206a8a306 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:07.846926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add23d6-a6b3-4d98-9995-103dbf0f6676 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:07.882208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c85c73-4062-4558-bf58-5d8aa4513844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:07.883252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c85c73-4062-4558-bf58-5d8aa4513844 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:07.883606 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c85c73-4062-4558-bf58-5d8aa4513844 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:07.883987 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c85c73-4062-4558-bf58-5d8aa4513844 None admin] PATH_INFO: `/v3/users/759437f1a8574797b420066053d55e5a` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:07.899617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c85c73-4062-4558-bf58-5d8aa4513844 None admin] RBAC: Authorizing `identity:get_user(user_id=759437f1a8574797b420066053d55e5a)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:07.901229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c85c73-4062-4558-bf58-5d8aa4513844 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:07.903016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 112/216] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:07 2022] GET /identity/v3/users/759437f1a8574797b420066053d55e5a => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:07.909021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c85c73-4062-4558-bf58-5d8aa4513844 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:07.924571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a7156-815a-49b5-9187-2cc206a8a306 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:07.936030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:07.937718 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:07.962865 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063d8b5-cfa2-43c8-8b53-9f316ba44e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:07.963673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063d8b5-cfa2-43c8-8b53-9f316ba44e67 None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:07.964031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063d8b5-cfa2-43c8-8b53-9f316ba44e67 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:07.964384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063d8b5-cfa2-43c8-8b53-9f316ba44e67 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:07.965367 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063d8b5-cfa2-43c8-8b53-9f316ba44e67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:07.967782 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063d8b5-cfa2-43c8-8b53-9f316ba44e67 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:08.027427 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c85c73-4062-4558-bf58-5d8aa4513844 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:08.066961 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 105/217] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 23 10:39:07 2022] POST /identity/v3/users => generated 297 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:39:08.072855 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4123acf-b133-4948-845c-011c9bf3bc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:08.072855 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4123acf-b133-4948-845c-011c9bf3bc00 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:08.072855 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4123acf-b133-4948-845c-011c9bf3bc00 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:08.072855 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4123acf-b133-4948-845c-011c9bf3bc00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:08.154291 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4123acf-b133-4948-845c-011c9bf3bc00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:08.155807 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4123acf-b133-4948-845c-011c9bf3bc00 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:08.183838 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:08.268196 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac04660-ee7f-4710-b2d3-5156e6a9728f None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:08.268826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac04660-ee7f-4710-b2d3-5156e6a9728f None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:08.268826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac04660-ee7f-4710-b2d3-5156e6a9728f None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:08.270426 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 106/218] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:39:08.274538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 113/219] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 10:39:08.275443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b44a49-f099-4cdb-84ae-ea87ed617128 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:08.275741 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b44a49-f099-4cdb-84ae-ea87ed617128 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:08.276028 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b44a49-f099-4cdb-84ae-ea87ed617128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:08.280133 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4123acf-b133-4948-845c-011c9bf3bc00 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:08.300210 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-88b44a49-f099-4cdb-84ae-ea87ed617128 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:08.301461 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-88b44a49-f099-4cdb-84ae-ea87ed617128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:08.392541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 107/220] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:08.402829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4123acf-b133-4948-845c-011c9bf3bc00 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:08.420212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b44a49-f099-4cdb-84ae-ea87ed617128 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:08.431763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:08.445689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb3164-6cbc-4af9-b958-1f2105435aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:08.447436 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb3164-6cbc-4af9-b958-1f2105435aa3 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:08.447436 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb3164-6cbc-4af9-b958-1f2105435aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:08.447436 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb3164-6cbc-4af9-b958-1f2105435aa3 None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:08.448552 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb3164-6cbc-4af9-b958-1f2105435aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:08.450195 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb3164-6cbc-4af9-b958-1f2105435aa3 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:08.452806 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 114/221] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:08 2022] GET /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:08.458666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb3164-6cbc-4af9-b958-1f2105435aa3 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:08.537166 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:08.546314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b44a49-f099-4cdb-84ae-ea87ed617128 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:08.582715 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c428cfc-0150-4685-b0eb-73d00dc9cb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:08.583527 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428cfc-0150-4685-b0eb-73d00dc9cb9b None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:08.583817 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428cfc-0150-4685-b0eb-73d00dc9cb9b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:08.584101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428cfc-0150-4685-b0eb-73d00dc9cb9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:08.594680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb3164-6cbc-4af9-b958-1f2105435aa3 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:08.596399 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c428cfc-0150-4685-b0eb-73d00dc9cb9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:08.604771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-9c428cfc-0150-4685-b0eb-73d00dc9cb9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:08.604771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:08.604771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:08.604771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:08.604771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:08.604771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:08.604771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:08.604771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:08.604771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:08.604771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:08.604771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:08.604771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:08.604771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:08.604771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:08.604771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:08.604771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:08.612945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:08.612945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:08.612945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:08.612945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:08.612945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:08.612945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:08.612945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:08.612945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:08.612945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:08.612945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:08.612945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:08.612945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:08.612945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:08.612945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:08.612945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:08.612945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:08.614026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:08.614026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:08.614026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:08.614026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:08.614026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:08.614026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:08.614026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:08.614026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:08.614026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:08.614026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:08.614026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:08.614026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:08.614026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 108/222] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:39:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:39:08.614026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30eb533-cd17-4263-bfdf-889757b0b280 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:08.614873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30eb533-cd17-4263-bfdf-889757b0b280 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:08.614873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30eb533-cd17-4263-bfdf-889757b0b280 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:08.614873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 109/223] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:08.614873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30eb533-cd17-4263-bfdf-889757b0b280 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:08.644986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b01b0-7efb-4af0-bfc1-e5fce5cd30c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:08.645936 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b01b0-7efb-4af0-bfc1-e5fce5cd30c9 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:08.646484 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b01b0-7efb-4af0-bfc1-e5fce5cd30c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:08.647091 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b01b0-7efb-4af0-bfc1-e5fce5cd30c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:08.648669 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b01b0-7efb-4af0-bfc1-e5fce5cd30c9 None admin] RBAC: Adding query filter params (role.id=14edb03a6a644798bdbf762bb59f6ef9, scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf, user.id=759437f1a8574797b420066053d55e5a) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:08.649051 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b01b0-7efb-4af0-bfc1-e5fce5cd30c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:08.650745 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b01b0-7efb-4af0-bfc1-e5fce5cd30c9 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:08.658412 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 115/224] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:08 2022] GET /identity/v3/role_assignments?user.id=759437f1a8574797b420066053d55e5a&scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf&role.id=14edb03a6a644798bdbf762bb59f6ef9 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:08.659770 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dff9e-d884-4944-93d0-073bad0ea11a None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:08.660066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dff9e-d884-4944-93d0-073bad0ea11a None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:08.660352 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dff9e-d884-4944-93d0-073bad0ea11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:08.680590 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-962dff9e-d884-4944-93d0-073bad0ea11a None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:08.681847 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-962dff9e-d884-4944-93d0-073bad0ea11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:08.771498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30eb533-cd17-4263-bfdf-889757b0b280 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:08.796730 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:08.834660 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760af8d1-9df4-4382-867f-d92b068bd947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:08.835355 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760af8d1-9df4-4382-867f-d92b068bd947 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:08.835636 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760af8d1-9df4-4382-867f-d92b068bd947 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:08.835909 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760af8d1-9df4-4382-867f-d92b068bd947 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:08.836706 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760af8d1-9df4-4382-867f-d92b068bd947 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:08.837020 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760af8d1-9df4-4382-867f-d92b068bd947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:08.838481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760af8d1-9df4-4382-867f-d92b068bd947 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:08.840918 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 116/225] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:08.851994 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 110/226] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:08.858384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dff9e-d884-4944-93d0-073bad0ea11a None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:08.878404 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760af8d1-9df4-4382-867f-d92b068bd947 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:08.899924 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:09.029712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760af8d1-9df4-4382-867f-d92b068bd947 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:09.066829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dff9e-d884-4944-93d0-073bad0ea11a None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:09.092678 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b2a66-376d-419d-9c8b-ab97c8fd54e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:09.093358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b2a66-376d-419d-9c8b-ab97c8fd54e9 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:09.093643 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b2a66-376d-419d-9c8b-ab97c8fd54e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:09.093919 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b2a66-376d-419d-9c8b-ab97c8fd54e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:09.114509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b2a66-376d-419d-9c8b-ab97c8fd54e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:09.130092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-a14b2a66-376d-419d-9c8b-ab97c8fd54e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:09.130092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:09.130092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:09.130092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:09.130092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:09.130092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:09.130092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:09.130092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:09.130092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:09.130092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:09.130092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:09.130092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:09.130092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:09.130092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:09.130092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:09.130092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:09.130998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:09.130998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:09.130998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:09.130998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:09.130998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:09.130998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:09.130998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:09.130998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:09.130998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:09.130998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:09.130998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:09.130998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:09.130998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:09.130998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:09.130998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:09.130998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:09.131772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:09.131772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:09.131772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:09.131772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:09.131772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:09.131772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:09.131772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:09.131772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:09.131772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:09.131772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:09.131772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:09.131772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:09.132942 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 111/227] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:39:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:39:09.138956 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b2a66-376d-419d-9c8b-ab97c8fd54e9 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:09.139946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f636fb-6c5e-462e-8f42-24f85f833961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:09.140875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f636fb-6c5e-462e-8f42-24f85f833961 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:09.141155 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f636fb-6c5e-462e-8f42-24f85f833961 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:09.141431 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f636fb-6c5e-462e-8f42-24f85f833961 None admin] PATH_INFO: `/v3/users/05c43177e9f040d5884daf7b40149a9e` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:09.142937 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f636fb-6c5e-462e-8f42-24f85f833961 None admin] RBAC: Authorizing `identity:get_user(user_id=05c43177e9f040d5884daf7b40149a9e)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:09.144378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f636fb-6c5e-462e-8f42-24f85f833961 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:09.149112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 117/228] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:08 2022] GET /identity/v3/users/05c43177e9f040d5884daf7b40149a9e => generated 283 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:09.157623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f636fb-6c5e-462e-8f42-24f85f833961 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:09.240992 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:09.291353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:09.319635 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f636fb-6c5e-462e-8f42-24f85f833961 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:09.328550 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b2a66-376d-419d-9c8b-ab97c8fd54e9 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:09.382953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85c4b3-69ba-44ef-8012-587925cc357a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:09.383831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85c4b3-69ba-44ef-8012-587925cc357a None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:09.384122 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85c4b3-69ba-44ef-8012-587925cc357a None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:09.384403 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85c4b3-69ba-44ef-8012-587925cc357a None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:09.385638 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85c4b3-69ba-44ef-8012-587925cc357a None admin] RBAC: Authorizing `identity:get_project(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:09.387240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85c4b3-69ba-44ef-8012-587925cc357a None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:09.389880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 118/229] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:09 2022] GET /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:09.394834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c15ab7-cdb8-4ad8-ac0b-1b1a379c6d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:09.395413 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85c4b3-69ba-44ef-8012-587925cc357a None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:09.395521 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c15ab7-cdb8-4ad8-ac0b-1b1a379c6d44 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:09.395798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c15ab7-cdb8-4ad8-ac0b-1b1a379c6d44 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:09.396084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c15ab7-cdb8-4ad8-ac0b-1b1a379c6d44 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:09.396877 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c15ab7-cdb8-4ad8-ac0b-1b1a379c6d44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:09.397193 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c15ab7-cdb8-4ad8-ac0b-1b1a379c6d44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:09.398596 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c15ab7-cdb8-4ad8-ac0b-1b1a379c6d44 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:09.419610 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 112/230] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:09.421664 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c15ab7-cdb8-4ad8-ac0b-1b1a379c6d44 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:09.582678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85c4b3-69ba-44ef-8012-587925cc357a None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:09.618448 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c15ab7-cdb8-4ad8-ac0b-1b1a379c6d44 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:09.627348 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:09.647044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439b394-a9ac-4479-8a0b-9ccf1987cfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:09.647937 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439b394-a9ac-4479-8a0b-9ccf1987cfc5 None admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:09.648216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439b394-a9ac-4479-8a0b-9ccf1987cfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:09.648492 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439b394-a9ac-4479-8a0b-9ccf1987cfc5 None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf/users/05c43177e9f040d5884daf7b40149a9e/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:09.661496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439b394-a9ac-4479-8a0b-9ccf1987cfc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf, user_id=05c43177e9f040d5884daf7b40149a9e, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:09.663275 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439b394-a9ac-4479-8a0b-9ccf1987cfc5 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:09.672266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66b37d-1aac-453d-bb47-becfc0c8d7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:09.686083 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66b37d-1aac-453d-bb47-becfc0c8d7a8 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:09.686083 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66b37d-1aac-453d-bb47-becfc0c8d7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:09.686083 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66b37d-1aac-453d-bb47-becfc0c8d7a8 None admin] PATH_INFO: `/v3/users/05c43177e9f040d5884daf7b40149a9e` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:09.686083 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66b37d-1aac-453d-bb47-becfc0c8d7a8 None admin] RBAC: Authorizing `identity:get_user(user_id=05c43177e9f040d5884daf7b40149a9e)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:09.686083 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66b37d-1aac-453d-bb47-becfc0c8d7a8 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:09.686083 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 113/231] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:09 2022] GET /identity/v3/users/05c43177e9f040d5884daf7b40149a9e => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:09.686510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66b37d-1aac-453d-bb47-becfc0c8d7a8 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:09.699469 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:09.794390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66b37d-1aac-453d-bb47-becfc0c8d7a8 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:09.797172 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 119/232] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:39:09 2022] PUT /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf/users/05c43177e9f040d5884daf7b40149a9e/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:39:09.836372 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e1fbc-3f6d-4ffa-9f8f-0a3dfdf150d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:09.837262 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e1fbc-3f6d-4ffa-9f8f-0a3dfdf150d5 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:09.837546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e1fbc-3f6d-4ffa-9f8f-0a3dfdf150d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:09.837827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e1fbc-3f6d-4ffa-9f8f-0a3dfdf150d5 None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:09.841479 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e1fbc-3f6d-4ffa-9f8f-0a3dfdf150d5 None admin] RBAC: Authorizing `identity:get_project(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:09.843143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e1fbc-3f6d-4ffa-9f8f-0a3dfdf150d5 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:09.845317 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 114/233] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:09 2022] GET /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:09.850866 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439b394-a9ac-4479-8a0b-9ccf1987cfc5 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:09.988030 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439b394-a9ac-4479-8a0b-9ccf1987cfc5 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:10.037311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c366e4a-4862-4945-bedc-1ad22895ea0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:10.038588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c366e4a-4862-4945-bedc-1ad22895ea0f None admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:10.039154 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c366e4a-4862-4945-bedc-1ad22895ea0f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:10.039635 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c366e4a-4862-4945-bedc-1ad22895ea0f None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf/users/05c43177e9f040d5884daf7b40149a9e/roles/f86a1d8dfb24430a98414eab048c4be9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:10.042303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c366e4a-4862-4945-bedc-1ad22895ea0f None admin] RBAC: Authorizing `identity:create_grant(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf, user_id=05c43177e9f040d5884daf7b40149a9e, role_id=f86a1d8dfb24430a98414eab048c4be9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:10.044712 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c366e4a-4862-4945-bedc-1ad22895ea0f None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:10.151703 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 120/234] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:39:09 2022] PUT /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf/users/05c43177e9f040d5884daf7b40149a9e/roles/f86a1d8dfb24430a98414eab048c4be9 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:39:10.600689 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264807d-f0dc-42bf-865a-12f371ea7815 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:10.601195 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264807d-f0dc-42bf-865a-12f371ea7815 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:10.601418 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264807d-f0dc-42bf-865a-12f371ea7815 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:10.602980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 115/235] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:10.622808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bcc3c-e5be-418b-9647-9c04d0a26311 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:10.625376 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bcc3c-e5be-418b-9647-9c04d0a26311 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:10.625376 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bcc3c-e5be-418b-9647-9c04d0a26311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:10.650528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-989bcc3c-e5be-418b-9647-9c04d0a26311 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:10.651736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-989bcc3c-e5be-418b-9647-9c04d0a26311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:10.701546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be555cfb-ef64-42c4-bd12-20adf215acaa None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:10.702174 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be555cfb-ef64-42c4-bd12-20adf215acaa None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:10.702446 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:10.702856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be555cfb-ef64-42c4-bd12-20adf215acaa None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:10.708486 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 116/236] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:39:10.710019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeaf1d-cf98-42a0-91d2-0a9dfd44da9d None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:10.710503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeaf1d-cf98-42a0-91d2-0a9dfd44da9d None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:10.710972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeaf1d-cf98-42a0-91d2-0a9dfd44da9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:10.729435 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-a5aeaf1d-cf98-42a0-91d2-0a9dfd44da9d None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:10.731067 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a5aeaf1d-cf98-42a0-91d2-0a9dfd44da9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:10.764663 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 121/237] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:10.806777 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bcc3c-e5be-418b-9647-9c04d0a26311 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:10.838507 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 117/238] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:10.909746 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeaf1d-cf98-42a0-91d2-0a9dfd44da9d None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:10.912810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:10.973944 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bcc3c-e5be-418b-9647-9c04d0a26311 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:11.016274 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb2d09-fa18-48c3-b237-b51e0063c5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:11.017160 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb2d09-fa18-48c3-b237-b51e0063c5e2 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:11.017444 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb2d09-fa18-48c3-b237-b51e0063c5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:11.017722 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb2d09-fa18-48c3-b237-b51e0063c5e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:11.028663 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb2d09-fa18-48c3-b237-b51e0063c5e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:11.036377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-50eb2d09-fa18-48c3-b237-b51e0063c5e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:39:11.036377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:11.036377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:11.036377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:11.036377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:11.036377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:11.036377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:11.036377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:11.036377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:11.036377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:11.036377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:11.036377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:11.036377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:11.036377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:11.036377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:11.036377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:11.037315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:11.037315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:11.037315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:11.037315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:11.037315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:11.037315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:11.037315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:11.037315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:11.037315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:11.037315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:11.037315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:11.037315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:11.037315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:11.037315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:11.037315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:11.037315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:11.038906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:11.038906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:11.038906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:11.038906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:11.038906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:11.038906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:11.038906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:11.038906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:11.038906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:11.038906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:11.038906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:39:11.038906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:11.038906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 122/239] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:39:11.043433 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb2d09-fa18-48c3-b237-b51e0063c5e2 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:11.078458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:11.088501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeaf1d-cf98-42a0-91d2-0a9dfd44da9d None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:11.134437 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c35e3-79ab-475e-a31a-cc2fb62454b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:11.135638 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c35e3-79ab-475e-a31a-cc2fb62454b8 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:11.136130 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c35e3-79ab-475e-a31a-cc2fb62454b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:11.136629 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c35e3-79ab-475e-a31a-cc2fb62454b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:11.139050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c35e3-79ab-475e-a31a-cc2fb62454b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:11.141252 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c35e3-79ab-475e-a31a-cc2fb62454b8 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:11.144151 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 118/240] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:11.146411 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5fd49-5aa3-476f-b105-c1d16a398a74 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:11.146918 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5fd49-5aa3-476f-b105-c1d16a398a74 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:11.147438 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5fd49-5aa3-476f-b105-c1d16a398a74 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:11.149424 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 119/241] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:11.150327 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5fd49-5aa3-476f-b105-c1d16a398a74 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:11.172197 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb2d09-fa18-48c3-b237-b51e0063c5e2 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:11.221639 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32076122-ea70-47e9-91a9-499b3adec4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:11.222907 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32076122-ea70-47e9-91a9-499b3adec4dc None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:11.223755 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32076122-ea70-47e9-91a9-499b3adec4dc None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:11.224513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32076122-ea70-47e9-91a9-499b3adec4dc None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:11.225730 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32076122-ea70-47e9-91a9-499b3adec4dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:11.226604 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32076122-ea70-47e9-91a9-499b3adec4dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:11.228730 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32076122-ea70-47e9-91a9-499b3adec4dc None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:11.237968 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:11.240675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 123/242] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:11.242271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc35e70-27dc-4656-a4fb-c71ae1d2f66f None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:11.242669 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc35e70-27dc-4656-a4fb-c71ae1d2f66f None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:11.243059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc35e70-27dc-4656-a4fb-c71ae1d2f66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:11.265833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-4dc35e70-27dc-4656-a4fb-c71ae1d2f66f None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:11.267751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-4dc35e70-27dc-4656-a4fb-c71ae1d2f66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:11.274357 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5fd49-5aa3-476f-b105-c1d16a398a74 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:11.311087 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f91848-dce2-409b-91a5-9424a2a9a8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:11.312103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f91848-dce2-409b-91a5-9424a2a9a8e9 None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:11.312539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f91848-dce2-409b-91a5-9424a2a9a8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:11.313092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f91848-dce2-409b-91a5-9424a2a9a8e9 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:11.314014 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f91848-dce2-409b-91a5-9424a2a9a8e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:11.315668 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f91848-dce2-409b-91a5-9424a2a9a8e9 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:11.347812 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 124/243] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:11.348996 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc35e70-27dc-4656-a4fb-c71ae1d2f66f None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:11.379450 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:11.398017 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 120/244] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 23 10:39:11 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:39:11.400681 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f91848-dce2-409b-91a5-9424a2a9a8e9 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:11.529612 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc35e70-27dc-4656-a4fb-c71ae1d2f66f None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:11.584723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f91848-dce2-409b-91a5-9424a2a9a8e9 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:11.607599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e1fc9-e1cf-4909-9230-57e63e27841e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:11.608068 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e1fc9-e1cf-4909-9230-57e63e27841e None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:11.608352 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e1fc9-e1cf-4909-9230-57e63e27841e None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:11.611682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e1fc9-e1cf-4909-9230-57e63e27841e None admin] PATH_INFO: `/v3/users/b3141b9697714e498df7241f86236781` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:11.648995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:11.651811 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e1fc9-e1cf-4909-9230-57e63e27841e None admin] RBAC: Authorizing `identity:get_user(user_id=b3141b9697714e498df7241f86236781)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:11.653941 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e1fc9-e1cf-4909-9230-57e63e27841e None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:11.657362 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 125/245] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:11 2022] GET /identity/v3/users/b3141b9697714e498df7241f86236781 => generated 297 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:11.661569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea14d0-edc3-4ad9-9078-a2282471873a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:11.662637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea14d0-edc3-4ad9-9078-a2282471873a None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:11.662809 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e1fc9-e1cf-4909-9230-57e63e27841e None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:11.663339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea14d0-edc3-4ad9-9078-a2282471873a None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:11.663782 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea14d0-edc3-4ad9-9078-a2282471873a None admin] PATH_INFO: `/v3/roles/member` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:11.677713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea14d0-edc3-4ad9-9078-a2282471873a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:11.688088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-43ea14d0-edc3-4ad9-9078-a2282471873a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:11.688088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:11.688088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:11.688088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:11.688088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:11.688088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:11.688088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:11.688088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:11.688088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:11.688088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:11.688088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:11.688088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:11.688088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:11.688088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:11.688088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:11.688088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:11.689042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:11.689042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:11.689042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:11.689042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:11.689042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:11.689042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:11.689042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:11.689042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:11.689042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:11.689042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:11.689042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:11.689042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:11.689042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:11.689042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:11.689042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:11.689042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:11.689837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:11.689837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:11.689837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:11.689837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:11.689837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:11.689837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:11.689837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:11.689837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:11.689837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:11.689837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:11.689837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:11.689837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:11.692662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 121/246] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:11.699507 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea14d0-edc3-4ad9-9078-a2282471873a None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:11.771334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:11.796394 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e1fc9-e1cf-4909-9230-57e63e27841e None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:11.841607 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea14d0-edc3-4ad9-9078-a2282471873a None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:11.843530 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e5210-3be1-43da-9c10-e17b14ca8e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:11.845285 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e5210-3be1-43da-9c10-e17b14ca8e55 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:11.845574 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e5210-3be1-43da-9c10-e17b14ca8e55 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:11.845859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e5210-3be1-43da-9c10-e17b14ca8e55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:11.890879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dac0b-3e2b-4143-874a-927b31a7b6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:11.891561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dac0b-3e2b-4143-874a-927b31a7b6c3 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:11.891893 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dac0b-3e2b-4143-874a-927b31a7b6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:11.892126 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dac0b-3e2b-4143-874a-927b31a7b6c3 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:11.894662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312dac0b-3e2b-4143-874a-927b31a7b6c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:11.894987 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312dac0b-3e2b-4143-874a-927b31a7b6c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:11.896406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312dac0b-3e2b-4143-874a-927b31a7b6c3 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:11.907792 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 122/247] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:11.918519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dac0b-3e2b-4143-874a-927b31a7b6c3 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:11.948015 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e5210-3be1-43da-9c10-e17b14ca8e55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:11.949841 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e5210-3be1-43da-9c10-e17b14ca8e55 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:11.985526 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:12.049774 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:12.059384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dac0b-3e2b-4143-874a-927b31a7b6c3 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:12.073408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 126/248] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:12.079763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e5210-3be1-43da-9c10-e17b14ca8e55 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:12.109535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7ea13-80ae-4093-ba12-5346c21adbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:12.111069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7ea13-80ae-4093-ba12-5346c21adbad None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:12.111636 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7ea13-80ae-4093-ba12-5346c21adbad None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:12.112104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7ea13-80ae-4093-ba12-5346c21adbad None admin] PATH_INFO: `/v3/users/759437f1a8574797b420066053d55e5a` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:12.113582 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7ea13-80ae-4093-ba12-5346c21adbad None admin] RBAC: Authorizing `identity:get_user(user_id=759437f1a8574797b420066053d55e5a)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:12.115777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7ea13-80ae-4093-ba12-5346c21adbad None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:12.118343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 123/249] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:11 2022] GET /identity/v3/users/759437f1a8574797b420066053d55e5a => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:12.124293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7ea13-80ae-4093-ba12-5346c21adbad None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:12.235050 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e5210-3be1-43da-9c10-e17b14ca8e55 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:12.257040 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7ea13-80ae-4093-ba12-5346c21adbad None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:12.276787 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:12.298806 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea372e-7d00-45e5-b8e6-1fceeccf1a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:12.300115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea372e-7d00-45e5-b8e6-1fceeccf1a45 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:12.300547 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea372e-7d00-45e5-b8e6-1fceeccf1a45 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:12.301013 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea372e-7d00-45e5-b8e6-1fceeccf1a45 None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:12.303010 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea372e-7d00-45e5-b8e6-1fceeccf1a45 None admin] RBAC: Authorizing `identity:get_project(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:12.304811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea372e-7d00-45e5-b8e6-1fceeccf1a45 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:12.306836 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 124/250] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:12 2022] GET /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:12.308198 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb57588-c639-4817-85a6-689794821f43 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:12.308668 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb57588-c639-4817-85a6-689794821f43 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:12.309092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb57588-c639-4817-85a6-689794821f43 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:12.313856 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c541dc2-a2b6-4d64-b7f7-052e15622ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:12.313856 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c541dc2-a2b6-4d64-b7f7-052e15622ccf None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:12.313856 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c541dc2-a2b6-4d64-b7f7-052e15622ccf None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:12.313856 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c541dc2-a2b6-4d64-b7f7-052e15622ccf None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:12.314204 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c541dc2-a2b6-4d64-b7f7-052e15622ccf None admin] RBAC: Authorizing `identity:get_project(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:12.315562 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 125/251] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:12.316438 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb57588-c639-4817-85a6-689794821f43 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:12.318303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c541dc2-a2b6-4d64-b7f7-052e15622ccf None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:12.321249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 127/252] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:12 2022] GET /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:12.329789 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06fcdd-01b5-4be0-93a4-461fac891c77 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:12.330151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06fcdd-01b5-4be0-93a4-461fac891c77 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:12.330509 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06fcdd-01b5-4be0-93a4-461fac891c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:12.357297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-9a06fcdd-01b5-4be0-93a4-461fac891c77 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:12.358777 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9a06fcdd-01b5-4be0-93a4-461fac891c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:12.431190 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb57588-c639-4817-85a6-689794821f43 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:12.456305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:12.468810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26f3a4-0e66-45f7-a3a7-7e873574911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:12.470019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26f3a4-0e66-45f7-a3a7-7e873574911e None admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:12.470498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26f3a4-0e66-45f7-a3a7-7e873574911e None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:12.471863 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26f3a4-0e66-45f7-a3a7-7e873574911e None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf/users/759437f1a8574797b420066053d55e5a/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:12.473318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26f3a4-0e66-45f7-a3a7-7e873574911e None admin] RBAC: Authorizing `identity:create_grant(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf, user_id=759437f1a8574797b420066053d55e5a, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:12.474952 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26f3a4-0e66-45f7-a3a7-7e873574911e None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:12.494004 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 128/253] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:12.495559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06fcdd-01b5-4be0-93a4-461fac891c77 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:12.551595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 126/254] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:39:12 2022] PUT /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf/users/759437f1a8574797b420066053d55e5a/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:39:12.552779 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26f3a4-0e66-45f7-a3a7-7e873574911e None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:12.659718 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06fcdd-01b5-4be0-93a4-461fac891c77 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:12.665435 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:12.734287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5b6a9-d6ee-4178-bfa8-a8232e3be1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:12.735349 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5b6a9-d6ee-4178-bfa8-a8232e3be1a5 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:12.735842 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5b6a9-d6ee-4178-bfa8-a8232e3be1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:12.736423 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5b6a9-d6ee-4178-bfa8-a8232e3be1a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:12.737525 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5b6a9-d6ee-4178-bfa8-a8232e3be1a5 None admin] RBAC: Adding query filter params (role.id=4b240816f7ab46a8b8674d54c63a9f03, scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf, user.id=b3141b9697714e498df7241f86236781) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:12.738087 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5b6a9-d6ee-4178-bfa8-a8232e3be1a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:12.739814 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5b6a9-d6ee-4178-bfa8-a8232e3be1a5 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:12.753782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 129/255] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:12 2022] GET /identity/v3/role_assignments?user.id=b3141b9697714e498df7241f86236781&scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf&role.id=4b240816f7ab46a8b8674d54c63a9f03 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:12.755470 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3739d47-d873-4c1b-8152-66838d1df88a None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:12.755967 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3739d47-d873-4c1b-8152-66838d1df88a None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:12.756475 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3739d47-d873-4c1b-8152-66838d1df88a None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:12.758075 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 130/256] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:12.765428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26f3a4-0e66-45f7-a3a7-7e873574911e None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:12.794273 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc714091-8f53-4a58-b6af-d52f45d92df6 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:12.794897 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc714091-8f53-4a58-b6af-d52f45d92df6 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:12.795403 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc714091-8f53-4a58-b6af-d52f45d92df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:12.816685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3229e8-bd97-4bc8-bccf-71910bf44a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:12.817411 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3229e8-bd97-4bc8-bccf-71910bf44a1c None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:12.818457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3229e8-bd97-4bc8-bccf-71910bf44a1c None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:12.818754 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3229e8-bd97-4bc8-bccf-71910bf44a1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:12.827075 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-cc714091-8f53-4a58-b6af-d52f45d92df6 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:12.829418 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-cc714091-8f53-4a58-b6af-d52f45d92df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:12.831991 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3229e8-bd97-4bc8-bccf-71910bf44a1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:12.843308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-9a3229e8-bd97-4bc8-bccf-71910bf44a1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:12.843308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:12.843308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:12.843308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:12.843308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:12.843308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:12.843308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:12.843308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:12.843308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:12.843308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:12.843308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:12.843308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:12.843308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:12.843308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:12.843308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:12.843308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:12.844272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:12.844272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:12.844272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:12.844272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:12.844272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:12.844272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:12.844272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:12.844272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:12.844272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:12.844272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:12.844272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:12.844272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:12.844272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:12.844272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:12.844272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:12.844272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:12.845063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:12.845063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:12.845063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:12.845063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:12.845063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:12.845063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:12.845063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:12.845063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:12.845063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:12.845063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:12.845063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:12.845063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:12.845689 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 127/257] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:39:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:12.851129 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3229e8-bd97-4bc8-bccf-71910bf44a1c None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:12.889915 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:12.922461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 131/258] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:12.993365 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc714091-8f53-4a58-b6af-d52f45d92df6 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:13.039656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3229e8-bd97-4bc8-bccf-71910bf44a1c None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:13.050207 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:13.093529 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494ede0-c337-4887-ab67-ce5e2300feb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:13.094144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494ede0-c337-4887-ab67-ce5e2300feb1 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:13.094436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494ede0-c337-4887-ab67-ce5e2300feb1 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:13.094718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494ede0-c337-4887-ab67-ce5e2300feb1 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:13.095490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494ede0-c337-4887-ab67-ce5e2300feb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:13.095803 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494ede0-c337-4887-ab67-ce5e2300feb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:13.097238 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494ede0-c337-4887-ab67-ce5e2300feb1 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:13.115875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 128/259] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:13.121053 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494ede0-c337-4887-ab67-ce5e2300feb1 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:13.154082 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc714091-8f53-4a58-b6af-d52f45d92df6 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:13.227179 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fde69-fd4a-4710-a5e6-d2fb94d78228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:13.227179 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fde69-fd4a-4710-a5e6-d2fb94d78228 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:13.227179 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fde69-fd4a-4710-a5e6-d2fb94d78228 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:13.227179 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fde69-fd4a-4710-a5e6-d2fb94d78228 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:13.242930 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fde69-fd4a-4710-a5e6-d2fb94d78228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:13.259271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-cd6fde69-fd4a-4710-a5e6-d2fb94d78228 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:13.259271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:13.259271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:13.259271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:13.259271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:13.259271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:13.259271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:13.259271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:13.259271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:13.259271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:13.259271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:13.259271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:13.259271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:13.259271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:13.259271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:13.259271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:13.260168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:13.260168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:13.260168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:13.260168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:13.260168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:13.260168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:13.260168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:13.260168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:13.260168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:13.260168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:13.260168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:13.260168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:13.260168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:13.260168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:13.260168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:13.260168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:13.260984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:13.260984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:13.260984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:13.260984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:13.260984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:13.260984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:13.260984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:13.260984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:13.260984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:13.260984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:13.260984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:13.260984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:13.260984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 132/260] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:39:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:39:13.268083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fde69-fd4a-4710-a5e6-d2fb94d78228 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:13.315371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494ede0-c337-4887-ab67-ce5e2300feb1 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:13.333986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:13.413295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e643e-df64-4036-badb-b3b409379e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:13.414394 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e643e-df64-4036-badb-b3b409379e23 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:13.414853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e643e-df64-4036-badb-b3b409379e23 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:13.415234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e643e-df64-4036-badb-b3b409379e23 None admin] PATH_INFO: `/v3/users/05c43177e9f040d5884daf7b40149a9e` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:13.417372 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e643e-df64-4036-badb-b3b409379e23 None admin] RBAC: Authorizing `identity:get_user(user_id=05c43177e9f040d5884daf7b40149a9e)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:13.419101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e643e-df64-4036-badb-b3b409379e23 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:13.421433 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 129/261] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:13 2022] GET /identity/v3/users/05c43177e9f040d5884daf7b40149a9e => generated 283 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:13.429595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e643e-df64-4036-badb-b3b409379e23 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:13.430873 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fde69-fd4a-4710-a5e6-d2fb94d78228 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:13.479326 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d97fd9-eb32-4cfe-9843-27a8a93eee08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:13.480003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d97fd9-eb32-4cfe-9843-27a8a93eee08 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:13.480289 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d97fd9-eb32-4cfe-9843-27a8a93eee08 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:13.480567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d97fd9-eb32-4cfe-9843-27a8a93eee08 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:13.481390 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d97fd9-eb32-4cfe-9843-27a8a93eee08 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:13.482323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d97fd9-eb32-4cfe-9843-27a8a93eee08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:13.483706 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d97fd9-eb32-4cfe-9843-27a8a93eee08 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:13.496313 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 133/262] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:13.503138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d97fd9-eb32-4cfe-9843-27a8a93eee08 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:13.516597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:13.668740 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d97fd9-eb32-4cfe-9843-27a8a93eee08 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:13.678293 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:13.689799 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e643e-df64-4036-badb-b3b409379e23 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:13.735685 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5466231-db5c-4d5f-ae94-4cb44be1f596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:13.737039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5466231-db5c-4d5f-ae94-4cb44be1f596 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:13.737532 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5466231-db5c-4d5f-ae94-4cb44be1f596 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:13.738165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5466231-db5c-4d5f-ae94-4cb44be1f596 None admin] PATH_INFO: `/v3/users/05c43177e9f040d5884daf7b40149a9e` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:13.745421 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5466231-db5c-4d5f-ae94-4cb44be1f596 None admin] RBAC: Authorizing `identity:get_user(user_id=05c43177e9f040d5884daf7b40149a9e)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:13.747310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5466231-db5c-4d5f-ae94-4cb44be1f596 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:13.749332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 134/263] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:13 2022] GET /identity/v3/users/05c43177e9f040d5884daf7b40149a9e => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:13.754979 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcb92b-e27c-485b-82dc-45e9300cee69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:13.755526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5466231-db5c-4d5f-ae94-4cb44be1f596 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:13.755701 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcb92b-e27c-485b-82dc-45e9300cee69 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:13.755987 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcb92b-e27c-485b-82dc-45e9300cee69 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:13.756269 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcb92b-e27c-485b-82dc-45e9300cee69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:13.863287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcb92b-e27c-485b-82dc-45e9300cee69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:13.864934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcb92b-e27c-485b-82dc-45e9300cee69 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:13.933114 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:13.996526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5466231-db5c-4d5f-ae94-4cb44be1f596 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:14.058352 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fe08b-e85e-42c1-889f-479abab34e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:14.059367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fe08b-e85e-42c1-889f-479abab34e30 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:14.059988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fe08b-e85e-42c1-889f-479abab34e30 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:14.060471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fe08b-e85e-42c1-889f-479abab34e30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:14.061827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 130/264] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:14.066934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcb92b-e27c-485b-82dc-45e9300cee69 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:14.116602 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:14.185981 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fe08b-e85e-42c1-889f-479abab34e30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:14.187973 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fe08b-e85e-42c1-889f-479abab34e30 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:14.301108 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcb92b-e27c-485b-82dc-45e9300cee69 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:14.359948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e43ac1-4588-4068-aad6-efe8f8fd4280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:14.360844 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e43ac1-4588-4068-aad6-efe8f8fd4280 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:14.361128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e43ac1-4588-4068-aad6-efe8f8fd4280 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:14.361403 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e43ac1-4588-4068-aad6-efe8f8fd4280 None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:14.364372 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e43ac1-4588-4068-aad6-efe8f8fd4280 None admin] RBAC: Authorizing `identity:get_project(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:14.365674 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e43ac1-4588-4068-aad6-efe8f8fd4280 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:14.367701 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 131/265] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:14 2022] GET /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:14.373592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e43ac1-4588-4068-aad6-efe8f8fd4280 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:14.379913 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:14.417493 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 135/266] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:14.423471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fe08b-e85e-42c1-889f-479abab34e30 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:14.485503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e43ac1-4588-4068-aad6-efe8f8fd4280 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:14.521433 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e861824-a772-43a9-a144-08669a9654fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:14.522096 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e861824-a772-43a9-a144-08669a9654fd None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:14.522387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e861824-a772-43a9-a144-08669a9654fd None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:14.522667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e861824-a772-43a9-a144-08669a9654fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:14.523564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e861824-a772-43a9-a144-08669a9654fd None admin] RBAC: Adding query filter params (role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf, user.id=05c43177e9f040d5884daf7b40149a9e) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:14.523882 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e861824-a772-43a9-a144-08669a9654fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:14.525468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e861824-a772-43a9-a144-08669a9654fd None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:14.535040 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 132/267] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:14 2022] GET /identity/v3/role_assignments?user.id=05c43177e9f040d5884daf7b40149a9e&scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:14.570178 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:14.582976 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fe08b-e85e-42c1-889f-479abab34e30 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:14.637586 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d260ff-0527-47d5-9d76-1dc4d9ae7fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:14.639561 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d260ff-0527-47d5-9d76-1dc4d9ae7fea None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:14.639789 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d260ff-0527-47d5-9d76-1dc4d9ae7fea None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:14.640073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d260ff-0527-47d5-9d76-1dc4d9ae7fea None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:14.641561 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d260ff-0527-47d5-9d76-1dc4d9ae7fea None admin] RBAC: Authorizing `identity:get_project(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:14.643071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d260ff-0527-47d5-9d76-1dc4d9ae7fea None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:14.645161 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 136/268] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:14 2022] GET /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:14.651609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e861824-a772-43a9-a144-08669a9654fd None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:14.745826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:14.781704 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e861824-a772-43a9-a144-08669a9654fd None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:14.818122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9291ebc-a177-42b4-a84c-e954238423b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:14.818791 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9291ebc-a177-42b4-a84c-e954238423b1 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:14.819076 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9291ebc-a177-42b4-a84c-e954238423b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:14.819352 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9291ebc-a177-42b4-a84c-e954238423b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:14.820192 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9291ebc-a177-42b4-a84c-e954238423b1 None admin] RBAC: Adding query filter params (role.id=f86a1d8dfb24430a98414eab048c4be9, scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf, user.id=05c43177e9f040d5884daf7b40149a9e) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:14.820509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9291ebc-a177-42b4-a84c-e954238423b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:14.821994 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9291ebc-a177-42b4-a84c-e954238423b1 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:14.828615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 133/269] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:14 2022] GET /identity/v3/role_assignments?user.id=05c43177e9f040d5884daf7b40149a9e&scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf&role.id=f86a1d8dfb24430a98414eab048c4be9 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:14.964964 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05466cb2-8096-4018-b522-a42e0ff9f25f None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:14.967004 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05466cb2-8096-4018-b522-a42e0ff9f25f None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:14.967004 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05466cb2-8096-4018-b522-a42e0ff9f25f None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:14.970868 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe68585-432f-47a8-bdb8-b6224b365b88 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:14.970868 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe68585-432f-47a8-bdb8-b6224b365b88 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:14.970868 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe68585-432f-47a8-bdb8-b6224b365b88 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:14.970868 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 134/270] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:39:14.971944 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 137/271] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:14.976978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4936ff-e650-4862-90ab-54ddd164d022 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:14.976978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4936ff-e650-4862-90ab-54ddd164d022 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:14.980675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdd9c1-6648-4b82-9a2e-0daec5920707 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:14.980675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdd9c1-6648-4b82-9a2e-0daec5920707 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:14.980675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdd9c1-6648-4b82-9a2e-0daec5920707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:14.981347 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4936ff-e650-4862-90ab-54ddd164d022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:15.020416 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-ac4936ff-e650-4862-90ab-54ddd164d022 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:15.021610 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ac4936ff-e650-4862-90ab-54ddd164d022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:15.024690 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-f2fdd9c1-6648-4b82-9a2e-0daec5920707 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:15.025876 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-f2fdd9c1-6648-4b82-9a2e-0daec5920707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:15.120818 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 135/272] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:15.134600 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 138/273] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:15.149211 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4936ff-e650-4862-90ab-54ddd164d022 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:15.159966 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdd9c1-6648-4b82-9a2e-0daec5920707 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:15.238316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:15.244485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:15.292567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdd9c1-6648-4b82-9a2e-0daec5920707 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:15.302159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4936ff-e650-4862-90ab-54ddd164d022 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:15.345136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe8fde-8bd5-4559-b6fb-cc53e888ba70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:15.345956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe8fde-8bd5-4559-b6fb-cc53e888ba70 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:15.346240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe8fde-8bd5-4559-b6fb-cc53e888ba70 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:15.346520 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe8fde-8bd5-4559-b6fb-cc53e888ba70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:15.351832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e077daf-a060-48ca-967b-e28de0bd9c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:15.352910 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e077daf-a060-48ca-967b-e28de0bd9c19 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:15.353596 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e077daf-a060-48ca-967b-e28de0bd9c19 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:15.354076 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e077daf-a060-48ca-967b-e28de0bd9c19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:15.355670 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e077daf-a060-48ca-967b-e28de0bd9c19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:15.357492 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e077daf-a060-48ca-967b-e28de0bd9c19 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:15.358147 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe8fde-8bd5-4559-b6fb-cc53e888ba70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:15.359897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 136/274] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:15.365429 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e077daf-a060-48ca-967b-e28de0bd9c19 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:15.366115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-9cbe8fde-8bd5-4559-b6fb-cc53e888ba70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:15.366115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:15.366115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:15.366115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:15.366115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:15.366115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:15.366115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:15.366115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:15.366115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:15.366115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:15.366115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:15.366115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:15.366115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:15.366115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:15.366115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:15.366115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:15.367016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:15.367016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:15.367016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:15.367016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:15.367016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:15.367016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:15.367016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:15.367016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:15.367016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:15.367016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:15.367016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:15.367016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:15.367016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:15.367016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:15.367016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:15.367016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:15.367972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:15.367972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:15.367972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:15.367972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:15.367972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:15.367972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:15.367972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:15.367972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:15.367972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:15.367972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:15.367972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:15.367972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:15.367972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 139/275] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:15.373165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe8fde-8bd5-4559-b6fb-cc53e888ba70 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:15.478821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe8fde-8bd5-4559-b6fb-cc53e888ba70 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:15.480014 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e077daf-a060-48ca-967b-e28de0bd9c19 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:15.503376 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:15.515672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:15.516731 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98197a7f-8a9b-46f8-bea4-1d9ce6617bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:15.517498 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98197a7f-8a9b-46f8-bea4-1d9ce6617bc5 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:15.517787 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98197a7f-8a9b-46f8-bea4-1d9ce6617bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:15.518065 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98197a7f-8a9b-46f8-bea4-1d9ce6617bc5 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:15.518823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98197a7f-8a9b-46f8-bea4-1d9ce6617bc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:15.519143 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98197a7f-8a9b-46f8-bea4-1d9ce6617bc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:15.520534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98197a7f-8a9b-46f8-bea4-1d9ce6617bc5 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:15.523120 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c5091-7992-4aaf-9726-3153d2ee990e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:15.523962 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c5091-7992-4aaf-9726-3153d2ee990e None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:15.524391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c5091-7992-4aaf-9726-3153d2ee990e None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:15.524843 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c5091-7992-4aaf-9726-3153d2ee990e None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:15.525723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c5091-7992-4aaf-9726-3153d2ee990e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:15.527402 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c5091-7992-4aaf-9726-3153d2ee990e None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:15.530182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 140/276] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:15.535947 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98197a7f-8a9b-46f8-bea4-1d9ce6617bc5 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:15.639456 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98197a7f-8a9b-46f8-bea4-1d9ce6617bc5 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:15.644286 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 137/277] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 23 10:39:15 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:39:15.645878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67675c0c-32a3-4084-bb15-bf18af2746fe None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:15.646340 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67675c0c-32a3-4084-bb15-bf18af2746fe None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:15.646785 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67675c0c-32a3-4084-bb15-bf18af2746fe None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:15.648304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 138/278] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:15.659380 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316e6ae-715d-47ce-b891-905fa963eda2 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:15.659678 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316e6ae-715d-47ce-b891-905fa963eda2 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:15.659988 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316e6ae-715d-47ce-b891-905fa963eda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:15.678362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-7316e6ae-715d-47ce-b891-905fa963eda2 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:15.679703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-7316e6ae-715d-47ce-b891-905fa963eda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:15.690536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af61663-1c6a-4258-a3c5-e77cafc6c1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:15.691930 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af61663-1c6a-4258-a3c5-e77cafc6c1e0 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:15.692411 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af61663-1c6a-4258-a3c5-e77cafc6c1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:15.692946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af61663-1c6a-4258-a3c5-e77cafc6c1e0 None admin] PATH_INFO: `/v3/users/1c766e84fa4d485b9786e3a9831e9f65` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:15.710423 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af61663-1c6a-4258-a3c5-e77cafc6c1e0 None admin] RBAC: Authorizing `identity:get_user(user_id=1c766e84fa4d485b9786e3a9831e9f65)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:15.712447 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af61663-1c6a-4258-a3c5-e77cafc6c1e0 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:15.719542 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 141/279] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:15 2022] GET /identity/v3/users/1c766e84fa4d485b9786e3a9831e9f65 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:15.721084 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af61663-1c6a-4258-a3c5-e77cafc6c1e0 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:15.759982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 139/280] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:15.761481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36241e08-d3c4-4c44-90d7-56d0acbc4fe3 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:15.761842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36241e08-d3c4-4c44-90d7-56d0acbc4fe3 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:15.762195 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36241e08-d3c4-4c44-90d7-56d0acbc4fe3 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:15.764343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 140/281] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:15.769853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf09593-9c6a-43fd-bfd0-2b525b622ed6 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:15.770283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf09593-9c6a-43fd-bfd0-2b525b622ed6 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:15.770689 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf09593-9c6a-43fd-bfd0-2b525b622ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:15.786923 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:15.792689 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-1cf09593-9c6a-43fd-bfd0-2b525b622ed6 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:15.794379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-1cf09593-9c6a-43fd-bfd0-2b525b622ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:15.841541 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af61663-1c6a-4258-a3c5-e77cafc6c1e0 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:15.870367 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 141/282] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:39:15.871193 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf09593-9c6a-43fd-bfd0-2b525b622ed6 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:15.883891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d370c-446b-406c-90df-0653831a7297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:15.884557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d370c-446b-406c-90df-0653831a7297 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:15.884921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d370c-446b-406c-90df-0653831a7297 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:15.885200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d370c-446b-406c-90df-0653831a7297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:15.886039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d370c-446b-406c-90df-0653831a7297 None admin] RBAC: Adding query filter params (role.id=14edb03a6a644798bdbf762bb59f6ef9, user.id=1c766e84fa4d485b9786e3a9831e9f65, scope.system=all) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:15.886354 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d370c-446b-406c-90df-0653831a7297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:15.888530 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d370c-446b-406c-90df-0653831a7297 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:15.894347 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 142/283] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Jun 23 10:39:15 2022] GET /identity/v3/role_assignments?user.id=1c766e84fa4d485b9786e3a9831e9f65&scope.system=all&role.id=14edb03a6a644798bdbf762bb59f6ef9 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:15.897813 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d370c-446b-406c-90df-0653831a7297 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:15.930125 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:16.018559 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf09593-9c6a-43fd-bfd0-2b525b622ed6 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:16.050468 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d370c-446b-406c-90df-0653831a7297 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:16.066501 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:16.079750 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6134-1a5f-4f0a-b25e-fccd1657d0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:16.080560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6134-1a5f-4f0a-b25e-fccd1657d0ec None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:16.081277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6134-1a5f-4f0a-b25e-fccd1657d0ec None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:16.081647 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6134-1a5f-4f0a-b25e-fccd1657d0ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:16.096906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1696c71-073f-4316-a326-2c28a770ba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:16.097752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1696c71-073f-4316-a326-2c28a770ba6a None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:16.098394 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1696c71-073f-4316-a326-2c28a770ba6a None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:16.098989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1696c71-073f-4316-a326-2c28a770ba6a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:16.100227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac6134-1a5f-4f0a-b25e-fccd1657d0ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:16.109223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-b5ac6134-1a5f-4f0a-b25e-fccd1657d0ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:16.109223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:16.109223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:16.109223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:16.109223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:16.109223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:16.109223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:16.109223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:16.109223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:16.109223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:16.109223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:16.109223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:16.109223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:16.109223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:16.109223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:16.109223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:16.110156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:16.110156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:16.110156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:16.110156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:16.110156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:16.110156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:16.110156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:16.110156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:16.110156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:16.110156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:16.110156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:16.110156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:16.110156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:16.110156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:16.110156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:16.110156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:16.110946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:16.110946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:16.110946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:16.110946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:16.110946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:16.110946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:16.110946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:16.110946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:16.110946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:16.110946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:16.110946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:16.110946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:16.111536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1696c71-073f-4316-a326-2c28a770ba6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:16.113493 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 142/284] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:16.121278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-d1696c71-073f-4316-a326-2c28a770ba6a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:39:16.121278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:16.121278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:16.121278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:16.121278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:16.121278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:16.121278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:16.121278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:16.121278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:16.121278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:16.121278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:16.121278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:16.121278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:16.121278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:16.121278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:16.121278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:16.122301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:16.122301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:16.122301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:16.122301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:16.122301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:16.122301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:16.122301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:16.122301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:16.122301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:16.122301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:16.122301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:16.122301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:16.122301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:16.122301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:16.122301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:16.122301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:16.123510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:16.123510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:16.123510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:16.123510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:16.123510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:16.123510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:16.123510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:16.123510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:16.123510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:16.123510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:16.123510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:39:16.123510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:16.123510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 143/285] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:16.124168 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6134-1a5f-4f0a-b25e-fccd1657d0ec None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:16.132660 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1696c71-073f-4316-a326-2c28a770ba6a None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:16.268499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1696c71-073f-4316-a326-2c28a770ba6a None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:16.310718 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54730ca7-8660-4dbb-8821-b535a2fb14d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:16.311395 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54730ca7-8660-4dbb-8821-b535a2fb14d4 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:16.311677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54730ca7-8660-4dbb-8821-b535a2fb14d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:16.311959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54730ca7-8660-4dbb-8821-b535a2fb14d4 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:16.312737 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54730ca7-8660-4dbb-8821-b535a2fb14d4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:16.313051 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54730ca7-8660-4dbb-8821-b535a2fb14d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:16.314425 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54730ca7-8660-4dbb-8821-b535a2fb14d4 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:16.334977 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 144/286] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:16.337496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6134-1a5f-4f0a-b25e-fccd1657d0ec None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:16.339854 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54730ca7-8660-4dbb-8821-b535a2fb14d4 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:16.354694 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:16.381091 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:16.423551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e8ee2-060d-4c8e-b92d-349e6a35255a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:16.424620 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e8ee2-060d-4c8e-b92d-349e6a35255a None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:16.425145 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e8ee2-060d-4c8e-b92d-349e6a35255a None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:16.425626 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e8ee2-060d-4c8e-b92d-349e6a35255a None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:16.426591 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e8ee2-060d-4c8e-b92d-349e6a35255a None admin] RBAC: Adding query filter params (name=member) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:16.427105 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e8ee2-060d-4c8e-b92d-349e6a35255a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:16.428883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e8ee2-060d-4c8e-b92d-349e6a35255a None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:16.447610 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 143/287] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:16.453730 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e8ee2-060d-4c8e-b92d-349e6a35255a None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:16.456016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54730ca7-8660-4dbb-8821-b535a2fb14d4 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:16.494765 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0876267-3e8a-4cae-8c66-f11f6bc07c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:16.495649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0876267-3e8a-4cae-8c66-f11f6bc07c83 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:16.495930 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0876267-3e8a-4cae-8c66-f11f6bc07c83 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:16.496206 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0876267-3e8a-4cae-8c66-f11f6bc07c83 None admin] PATH_INFO: `/v3/users/b3141b9697714e498df7241f86236781` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:16.498442 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0876267-3e8a-4cae-8c66-f11f6bc07c83 None admin] RBAC: Authorizing `identity:get_user(user_id=b3141b9697714e498df7241f86236781)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:16.500310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0876267-3e8a-4cae-8c66-f11f6bc07c83 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:16.502733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 145/288] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:16 2022] GET /identity/v3/users/b3141b9697714e498df7241f86236781 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:16.508358 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0876267-3e8a-4cae-8c66-f11f6bc07c83 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:16.581295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e8ee2-060d-4c8e-b92d-349e6a35255a None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:16.624907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd80b6f-12da-4a89-8245-57cbea8b038f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:16.625825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd80b6f-12da-4a89-8245-57cbea8b038f None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:16.626120 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd80b6f-12da-4a89-8245-57cbea8b038f None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:16.626408 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd80b6f-12da-4a89-8245-57cbea8b038f None admin] PATH_INFO: `/v3/users/759437f1a8574797b420066053d55e5a` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:16.627646 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd80b6f-12da-4a89-8245-57cbea8b038f None admin] RBAC: Authorizing `identity:get_user(user_id=759437f1a8574797b420066053d55e5a)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:16.629569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd80b6f-12da-4a89-8245-57cbea8b038f None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:16.631732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 144/289] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:16 2022] GET /identity/v3/users/759437f1a8574797b420066053d55e5a => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:16.636648 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd80b6f-12da-4a89-8245-57cbea8b038f None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:16.695614 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:16.708800 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0876267-3e8a-4cae-8c66-f11f6bc07c83 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:16.712990 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:16.749296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7aad43-e4ef-448b-aea2-15ae28ba541d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:16.750221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7aad43-e4ef-448b-aea2-15ae28ba541d None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:16.750515 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7aad43-e4ef-448b-aea2-15ae28ba541d None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:16.750795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7aad43-e4ef-448b-aea2-15ae28ba541d None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:16.752525 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7aad43-e4ef-448b-aea2-15ae28ba541d None admin] RBAC: Authorizing `identity:get_project(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:16.754532 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7aad43-e4ef-448b-aea2-15ae28ba541d None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:16.756712 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 146/290] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:16 2022] GET /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:16.764960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7aad43-e4ef-448b-aea2-15ae28ba541d None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:16.848253 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd80b6f-12da-4a89-8245-57cbea8b038f None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:16.919620 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7aad43-e4ef-448b-aea2-15ae28ba541d None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:16.922522 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b320e-bbd5-401b-9651-0e8b37577f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:16.923184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b320e-bbd5-401b-9651-0e8b37577f38 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:16.923470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b320e-bbd5-401b-9651-0e8b37577f38 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:16.923751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b320e-bbd5-401b-9651-0e8b37577f38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:16.990124 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dc82c-9522-4e6a-a5ce-8fddbf65dd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:16.991295 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dc82c-9522-4e6a-a5ce-8fddbf65dd63 None admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:16.991728 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dc82c-9522-4e6a-a5ce-8fddbf65dd63 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:16.992151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dc82c-9522-4e6a-a5ce-8fddbf65dd63 None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf/users/b3141b9697714e498df7241f86236781/roles/4b240816f7ab46a8b8674d54c63a9f03` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:16.996996 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dc82c-9522-4e6a-a5ce-8fddbf65dd63 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf, user_id=b3141b9697714e498df7241f86236781, role_id=4b240816f7ab46a8b8674d54c63a9f03)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:16.999479 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dc82c-9522-4e6a-a5ce-8fddbf65dd63 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:17.028662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b320e-bbd5-401b-9651-0e8b37577f38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:17.030525 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b320e-bbd5-401b-9651-0e8b37577f38 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:17.067936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:17.083354 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 147/291] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:39:16 2022] PUT /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf/users/b3141b9697714e498df7241f86236781/roles/4b240816f7ab46a8b8674d54c63a9f03 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:39:17.153139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 145/292] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:17.160704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dc82c-9522-4e6a-a5ce-8fddbf65dd63 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:17.200872 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:17.283283 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dc82c-9522-4e6a-a5ce-8fddbf65dd63 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:17.328196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806898c2-6c0e-4743-bb61-eaea0d001564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:17.329381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806898c2-6c0e-4743-bb61-eaea0d001564 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:17.329841 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806898c2-6c0e-4743-bb61-eaea0d001564 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:17.330266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806898c2-6c0e-4743-bb61-eaea0d001564 None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:17.331661 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806898c2-6c0e-4743-bb61-eaea0d001564 None admin] RBAC: Authorizing `identity:get_project(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:17.333323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806898c2-6c0e-4743-bb61-eaea0d001564 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:17.335697 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 148/293] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:17 2022] GET /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:17.341721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b320e-bbd5-401b-9651-0e8b37577f38 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:17.471733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b320e-bbd5-401b-9651-0e8b37577f38 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:17.520768 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463400a-ff0d-4972-a54a-f655de285371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:17.521675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463400a-ff0d-4972-a54a-f655de285371 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:17.522112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463400a-ff0d-4972-a54a-f655de285371 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:17.522566 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463400a-ff0d-4972-a54a-f655de285371 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:17.523542 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463400a-ff0d-4972-a54a-f655de285371 None admin] RBAC: Adding query filter params (role.id=14edb03a6a644798bdbf762bb59f6ef9, scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf, user.id=759437f1a8574797b420066053d55e5a) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:17.524005 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463400a-ff0d-4972-a54a-f655de285371 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:17.525617 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463400a-ff0d-4972-a54a-f655de285371 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:17.530160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:17.534194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 146/294] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:17 2022] GET /identity/v3/role_assignments?user.id=759437f1a8574797b420066053d55e5a&scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf&role.id=14edb03a6a644798bdbf762bb59f6ef9 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:18.123571 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e662e6e-b830-481d-a64b-7b73fac9b927 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:18.124618 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e662e6e-b830-481d-a64b-7b73fac9b927 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:18.125140 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e662e6e-b830-481d-a64b-7b73fac9b927 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:18.127035 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 149/295] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:18.133223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9f6ca-0e1e-47c2-9a33-b76395ba8b43 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:18.134043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9f6ca-0e1e-47c2-9a33-b76395ba8b43 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:18.134525 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9f6ca-0e1e-47c2-9a33-b76395ba8b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:18.152769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-a1a9f6ca-0e1e-47c2-9a33-b76395ba8b43 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:18.154631 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a1a9f6ca-0e1e-47c2-9a33-b76395ba8b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:18.236942 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 147/296] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:39:18.260744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e662e6e-b830-481d-a64b-7b73fac9b927 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:18.356401 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:18.366236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e662e6e-b830-481d-a64b-7b73fac9b927 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:18.383972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47192f44-abce-4a35-99f9-3bba8acfb9ab None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:18.383972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47192f44-abce-4a35-99f9-3bba8acfb9ab None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:18.383972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47192f44-abce-4a35-99f9-3bba8acfb9ab None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:18.383972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 148/297] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:18.384746 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522febb-993f-4c6f-9b4b-aaafac7ff49e None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:18.385041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522febb-993f-4c6f-9b4b-aaafac7ff49e None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:18.385326 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522febb-993f-4c6f-9b4b-aaafac7ff49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:18.403092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-5522febb-993f-4c6f-9b4b-aaafac7ff49e None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:18.404561 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d244588-9828-4b53-aaa2-8b416cf3d7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:18.405161 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-5522febb-993f-4c6f-9b4b-aaafac7ff49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:18.405828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d244588-9828-4b53-aaa2-8b416cf3d7b0 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:18.406301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d244588-9828-4b53-aaa2-8b416cf3d7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:18.406837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d244588-9828-4b53-aaa2-8b416cf3d7b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:18.421219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d244588-9828-4b53-aaa2-8b416cf3d7b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:18.429058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-0d244588-9828-4b53-aaa2-8b416cf3d7b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:39:18.429058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:18.429058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:18.429058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:18.429058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:18.429058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:18.429058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:18.429058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:18.429058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:18.429058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:18.429058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:18.429058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:18.429058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:18.429058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:18.429058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:18.429058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:18.429927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:18.429927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:18.429927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:18.429927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:18.429927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:18.429927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:18.429927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:18.429927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:18.429927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:18.429927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:18.429927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:18.429927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:18.429927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:18.429927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:18.429927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:18.429927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:18.435875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:18.435875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:18.435875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:18.435875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:18.435875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:18.435875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:18.435875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:18.435875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:18.435875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:18.435875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:18.435875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:39:18.435875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:18.435875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 150/298] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:18.438548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d244588-9828-4b53-aaa2-8b416cf3d7b0 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:18.503799 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 149/299] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:39:18.505003 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d82866-6621-4efe-a46e-c99016e15cae None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:18.505294 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d82866-6621-4efe-a46e-c99016e15cae None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:18.505574 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d82866-6621-4efe-a46e-c99016e15cae None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:18.506984 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 150/300] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:18.514257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bc2f9-7d9f-40f5-91a4-8138552d5b98 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:18.514655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bc2f9-7d9f-40f5-91a4-8138552d5b98 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:18.515035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bc2f9-7d9f-40f5-91a4-8138552d5b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:18.534606 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-467bc2f9-7d9f-40f5-91a4-8138552d5b98 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:18.535813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-467bc2f9-7d9f-40f5-91a4-8138552d5b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:18.555972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d244588-9828-4b53-aaa2-8b416cf3d7b0 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:18.590839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be45dca-bb82-49e0-b439-7d7885ab834e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:18.591516 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be45dca-bb82-49e0-b439-7d7885ab834e None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:18.591796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be45dca-bb82-49e0-b439-7d7885ab834e None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:18.592071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be45dca-bb82-49e0-b439-7d7885ab834e None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:18.592853 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be45dca-bb82-49e0-b439-7d7885ab834e None admin] RBAC: Adding query filter params (name=reader) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:18.593162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be45dca-bb82-49e0-b439-7d7885ab834e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:18.594544 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be45dca-bb82-49e0-b439-7d7885ab834e None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:18.595239 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:18.603040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 151/301] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:18.607807 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be45dca-bb82-49e0-b439-7d7885ab834e None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:18.628656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 151/302] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:18.628656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bc2f9-7d9f-40f5-91a4-8138552d5b98 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:18.632865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:18.722367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be45dca-bb82-49e0-b439-7d7885ab834e None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:18.725050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bc2f9-7d9f-40f5-91a4-8138552d5b98 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:18.755679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367f3f3-3b63-41c5-865e-1b992d345e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:18.756477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367f3f3-3b63-41c5-865e-1b992d345e0c None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:18.756794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367f3f3-3b63-41c5-865e-1b992d345e0c None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:18.757076 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367f3f3-3b63-41c5-865e-1b992d345e0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:18.758223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367f3f3-3b63-41c5-865e-1b992d345e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:18.759657 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367f3f3-3b63-41c5-865e-1b992d345e0c None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:18.759796 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6617fa6-dc11-4dd1-ad52-04dbcf62f7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:18.760824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6617fa6-dc11-4dd1-ad52-04dbcf62f7b3 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:18.761261 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6617fa6-dc11-4dd1-ad52-04dbcf62f7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:18.761360 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 152/303] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:18.761735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6617fa6-dc11-4dd1-ad52-04dbcf62f7b3 None admin] PATH_INFO: `/v3/users/3907a248b9374a4dbba8d2a1794a7565` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:18.762053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367f3f3-3b63-41c5-865e-1b992d345e0c None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:18.779795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6617fa6-dc11-4dd1-ad52-04dbcf62f7b3 None admin] RBAC: Authorizing `identity:get_user(user_id=3907a248b9374a4dbba8d2a1794a7565)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:18.781559 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6617fa6-dc11-4dd1-ad52-04dbcf62f7b3 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:18.783393 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 152/304] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:18 2022] GET /identity/v3/users/3907a248b9374a4dbba8d2a1794a7565 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:18.784153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6617fa6-dc11-4dd1-ad52-04dbcf62f7b3 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:18.836568 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:18.853784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:18.876958 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367f3f3-3b63-41c5-865e-1b992d345e0c None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:18.890765 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6617fa6-dc11-4dd1-ad52-04dbcf62f7b3 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:18.914608 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f854bd-6d7f-43a6-a9e5-15e9aba4c290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:18.915410 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f854bd-6d7f-43a6-a9e5-15e9aba4c290 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:18.915691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f854bd-6d7f-43a6-a9e5-15e9aba4c290 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:18.916037 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f854bd-6d7f-43a6-a9e5-15e9aba4c290 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:18.926458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f854bd-6d7f-43a6-a9e5-15e9aba4c290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:18.926688 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5dd43-b58c-4b54-9f73-110cf20362df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:18.927281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5dd43-b58c-4b54-9f73-110cf20362df None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:18.927562 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5dd43-b58c-4b54-9f73-110cf20362df None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:18.927836 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5dd43-b58c-4b54-9f73-110cf20362df None admin] PATH_INFO: `/v3/groups` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:18.928525 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5dd43-b58c-4b54-9f73-110cf20362df None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:18.929972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5dd43-b58c-4b54-9f73-110cf20362df None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:18.934243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-23f854bd-6d7f-43a6-a9e5-15e9aba4c290 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:18.934243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:18.934243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:18.934243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:18.934243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:18.934243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:18.934243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:18.934243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:18.934243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:18.934243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:18.934243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:18.934243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:18.934243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:18.934243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:18.934243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:18.934243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:18.935678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:18.935678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:18.935678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:18.935678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:18.935678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:18.935678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:18.935678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:18.935678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:18.935678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:18.935678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:18.935678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:18.935678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:18.935678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:18.935678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:18.935678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:18.935678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:18.936528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:18.936528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:18.936528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:18.936528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:18.936528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:18.936528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:18.936528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:18.936528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:18.936528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:18.936528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:18.936528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:18.936528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:18.936528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 153/305] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:18.937670 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f854bd-6d7f-43a6-a9e5-15e9aba4c290 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:19.004773 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 153/306] 10.222.0.20 () {60 vars in 1134 bytes} [Thu Jun 23 10:39:18 2022] POST /identity/v3/groups => generated 229 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:39:19.004773 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5dd43-b58c-4b54-9f73-110cf20362df None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:19.082010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f854bd-6d7f-43a6-a9e5-15e9aba4c290 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:19.132632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fa04e-9dff-4270-94db-459bd1725837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:19.133767 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fa04e-9dff-4270-94db-459bd1725837 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:19.134330 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fa04e-9dff-4270-94db-459bd1725837 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:19.134613 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fa04e-9dff-4270-94db-459bd1725837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:19.135469 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fa04e-9dff-4270-94db-459bd1725837 None admin] RBAC: Adding query filter params (role.id=4b240816f7ab46a8b8674d54c63a9f03, user.id=3907a248b9374a4dbba8d2a1794a7565, scope.system=all) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:19.135787 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fa04e-9dff-4270-94db-459bd1725837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:19.136378 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5dd43-b58c-4b54-9f73-110cf20362df None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:19.137360 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fa04e-9dff-4270-94db-459bd1725837 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:19.146043 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 154/307] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Jun 23 10:39:18 2022] GET /identity/v3/role_assignments?user.id=3907a248b9374a4dbba8d2a1794a7565&scope.system=all&role.id=4b240816f7ab46a8b8674d54c63a9f03 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:19.155750 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:19.188624 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59287bce-82e0-4677-abc1-b0db2897bcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:19.189378 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287bce-82e0-4677-abc1-b0db2897bcb4 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:19.189664 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287bce-82e0-4677-abc1-b0db2897bcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:19.189945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287bce-82e0-4677-abc1-b0db2897bcb4 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:19.190715 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59287bce-82e0-4677-abc1-b0db2897bcb4 None admin] RBAC: Adding query filter params (name=member) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:19.191027 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59287bce-82e0-4677-abc1-b0db2897bcb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:19.192519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59287bce-82e0-4677-abc1-b0db2897bcb4 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:19.205802 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 154/308] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:19.211238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fa04e-9dff-4270-94db-459bd1725837 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:19.225952 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:19.328977 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fa04e-9dff-4270-94db-459bd1725837 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:19.365041 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ac88b-226b-455f-b559-5573d1e986bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:19.366351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ac88b-226b-455f-b559-5573d1e986bd None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:19.366837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ac88b-226b-455f-b559-5573d1e986bd None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:19.367315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ac88b-226b-455f-b559-5573d1e986bd None admin] PATH_INFO: `/v3/users/1c766e84fa4d485b9786e3a9831e9f65` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:19.368734 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ac88b-226b-455f-b559-5573d1e986bd None admin] RBAC: Authorizing `identity:get_user(user_id=1c766e84fa4d485b9786e3a9831e9f65)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:19.370455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ac88b-226b-455f-b559-5573d1e986bd None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:19.373188 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 155/309] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:19 2022] GET /identity/v3/users/1c766e84fa4d485b9786e3a9831e9f65 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:19.380756 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59287bce-82e0-4677-abc1-b0db2897bcb4 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:19.433782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bd3c5-2da2-4588-9c59-f01ee0423ee7 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:19.434100 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bd3c5-2da2-4588-9c59-f01ee0423ee7 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:19.434356 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bd3c5-2da2-4588-9c59-f01ee0423ee7 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:19.436551 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 156/310] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:19.441544 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0e324-9ec6-4942-8e24-be501398ab56 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:19.441839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0e324-9ec6-4942-8e24-be501398ab56 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:19.442121 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0e324-9ec6-4942-8e24-be501398ab56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:19.459543 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-66a0e324-9ec6-4942-8e24-be501398ab56 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:19.460772 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-66a0e324-9ec6-4942-8e24-be501398ab56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:19.501630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59287bce-82e0-4677-abc1-b0db2897bcb4 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:19.536024 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 157/311] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:39:19.549428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e0611-269e-47b3-ba46-6c3ffb677c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:19.550580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e0611-269e-47b3-ba46-6c3ffb677c12 None admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:19.551088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e0611-269e-47b3-ba46-6c3ffb677c12 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:19.551564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e0611-269e-47b3-ba46-6c3ffb677c12 None admin] PATH_INFO: `/v3/system/users/1c766e84fa4d485b9786e3a9831e9f65/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:19.553341 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e0611-269e-47b3-ba46-6c3ffb677c12 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1c766e84fa4d485b9786e3a9831e9f65, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:19.555048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e0611-269e-47b3-ba46-6c3ffb677c12 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:19.559911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0e324-9ec6-4942-8e24-be501398ab56 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:19.563976 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:19.660652 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 155/312] 10.222.0.20 () {58 vars in 1334 bytes} [Thu Jun 23 10:39:19 2022] PUT /identity/v3/system/users/1c766e84fa4d485b9786e3a9831e9f65/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:39:19.668695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0e324-9ec6-4942-8e24-be501398ab56 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:19.709691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5226486-4f20-4440-8956-d7fc7cdb45c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:19.710796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5226486-4f20-4440-8956-d7fc7cdb45c4 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:19.711239 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5226486-4f20-4440-8956-d7fc7cdb45c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:19.711656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5226486-4f20-4440-8956-d7fc7cdb45c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:19.726259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5226486-4f20-4440-8956-d7fc7cdb45c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:19.735628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-a5226486-4f20-4440-8956-d7fc7cdb45c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:39:19.735628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:19.735628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:19.735628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:19.735628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:19.735628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:19.735628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:19.735628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:19.735628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:19.735628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:19.735628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:19.735628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:19.735628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:19.735628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:19.735628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:19.735628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:19.736784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:19.736784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:19.736784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:19.736784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:19.736784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:19.736784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:19.736784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:19.736784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:19.736784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:19.736784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:19.736784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:19.736784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:19.736784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:19.736784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:19.736784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:19.736784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:19.737761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:19.737761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:19.737761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:19.737761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:19.737761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:19.737761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:19.737761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:19.737761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:19.737761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:19.737761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:19.737761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:39:19.737761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:19.740245 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 158/313] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:39:19.752132 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e0611-269e-47b3-ba46-6c3ffb677c12 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:19.807452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:19.866432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e0611-269e-47b3-ba46-6c3ffb677c12 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:19.903231 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd1174-bd07-4393-860a-1661826bef13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:19.904684 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd1174-bd07-4393-860a-1661826bef13 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:19.904976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd1174-bd07-4393-860a-1661826bef13 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:19.905251 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd1174-bd07-4393-860a-1661826bef13 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:19.906062 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd1174-bd07-4393-860a-1661826bef13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:19.906373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd1174-bd07-4393-860a-1661826bef13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:19.907931 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd1174-bd07-4393-860a-1661826bef13 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:19.916917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 156/314] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:19.922303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5226486-4f20-4440-8956-d7fc7cdb45c4 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:19.986023 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:20.025660 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5226486-4f20-4440-8956-d7fc7cdb45c4 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:20.064769 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03af52-fdff-475a-b54a-a4d8ac66faaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:20.066012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03af52-fdff-475a-b54a-a4d8ac66faaf None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:20.066492 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03af52-fdff-475a-b54a-a4d8ac66faaf None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:20.066959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03af52-fdff-475a-b54a-a4d8ac66faaf None admin] PATH_INFO: `/v3/users/b3141b9697714e498df7241f86236781` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:20.068355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03af52-fdff-475a-b54a-a4d8ac66faaf None admin] RBAC: Authorizing `identity:get_user(user_id=b3141b9697714e498df7241f86236781)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:20.070036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03af52-fdff-475a-b54a-a4d8ac66faaf None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:20.072212 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 159/315] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:19 2022] GET /identity/v3/users/b3141b9697714e498df7241f86236781 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:20.077585 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd1174-bd07-4393-860a-1661826bef13 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:20.182389 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:20.188955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd1174-bd07-4393-860a-1661826bef13 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:20.225219 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7a1b9-dd9b-4892-8357-455f7ed3be31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:20.225909 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7a1b9-dd9b-4892-8357-455f7ed3be31 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:20.226201 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7a1b9-dd9b-4892-8357-455f7ed3be31 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:20.226489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7a1b9-dd9b-4892-8357-455f7ed3be31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:20.300059 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7a1b9-dd9b-4892-8357-455f7ed3be31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:20.301676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7a1b9-dd9b-4892-8357-455f7ed3be31 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:20.401421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:20.408294 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 157/316] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:20.417728 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03af52-fdff-475a-b54a-a4d8ac66faaf None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:20.522257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03af52-fdff-475a-b54a-a4d8ac66faaf None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:20.551724 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:20.556751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771be6a-6864-42e2-8c33-98e7db4d5536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:20.557615 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771be6a-6864-42e2-8c33-98e7db4d5536 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:20.557898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771be6a-6864-42e2-8c33-98e7db4d5536 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:20.558175 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771be6a-6864-42e2-8c33-98e7db4d5536 None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:20.559377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771be6a-6864-42e2-8c33-98e7db4d5536 None admin] RBAC: Authorizing `identity:get_project(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:20.569305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771be6a-6864-42e2-8c33-98e7db4d5536 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:20.569305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 160/317] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:20 2022] GET /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:20.569468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7a1b9-dd9b-4892-8357-455f7ed3be31 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:20.683426 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7a1b9-dd9b-4892-8357-455f7ed3be31 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:20.719237 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24618e87-8b3f-4881-9350-f8bf7358053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:20.719912 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24618e87-8b3f-4881-9350-f8bf7358053c None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:20.720199 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24618e87-8b3f-4881-9350-f8bf7358053c None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:20.720478 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24618e87-8b3f-4881-9350-f8bf7358053c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:20.721349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24618e87-8b3f-4881-9350-f8bf7358053c None admin] RBAC: Adding query filter params (role.id=4b240816f7ab46a8b8674d54c63a9f03, scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf, user.id=b3141b9697714e498df7241f86236781) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:20.721665 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24618e87-8b3f-4881-9350-f8bf7358053c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:20.723130 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24618e87-8b3f-4881-9350-f8bf7358053c None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:20.729338 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 158/318] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:20 2022] GET /identity/v3/role_assignments?user.id=b3141b9697714e498df7241f86236781&scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf&role.id=4b240816f7ab46a8b8674d54c63a9f03 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:21.171406 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32c994-d646-4451-89bd-07de4737e97a None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:21.171821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32c994-d646-4451-89bd-07de4737e97a None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:21.171947 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32c994-d646-4451-89bd-07de4737e97a None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:21.173505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 161/319] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:21.178453 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f870f7b-abef-4103-8c29-101348159bd0 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:21.178749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f870f7b-abef-4103-8c29-101348159bd0 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:21.179027 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f870f7b-abef-4103-8c29-101348159bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:21.196867 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-4f870f7b-abef-4103-8c29-101348159bd0 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:21.198082 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4f870f7b-abef-4103-8c29-101348159bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:21.257883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:21.269108 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 159/320] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:21.291783 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32c994-d646-4451-89bd-07de4737e97a None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:21.301948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ba4ed-08f6-48c8-ad71-2f09c6b34d20 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:21.302246 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ba4ed-08f6-48c8-ad71-2f09c6b34d20 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:21.302588 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ba4ed-08f6-48c8-ad71-2f09c6b34d20 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:21.304379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 160/321] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:39:21.310309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c3d64-d87b-4b4c-828c-802d33b051b0 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:21.310597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c3d64-d87b-4b4c-828c-802d33b051b0 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:21.310877 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c3d64-d87b-4b4c-828c-802d33b051b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:21.328148 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-fc3c3d64-d87b-4b4c-828c-802d33b051b0 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:21.329397 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-fc3c3d64-d87b-4b4c-828c-802d33b051b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:21.402527 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 161/322] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:21.414813 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32c994-d646-4451-89bd-07de4737e97a None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:21.425610 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c3d64-d87b-4b4c-828c-802d33b051b0 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:21.452445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd896af2-c51d-4c13-aa0f-6689f7642912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:21.453278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd896af2-c51d-4c13-aa0f-6689f7642912 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:21.453567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd896af2-c51d-4c13-aa0f-6689f7642912 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:21.453843 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd896af2-c51d-4c13-aa0f-6689f7642912 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:21.455016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd896af2-c51d-4c13-aa0f-6689f7642912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:21.456465 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd896af2-c51d-4c13-aa0f-6689f7642912 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:21.458378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 162/323] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:21.464159 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd896af2-c51d-4c13-aa0f-6689f7642912 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:21.535232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:21.536938 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c3d64-d87b-4b4c-828c-802d33b051b0 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:21.559274 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:21.570369 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd896af2-c51d-4c13-aa0f-6689f7642912 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:21.574313 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df855b-8450-4ea3-a2e5-ec1d89034589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:21.575107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df855b-8450-4ea3-a2e5-ec1d89034589 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:21.575955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df855b-8450-4ea3-a2e5-ec1d89034589 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:21.576234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df855b-8450-4ea3-a2e5-ec1d89034589 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:21.586525 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df855b-8450-4ea3-a2e5-ec1d89034589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:21.594851 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-d3df855b-8450-4ea3-a2e5-ec1d89034589 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:39:21.594851 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:21.594851 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:21.594851 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:21.594851 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:21.594851 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:21.594851 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:21.594851 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:21.594851 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:21.594851 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:21.594851 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:21.594851 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:21.594851 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:21.594851 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:21.594851 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:21.594851 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:21.595946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:21.595946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:21.595946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:21.595946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:21.595946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:21.595946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:21.595946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:21.595946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:21.595946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:21.595946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:21.595946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:21.595946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:21.595946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:21.595946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:21.595946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:21.595946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:21.596859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:21.596859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:21.596859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:21.596859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:21.596859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:21.596859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:21.596859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:21.596859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:21.596859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:21.596859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:21.596859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:39:21.596859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:21.596859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 162/324] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:21.601909 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df855b-8450-4ea3-a2e5-ec1d89034589 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:21.618384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58f5ad-69a1-4c06-b25c-86bb2ce23a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:21.619438 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58f5ad-69a1-4c06-b25c-86bb2ce23a51 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:21.619989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58f5ad-69a1-4c06-b25c-86bb2ce23a51 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:21.620549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58f5ad-69a1-4c06-b25c-86bb2ce23a51 None admin] PATH_INFO: `/v3/groups` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:21.622169 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58f5ad-69a1-4c06-b25c-86bb2ce23a51 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:21.624246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58f5ad-69a1-4c06-b25c-86bb2ce23a51 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:21.703934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df855b-8450-4ea3-a2e5-ec1d89034589 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:21.724137 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 163/325] 10.222.0.20 () {60 vars in 1134 bytes} [Thu Jun 23 10:39:21 2022] POST /identity/v3/groups => generated 226 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:39:21.740264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08674a28-4f01-4d80-9ab2-804c4b70babc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:21.741057 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08674a28-4f01-4d80-9ab2-804c4b70babc None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:21.741343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08674a28-4f01-4d80-9ab2-804c4b70babc None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:21.741723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08674a28-4f01-4d80-9ab2-804c4b70babc None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:21.742511 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08674a28-4f01-4d80-9ab2-804c4b70babc None admin] RBAC: Adding query filter params (name=reader) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:21.742874 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08674a28-4f01-4d80-9ab2-804c4b70babc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:21.744392 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08674a28-4f01-4d80-9ab2-804c4b70babc None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:21.760726 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 163/326] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:21.765795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58f5ad-69a1-4c06-b25c-86bb2ce23a51 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:21.775864 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c2e82-6f81-438a-ac08-5a16ae348864 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:21.776161 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c2e82-6f81-438a-ac08-5a16ae348864 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:21.776435 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c2e82-6f81-438a-ac08-5a16ae348864 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:21.777912 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 164/327] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:39:21.783969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031c009-1ad8-4855-a7d2-e6f3170223cf None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:21.784243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031c009-1ad8-4855-a7d2-e6f3170223cf None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:21.784523 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031c009-1ad8-4855-a7d2-e6f3170223cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:21.801998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-b031c009-1ad8-4855-a7d2-e6f3170223cf None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:21.803214 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-b031c009-1ad8-4855-a7d2-e6f3170223cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:21.843368 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:21.880185 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58f5ad-69a1-4c06-b25c-86bb2ce23a51 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:21.884735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 165/328] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:39:21.908051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031c009-1ad8-4855-a7d2-e6f3170223cf None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:21.911904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:21.925162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eee04b-032d-4085-adc7-c25570821034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:21.926060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eee04b-032d-4085-adc7-c25570821034 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:21.929119 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eee04b-032d-4085-adc7-c25570821034 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:21.929119 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eee04b-032d-4085-adc7-c25570821034 None admin] PATH_INFO: `/v3/users/3907a248b9374a4dbba8d2a1794a7565` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:21.929119 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eee04b-032d-4085-adc7-c25570821034 None admin] RBAC: Authorizing `identity:get_user(user_id=3907a248b9374a4dbba8d2a1794a7565)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:21.929383 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eee04b-032d-4085-adc7-c25570821034 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:21.931165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 164/329] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:21 2022] GET /identity/v3/users/3907a248b9374a4dbba8d2a1794a7565 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:21.937071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eee04b-032d-4085-adc7-c25570821034 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:22.040564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031c009-1ad8-4855-a7d2-e6f3170223cf None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:22.067077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eee04b-032d-4085-adc7-c25570821034 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:22.084311 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89ab52-ffee-489a-ab05-8fcbe7879a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:22.085479 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89ab52-ffee-489a-ab05-8fcbe7879a58 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:22.086360 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89ab52-ffee-489a-ab05-8fcbe7879a58 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:22.087212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89ab52-ffee-489a-ab05-8fcbe7879a58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:22.105109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89ab52-ffee-489a-ab05-8fcbe7879a58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:22.111273 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d8fdc-bd38-4fd7-9385-6d7f57de1408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:22.112157 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d8fdc-bd38-4fd7-9385-6d7f57de1408 None admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:22.112451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d8fdc-bd38-4fd7-9385-6d7f57de1408 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:22.113121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-ca89ab52-ffee-489a-ab05-8fcbe7879a58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:22.113121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:22.113121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:22.113121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:22.113121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:22.113121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:22.113121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:22.113121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:22.113121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:22.113121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:22.113121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:22.113121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:22.113121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:22.113121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:22.113121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:22.113121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:22.114025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:22.114025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:22.114025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:22.114025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:22.114025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:22.114025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:22.114025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:22.114025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:22.114025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:22.114025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:22.114025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:22.114025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:22.114025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:22.114025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:22.114025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:22.114025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:22.114965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:22.114965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:22.114965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:22.114965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:22.114965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:22.114965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:22.114965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:22.114965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:22.114965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:22.114965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:22.114965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:22.114965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:22.115540 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d8fdc-bd38-4fd7-9385-6d7f57de1408 None admin] PATH_INFO: `/v3/system/users/3907a248b9374a4dbba8d2a1794a7565/roles/4b240816f7ab46a8b8674d54c63a9f03` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:22.115605 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 166/330] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:22.115675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d8fdc-bd38-4fd7-9385-6d7f57de1408 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3907a248b9374a4dbba8d2a1794a7565, role_id=4b240816f7ab46a8b8674d54c63a9f03)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:22.120832 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d8fdc-bd38-4fd7-9385-6d7f57de1408 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:22.122394 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89ab52-ffee-489a-ab05-8fcbe7879a58 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:22.158712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:22.214881 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 165/331] 10.222.0.20 () {58 vars in 1334 bytes} [Thu Jun 23 10:39:21 2022] PUT /identity/v3/system/users/3907a248b9374a4dbba8d2a1794a7565/roles/4b240816f7ab46a8b8674d54c63a9f03 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:39:22.239223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89ab52-ffee-489a-ab05-8fcbe7879a58 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:22.280048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1f6b1-6d32-47a3-b1f1-eeb3a01f4b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:22.280772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1f6b1-6d32-47a3-b1f1-eeb3a01f4b00 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:22.281062 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1f6b1-6d32-47a3-b1f1-eeb3a01f4b00 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:22.281340 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1f6b1-6d32-47a3-b1f1-eeb3a01f4b00 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:22.282177 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1f6b1-6d32-47a3-b1f1-eeb3a01f4b00 None admin] RBAC: Adding query filter params (name=member) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:22.282487 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1f6b1-6d32-47a3-b1f1-eeb3a01f4b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:22.283968 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1f6b1-6d32-47a3-b1f1-eeb3a01f4b00 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:22.293682 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 167/332] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:22.299282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d8fdc-bd38-4fd7-9385-6d7f57de1408 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:22.371741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:22.420152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d8fdc-bd38-4fd7-9385-6d7f57de1408 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:22.458310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28689977-9cac-43a4-92d2-3631cde441b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:22.459200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28689977-9cac-43a4-92d2-3631cde441b0 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:22.459488 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28689977-9cac-43a4-92d2-3631cde441b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:22.459768 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28689977-9cac-43a4-92d2-3631cde441b0 None admin] PATH_INFO: `/v3/users/1c766e84fa4d485b9786e3a9831e9f65` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:22.461029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28689977-9cac-43a4-92d2-3631cde441b0 None admin] RBAC: Authorizing `identity:get_user(user_id=1c766e84fa4d485b9786e3a9831e9f65)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:22.462484 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28689977-9cac-43a4-92d2-3631cde441b0 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:22.464452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 166/333] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:22 2022] GET /identity/v3/users/1c766e84fa4d485b9786e3a9831e9f65 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:22.473747 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1f6b1-6d32-47a3-b1f1-eeb3a01f4b00 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:22.591470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:22.594386 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1f6b1-6d32-47a3-b1f1-eeb3a01f4b00 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:22.629709 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17395994-dfc3-4da1-8055-ced0111c64be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:22.630386 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17395994-dfc3-4da1-8055-ced0111c64be None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:22.630673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17395994-dfc3-4da1-8055-ced0111c64be None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:22.632359 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17395994-dfc3-4da1-8055-ced0111c64be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:22.632359 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17395994-dfc3-4da1-8055-ced0111c64be None admin] RBAC: Adding query filter params (role.id=14edb03a6a644798bdbf762bb59f6ef9, user.id=1c766e84fa4d485b9786e3a9831e9f65, scope.system=all) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:22.632359 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17395994-dfc3-4da1-8055-ced0111c64be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:22.633579 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17395994-dfc3-4da1-8055-ced0111c64be None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:22.647013 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 168/334] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Jun 23 10:39:22 2022] GET /identity/v3/role_assignments?user.id=1c766e84fa4d485b9786e3a9831e9f65&scope.system=all&role.id=14edb03a6a644798bdbf762bb59f6ef9 => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:24.349228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c23c7e-a899-4499-b435-99cff653c044 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:24.350246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c23c7e-a899-4499-b435-99cff653c044 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:24.350735 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c23c7e-a899-4499-b435-99cff653c044 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:24.352541 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 167/335] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:24.358289 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08497afc-fc7c-4e9d-ae0b-418d99fff79a None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:24.359118 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08497afc-fc7c-4e9d-ae0b-418d99fff79a None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:24.359598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08497afc-fc7c-4e9d-ae0b-418d99fff79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:24.378482 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-08497afc-fc7c-4e9d-ae0b-418d99fff79a None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:24.379989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-08497afc-fc7c-4e9d-ae0b-418d99fff79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:24.449978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 169/336] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:39:24.475278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c23c7e-a899-4499-b435-99cff653c044 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:24.586035 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c23c7e-a899-4499-b435-99cff653c044 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:24.620664 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:24.624742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c187014-b1b6-49b2-b3ac-3cfc05610659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:24.624742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c187014-b1b6-49b2-b3ac-3cfc05610659 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:24.624742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c187014-b1b6-49b2-b3ac-3cfc05610659 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:24.624742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c187014-b1b6-49b2-b3ac-3cfc05610659 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:24.636867 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c187014-b1b6-49b2-b3ac-3cfc05610659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:24.645547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-8c187014-b1b6-49b2-b3ac-3cfc05610659 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:24.645547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:24.645547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:24.645547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:24.645547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:24.645547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:24.645547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:24.645547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:24.645547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:24.645547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:24.645547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:24.645547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:24.645547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:24.645547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:24.645547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:24.645547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:24.646439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:24.646439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:24.646439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:24.646439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:24.646439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:24.646439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:24.646439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:24.646439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:24.646439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:24.646439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:24.646439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:24.646439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:24.646439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:24.646439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:24.646439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:24.646439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:24.647224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:24.647224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:24.647224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:24.647224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:24.647224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:24.647224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:24.647224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:24.647224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:24.647224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:24.647224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:24.647224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:24.647224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:24.647224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 168/337] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:24.652908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08497afc-fc7c-4e9d-ae0b-418d99fff79a None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:24.741545 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:24.760972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08497afc-fc7c-4e9d-ae0b-418d99fff79a None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:24.779342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b26ec-748d-433a-ad15-f4cd87b6a256 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:24.779717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b26ec-748d-433a-ad15-f4cd87b6a256 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:24.779893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b26ec-748d-433a-ad15-f4cd87b6a256 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:24.781287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 169/338] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:24.788082 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ba5db-78b5-40bc-a20b-b0b2a28bbc48 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:24.789136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ba5db-78b5-40bc-a20b-b0b2a28bbc48 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:24.789648 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ba5db-78b5-40bc-a20b-b0b2a28bbc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:24.810428 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-e04ba5db-78b5-40bc-a20b-b0b2a28bbc48 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:24.810848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53c554-3624-4f1b-99c1-3f40a4f96987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:24.811539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53c554-3624-4f1b-99c1-3f40a4f96987 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:24.811820 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53c554-3624-4f1b-99c1-3f40a4f96987 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:24.812097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53c554-3624-4f1b-99c1-3f40a4f96987 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:24.812865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e04ba5db-78b5-40bc-a20b-b0b2a28bbc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:24.812971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53c554-3624-4f1b-99c1-3f40a4f96987 None admin] RBAC: Adding query filter params (name=member) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:24.813176 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53c554-3624-4f1b-99c1-3f40a4f96987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:24.814554 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53c554-3624-4f1b-99c1-3f40a4f96987 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:24.831834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 170/339] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:24.854814 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53c554-3624-4f1b-99c1-3f40a4f96987 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:24.899272 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 170/340] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:39:24.926844 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ba5db-78b5-40bc-a20b-b0b2a28bbc48 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:25.130371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53c554-3624-4f1b-99c1-3f40a4f96987 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:25.189423 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ba5db-78b5-40bc-a20b-b0b2a28bbc48 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:25.215394 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:25.233391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a3676-061f-4f1a-9dbe-54e0226fdeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:25.234068 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3676-061f-4f1a-9dbe-54e0226fdeb4 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:25.234354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3676-061f-4f1a-9dbe-54e0226fdeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:25.238873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3676-061f-4f1a-9dbe-54e0226fdeb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:25.241348 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab109ac-c126-4bca-89f5-e498b074522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:25.242431 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab109ac-c126-4bca-89f5-e498b074522e None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:25.242913 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab109ac-c126-4bca-89f5-e498b074522e None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:25.243388 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab109ac-c126-4bca-89f5-e498b074522e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:25.259635 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab109ac-c126-4bca-89f5-e498b074522e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:25.269127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:25.269743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-4ab109ac-c126-4bca-89f5-e498b074522e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:25.269743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:25.269743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:25.269743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:25.269743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:25.269743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:25.269743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:25.269743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:25.269743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:25.269743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:25.269743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:25.269743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:25.269743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:25.269743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:25.269743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:25.269743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:25.270591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:25.270591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:25.270591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:25.270591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:25.270591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:25.270591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:25.270591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:25.270591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:25.270591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:25.270591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:25.270591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:25.270591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:25.270591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:25.270591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:25.270591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:25.270591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:25.271355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:25.271355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:25.271355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:25.271355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:25.271355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:25.271355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:25.271355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:25.271355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:25.271355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:25.271355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:25.271355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:25.271355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:25.274445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 171/341] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:39:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:25.275969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b302d3-d4cc-49a9-899b-0639c5734e9c None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:25.276472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b302d3-d4cc-49a9-899b-0639c5734e9c None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:25.281150 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b302d3-d4cc-49a9-899b-0639c5734e9c None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:25.283015 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 172/342] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:25.285505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b302d3-d4cc-49a9-899b-0639c5734e9c None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:25.379744 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a3676-061f-4f1a-9dbe-54e0226fdeb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:25.382614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a3676-061f-4f1a-9dbe-54e0226fdeb4 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:25.408210 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b302d3-d4cc-49a9-899b-0639c5734e9c None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:25.454517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b242e8c-e7fe-4459-943c-eff501396cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:25.456551 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b242e8c-e7fe-4459-943c-eff501396cdb None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:25.456871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b242e8c-e7fe-4459-943c-eff501396cdb None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:25.457159 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b242e8c-e7fe-4459-943c-eff501396cdb None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:25.458198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b242e8c-e7fe-4459-943c-eff501396cdb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:25.458306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b242e8c-e7fe-4459-943c-eff501396cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:25.459633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b242e8c-e7fe-4459-943c-eff501396cdb None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:25.482607 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 173/343] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:25.484136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51a3bc-a685-43ac-8886-4f350487b1e8 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:25.484430 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51a3bc-a685-43ac-8886-4f350487b1e8 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:25.484739 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51a3bc-a685-43ac-8886-4f350487b1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:25.514423 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-cf51a3bc-a685-43ac-8886-4f350487b1e8 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:25.515628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-cf51a3bc-a685-43ac-8886-4f350487b1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:25.537497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 171/344] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 10:39:25.539198 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551a61e-0d34-4cec-9d09-c0d1e198d612 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:25.539710 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551a61e-0d34-4cec-9d09-c0d1e198d612 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:25.541380 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551a61e-0d34-4cec-9d09-c0d1e198d612 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:25.543187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 172/345] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:25.545143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551a61e-0d34-4cec-9d09-c0d1e198d612 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:25.604728 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:25.608264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:25.659341 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 174/346] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:25.661397 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51a3bc-a685-43ac-8886-4f350487b1e8 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:25.675151 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551a61e-0d34-4cec-9d09-c0d1e198d612 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:25.713427 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06377086-b027-48db-a6ec-990482dea354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:25.714004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06377086-b027-48db-a6ec-990482dea354 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:25.714286 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06377086-b027-48db-a6ec-990482dea354 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:25.714557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06377086-b027-48db-a6ec-990482dea354 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:25.786071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51a3bc-a685-43ac-8886-4f350487b1e8 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:25.787993 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06377086-b027-48db-a6ec-990482dea354 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:25.789664 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06377086-b027-48db-a6ec-990482dea354 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:25.830048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb99a4e-c666-4c92-84fe-e2602becfb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:25.831357 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb99a4e-c666-4c92-84fe-e2602becfb20 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:25.831868 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb99a4e-c666-4c92-84fe-e2602becfb20 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:25.832363 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb99a4e-c666-4c92-84fe-e2602becfb20 None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:25.833885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb99a4e-c666-4c92-84fe-e2602becfb20 None admin] RBAC: Authorizing `identity:get_project(project_id=ab32a97afff44105a351deb0fa2e7609)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:25.835810 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb99a4e-c666-4c92-84fe-e2602becfb20 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:25.838199 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 175/347] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:25 2022] GET /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:25.839190 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:25.841051 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf6ed-ab79-4bc0-92bd-ea174dda95a9 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:25.842206 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf6ed-ab79-4bc0-92bd-ea174dda95a9 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:25.842927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf6ed-ab79-4bc0-92bd-ea174dda95a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:25.859907 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-0dbcf6ed-ab79-4bc0-92bd-ea174dda95a9 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:25.861530 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-0dbcf6ed-ab79-4bc0-92bd-ea174dda95a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:25.900019 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:25.902068 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 173/348] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:25.902512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06377086-b027-48db-a6ec-990482dea354 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:25.943226 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 176/349] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:25.944415 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcf6ed-ab79-4bc0-92bd-ea174dda95a9 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:26.009683 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06377086-b027-48db-a6ec-990482dea354 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:26.043832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14227aa2-20de-450d-a95c-e7b0d26b5390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:26.045209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14227aa2-20de-450d-a95c-e7b0d26b5390 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:26.045491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14227aa2-20de-450d-a95c-e7b0d26b5390 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:26.045762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14227aa2-20de-450d-a95c-e7b0d26b5390 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:26.057001 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14227aa2-20de-450d-a95c-e7b0d26b5390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:26.066314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-14227aa2-20de-450d-a95c-e7b0d26b5390 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:26.066314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:26.066314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:26.066314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:26.066314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:26.066314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:26.066314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:26.066314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:26.066314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:26.066314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:26.066314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:26.066314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:26.066314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:26.066314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:26.066314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:26.066314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:26.067240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:26.067240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:26.067240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:26.067240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:26.067240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:26.067240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:26.067240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:26.067240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:26.067240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:26.067240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:26.067240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:26.067240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:26.067240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:26.067240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:26.067240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:26.067240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:26.068033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:26.068033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:26.068033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:26.068033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:26.068033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:26.068033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:26.068033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:26.068033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:26.068033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:26.068033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:26.068033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:26.068033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:26.068033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 174/350] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:26.068738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14227aa2-20de-450d-a95c-e7b0d26b5390 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:26.070709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcf6ed-ab79-4bc0-92bd-ea174dda95a9 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:26.072876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:26.111608 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6a1b4-2cf3-4257-bcb3-0d25395597ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:26.113039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6a1b4-2cf3-4257-bcb3-0d25395597ef None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:26.113530 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6a1b4-2cf3-4257-bcb3-0d25395597ef None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:26.114010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6a1b4-2cf3-4257-bcb3-0d25395597ef None admin] PATH_INFO: `/v3/groups/c01c574806804757bafcab2ca2a44c80` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:26.122319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6a1b4-2cf3-4257-bcb3-0d25395597ef None admin] RBAC: Authorizing `identity:get_group(group_id=c01c574806804757bafcab2ca2a44c80)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:26.124753 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6a1b4-2cf3-4257-bcb3-0d25395597ef None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:26.127076 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 177/351] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 23 10:39:25 2022] GET /identity/v3/groups/c01c574806804757bafcab2ca2a44c80 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:26.128087 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6a1b4-2cf3-4257-bcb3-0d25395597ef None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:26.177009 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:26.190551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14227aa2-20de-450d-a95c-e7b0d26b5390 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:26.235433 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f957f-bcde-4605-b5da-1242942d3f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:26.236414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f957f-bcde-4605-b5da-1242942d3f5e None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:26.236837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f957f-bcde-4605-b5da-1242942d3f5e None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:26.237198 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f957f-bcde-4605-b5da-1242942d3f5e None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:26.238492 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f957f-bcde-4605-b5da-1242942d3f5e None admin] RBAC: Authorizing `identity:get_project(project_id=ab32a97afff44105a351deb0fa2e7609)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:26.240257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f957f-bcde-4605-b5da-1242942d3f5e None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:26.242321 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 175/352] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:26 2022] GET /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:26.242930 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f957f-bcde-4605-b5da-1242942d3f5e None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:26.276606 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6a1b4-2cf3-4257-bcb3-0d25395597ef None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:26.315196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b194e-220d-4423-82a6-1d4bc0436d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:26.315999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b194e-220d-4423-82a6-1d4bc0436d83 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:26.316285 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b194e-220d-4423-82a6-1d4bc0436d83 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:26.316564 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b194e-220d-4423-82a6-1d4bc0436d83 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:26.330664 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b194e-220d-4423-82a6-1d4bc0436d83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:26.338585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-615b194e-220d-4423-82a6-1d4bc0436d83 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:39:26.338585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:26.338585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:26.338585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:26.338585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:26.338585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:26.338585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:26.338585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:26.338585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:26.338585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:26.338585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:26.338585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:26.338585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:26.338585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:26.338585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:26.338585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:26.339472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:26.339472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:26.339472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:26.339472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:26.339472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:26.339472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:26.339472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:26.339472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:26.339472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:26.339472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:26.339472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:26.339472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:26.339472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:26.339472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:26.339472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:26.339472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:26.341796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:26.341796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:26.341796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:26.341796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:26.341796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:26.341796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:26.341796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:26.341796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:26.341796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:26.341796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:26.341796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:39:26.341796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:26.341796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 178/353] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:26.341796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461928d-68f3-4873-8edd-73184b2d4986 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:26.342545 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461928d-68f3-4873-8edd-73184b2d4986 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:26.342545 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461928d-68f3-4873-8edd-73184b2d4986 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:26.345300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 179/354] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:26.347296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:26.348927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461928d-68f3-4873-8edd-73184b2d4986 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:26.386817 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f957f-bcde-4605-b5da-1242942d3f5e None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:26.431626 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883ae5e-3513-434e-baba-763a6bdee32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:26.432312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883ae5e-3513-434e-baba-763a6bdee32d None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:26.432602 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883ae5e-3513-434e-baba-763a6bdee32d None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:26.432917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883ae5e-3513-434e-baba-763a6bdee32d None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:26.433687 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883ae5e-3513-434e-baba-763a6bdee32d None admin] RBAC: Adding query filter params (name=member) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:26.436457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883ae5e-3513-434e-baba-763a6bdee32d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:26.437898 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883ae5e-3513-434e-baba-763a6bdee32d None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:26.448115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 176/355] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:26.448115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883ae5e-3513-434e-baba-763a6bdee32d None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:26.476529 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:26.490526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461928d-68f3-4873-8edd-73184b2d4986 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:26.534013 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372026b-6e62-478a-a9d9-55da95f3f566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:26.534598 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372026b-6e62-478a-a9d9-55da95f3f566 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:26.534889 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372026b-6e62-478a-a9d9-55da95f3f566 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:26.535171 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372026b-6e62-478a-a9d9-55da95f3f566 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:26.536021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372026b-6e62-478a-a9d9-55da95f3f566 None admin] RBAC: Adding query filter params (group.id=c01c574806804757bafcab2ca2a44c80, role.id=14edb03a6a644798bdbf762bb59f6ef9, scope.project.id=ab32a97afff44105a351deb0fa2e7609) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:26.536346 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372026b-6e62-478a-a9d9-55da95f3f566 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:26.537848 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372026b-6e62-478a-a9d9-55da95f3f566 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:26.547173 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 180/356] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 23 10:39:26 2022] GET /identity/v3/role_assignments?group.id=c01c574806804757bafcab2ca2a44c80&scope.project.id=ab32a97afff44105a351deb0fa2e7609&role.id=14edb03a6a644798bdbf762bb59f6ef9 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:26.550279 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372026b-6e62-478a-a9d9-55da95f3f566 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:26.580434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883ae5e-3513-434e-baba-763a6bdee32d None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:26.624186 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1f280-5448-4e3e-a63a-2a26dca51658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:26.626659 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1f280-5448-4e3e-a63a-2a26dca51658 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:26.627257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1f280-5448-4e3e-a63a-2a26dca51658 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:26.627795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1f280-5448-4e3e-a63a-2a26dca51658 None admin] PATH_INFO: `/v3/groups/c01c574806804757bafcab2ca2a44c80` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:26.629933 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1f280-5448-4e3e-a63a-2a26dca51658 None admin] RBAC: Authorizing `identity:get_group(group_id=c01c574806804757bafcab2ca2a44c80)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:26.631692 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1f280-5448-4e3e-a63a-2a26dca51658 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:26.634148 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 177/357] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 23 10:39:26 2022] GET /identity/v3/groups/c01c574806804757bafcab2ca2a44c80 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:26.641386 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6419ffe-7080-4a07-b02f-172f1d675170 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:26.642051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6419ffe-7080-4a07-b02f-172f1d675170 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:26.642610 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6419ffe-7080-4a07-b02f-172f1d675170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:26.662537 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-f6419ffe-7080-4a07-b02f-172f1d675170 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:26.664242 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f6419ffe-7080-4a07-b02f-172f1d675170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:26.677024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:26.687671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372026b-6e62-478a-a9d9-55da95f3f566 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:26.736804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b1e88-6fac-459b-8041-9297b965e85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:26.737583 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1e88-6fac-459b-8041-9297b965e85f None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:26.737999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1e88-6fac-459b-8041-9297b965e85f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:26.738307 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1e88-6fac-459b-8041-9297b965e85f None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:26.739189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b1e88-6fac-459b-8041-9297b965e85f None admin] RBAC: Adding query filter params (name=reader) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:26.739689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b1e88-6fac-459b-8041-9297b965e85f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:26.741247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b1e88-6fac-459b-8041-9297b965e85f None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:26.752492 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 181/358] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:26.753455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b1e88-6fac-459b-8041-9297b965e85f None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:26.753562 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 178/359] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:26.754489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6419ffe-7080-4a07-b02f-172f1d675170 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:26.776975 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:26.878796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b1e88-6fac-459b-8041-9297b965e85f None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:26.879082 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6419ffe-7080-4a07-b02f-172f1d675170 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:26.920884 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:26.922215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2b5d6-bfa9-4298-b969-9259b2470026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:26.922883 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2b5d6-bfa9-4298-b969-9259b2470026 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:26.923170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2b5d6-bfa9-4298-b969-9259b2470026 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:26.923447 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2b5d6-bfa9-4298-b969-9259b2470026 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:26.926550 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef4722-4dae-4d2b-a207-59fa235a564d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:26.927412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef4722-4dae-4d2b-a207-59fa235a564d None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:26.928617 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef4722-4dae-4d2b-a207-59fa235a564d None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:26.928940 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef4722-4dae-4d2b-a207-59fa235a564d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:26.939552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef4722-4dae-4d2b-a207-59fa235a564d None admin] RBAC: Adding query filter params (group.id=c01c574806804757bafcab2ca2a44c80, role.id=f86a1d8dfb24430a98414eab048c4be9, scope.project.id=ab32a97afff44105a351deb0fa2e7609) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:26.939552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef4722-4dae-4d2b-a207-59fa235a564d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:26.939552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef4722-4dae-4d2b-a207-59fa235a564d None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:26.939552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 179/360] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 23 10:39:26 2022] GET /identity/v3/role_assignments?group.id=c01c574806804757bafcab2ca2a44c80&scope.project.id=ab32a97afff44105a351deb0fa2e7609&role.id=f86a1d8dfb24430a98414eab048c4be9 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:26.940935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c24bb-af27-4cb5-84e5-a7aa3eab6c6a None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:26.941345 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c24bb-af27-4cb5-84e5-a7aa3eab6c6a None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:26.941746 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c24bb-af27-4cb5-84e5-a7aa3eab6c6a None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:26.943333 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 180/361] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:26.944114 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c24bb-af27-4cb5-84e5-a7aa3eab6c6a None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:27.024062 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2b5d6-bfa9-4298-b969-9259b2470026 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:27.026695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2b5d6-bfa9-4298-b969-9259b2470026 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:27.052288 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:27.073360 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c24bb-af27-4cb5-84e5-a7aa3eab6c6a None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:27.115911 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3058e-3b2c-4916-811e-83deb54b94ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:27.116907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3058e-3b2c-4916-811e-83deb54b94ff None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:27.117195 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3058e-3b2c-4916-811e-83deb54b94ff None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:27.117476 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3058e-3b2c-4916-811e-83deb54b94ff None admin] PATH_INFO: `/v3/users/3907a248b9374a4dbba8d2a1794a7565` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:27.119293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3058e-3b2c-4916-811e-83deb54b94ff None admin] RBAC: Authorizing `identity:get_user(user_id=3907a248b9374a4dbba8d2a1794a7565)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:27.121176 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3058e-3b2c-4916-811e-83deb54b94ff None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:27.125133 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 181/362] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:26 2022] GET /identity/v3/users/3907a248b9374a4dbba8d2a1794a7565 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:27.125955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3058e-3b2c-4916-811e-83deb54b94ff None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:27.167865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 182/363] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:27.169376 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09381555-44ff-4c1b-a351-2a80e13b614f None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:27.170066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09381555-44ff-4c1b-a351-2a80e13b614f None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:27.170358 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09381555-44ff-4c1b-a351-2a80e13b614f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:27.197744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-09381555-44ff-4c1b-a351-2a80e13b614f None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:27.198963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-09381555-44ff-4c1b-a351-2a80e13b614f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:27.220071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:27.269832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3058e-3b2c-4916-811e-83deb54b94ff None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:27.287926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 183/364] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:27.288955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09381555-44ff-4c1b-a351-2a80e13b614f None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:27.337010 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ac996-cfac-4483-9911-cc37973486cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:27.337791 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ac996-cfac-4483-9911-cc37973486cc None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:27.338076 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ac996-cfac-4483-9911-cc37973486cc None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:27.338354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ac996-cfac-4483-9911-cc37973486cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:27.348576 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:27.351254 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ac996-cfac-4483-9911-cc37973486cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:27.361637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-a28ac996-cfac-4483-9911-cc37973486cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:27.361637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:27.361637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:27.361637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:27.361637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:27.361637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:27.361637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:27.361637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:27.361637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:27.361637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:27.361637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:27.361637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:27.361637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:27.361637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:27.361637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:27.361637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:27.362963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:27.362963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:27.362963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:27.362963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:27.362963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:27.362963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:27.362963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:27.362963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:27.362963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:27.362963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:27.362963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:27.362963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:27.362963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:27.362963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:27.362963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:27.362963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:27.363944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:27.363944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:27.363944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:27.363944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:27.363944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:27.363944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:27.363944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:27.363944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:27.363944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:27.363944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:27.363944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:27.363944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:27.364682 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 182/365] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:39:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:27.368047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ac996-cfac-4483-9911-cc37973486cc None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:27.414517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09381555-44ff-4c1b-a351-2a80e13b614f None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:27.462447 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c444003-cd2a-445c-ba94-401a92c214db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:27.463456 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c444003-cd2a-445c-ba94-401a92c214db None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:27.463941 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c444003-cd2a-445c-ba94-401a92c214db None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:27.464415 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c444003-cd2a-445c-ba94-401a92c214db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:27.466646 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c444003-cd2a-445c-ba94-401a92c214db None admin] RBAC: Adding query filter params (role.id=4b240816f7ab46a8b8674d54c63a9f03, user.id=3907a248b9374a4dbba8d2a1794a7565, scope.system=all) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:27.467177 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c444003-cd2a-445c-ba94-401a92c214db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:27.470407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c444003-cd2a-445c-ba94-401a92c214db None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:27.486201 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 184/366] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Jun 23 10:39:27 2022] GET /identity/v3/role_assignments?user.id=3907a248b9374a4dbba8d2a1794a7565&scope.system=all&role.id=4b240816f7ab46a8b8674d54c63a9f03 => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:27.487977 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c444003-cd2a-445c-ba94-401a92c214db None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:27.500740 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ac996-cfac-4483-9911-cc37973486cc None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:27.536467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:27.554008 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c370d1-23ff-47c0-9345-2ccb746079ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:27.555055 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c370d1-23ff-47c0-9345-2ccb746079ca None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:27.555470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c370d1-23ff-47c0-9345-2ccb746079ca None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:27.555960 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c370d1-23ff-47c0-9345-2ccb746079ca None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:27.557336 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c370d1-23ff-47c0-9345-2ccb746079ca None admin] RBAC: Authorizing `identity:get_project(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:27.558901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c370d1-23ff-47c0-9345-2ccb746079ca None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:27.562117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 183/367] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:27 2022] GET /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:27.563089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c370d1-23ff-47c0-9345-2ccb746079ca None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:27.647712 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c444003-cd2a-445c-ba94-401a92c214db None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:27.657568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:27.699710 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92122e-3c2a-4eec-8031-b964782085f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:27.702462 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92122e-3c2a-4eec-8031-b964782085f7 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:27.702462 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92122e-3c2a-4eec-8031-b964782085f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:27.702462 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92122e-3c2a-4eec-8031-b964782085f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:27.721569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c370d1-23ff-47c0-9345-2ccb746079ca None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:27.729303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92122e-3c2a-4eec-8031-b964782085f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:27.738539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-7e92122e-3c2a-4eec-8031-b964782085f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:27.738539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:27.738539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:27.738539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:27.738539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:27.738539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:27.738539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:27.738539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:27.738539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:27.738539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:27.738539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:27.738539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:27.738539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:27.738539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:27.738539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:27.738539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:27.739677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:27.739677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:27.739677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:27.739677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:27.739677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:27.739677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:27.739677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:27.739677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:27.739677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:27.739677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:27.739677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:27.739677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:27.739677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:27.739677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:27.739677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:27.739677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:27.740675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:27.740675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:27.740675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:27.740675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:27.740675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:27.740675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:27.740675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:27.740675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:27.740675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:27.740675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:27.740675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:27.740675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:27.740675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 185/368] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:39:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:27.744616 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92122e-3c2a-4eec-8031-b964782085f7 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:27.768035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96d4d3-709e-4e58-a2aa-e48ed7da7696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:27.768949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96d4d3-709e-4e58-a2aa-e48ed7da7696 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:27.769954 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96d4d3-709e-4e58-a2aa-e48ed7da7696 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:27.769954 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96d4d3-709e-4e58-a2aa-e48ed7da7696 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:27.770628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96d4d3-709e-4e58-a2aa-e48ed7da7696 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:27.771045 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96d4d3-709e-4e58-a2aa-e48ed7da7696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:27.772881 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96d4d3-709e-4e58-a2aa-e48ed7da7696 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:27.787281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 184/369] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:27.788371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96d4d3-709e-4e58-a2aa-e48ed7da7696 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:27.851981 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:27.908349 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92122e-3c2a-4eec-8031-b964782085f7 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:27.910404 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96d4d3-709e-4e58-a2aa-e48ed7da7696 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:27.952386 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dbdcf-4ed7-4a17-a865-fc75aff26a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:27.953469 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dbdcf-4ed7-4a17-a865-fc75aff26a77 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:27.953954 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dbdcf-4ed7-4a17-a865-fc75aff26a77 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:27.954442 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dbdcf-4ed7-4a17-a865-fc75aff26a77 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:27.954831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3debc-9927-4b0d-ac9f-01fbdced9208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:27.955637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dbdcf-4ed7-4a17-a865-fc75aff26a77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:27.955740 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3debc-9927-4b0d-ac9f-01fbdced9208 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:27.955972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3debc-9927-4b0d-ac9f-01fbdced9208 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:27.956257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3debc-9927-4b0d-ac9f-01fbdced9208 None admin] PATH_INFO: `/v3/groups/c01c574806804757bafcab2ca2a44c80` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:27.956650 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dbdcf-4ed7-4a17-a865-fc75aff26a77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:27.957479 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3debc-9927-4b0d-ac9f-01fbdced9208 None admin] RBAC: Authorizing `identity:get_group(group_id=c01c574806804757bafcab2ca2a44c80)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:27.958457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dbdcf-4ed7-4a17-a865-fc75aff26a77 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:27.958925 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3debc-9927-4b0d-ac9f-01fbdced9208 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:27.961316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 186/370] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 23 10:39:27 2022] GET /identity/v3/groups/c01c574806804757bafcab2ca2a44c80 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:27.961929 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3debc-9927-4b0d-ac9f-01fbdced9208 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:27.972349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 185/371] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:27.973143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dbdcf-4ed7-4a17-a865-fc75aff26a77 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:28.006942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:28.078082 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3debc-9927-4b0d-ac9f-01fbdced9208 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:28.095872 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dbdcf-4ed7-4a17-a865-fc75aff26a77 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:28.114275 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:28.116523 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a9cf1-bda2-4804-8fc2-e91be4ffd956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:28.117469 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a9cf1-bda2-4804-8fc2-e91be4ffd956 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:28.117945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a9cf1-bda2-4804-8fc2-e91be4ffd956 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:28.118382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a9cf1-bda2-4804-8fc2-e91be4ffd956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:28.135357 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4014c-32ed-494c-8e5f-7642be516d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:28.136111 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4014c-32ed-494c-8e5f-7642be516d48 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:28.136472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4014c-32ed-494c-8e5f-7642be516d48 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:28.136850 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4014c-32ed-494c-8e5f-7642be516d48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:28.138426 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4014c-32ed-494c-8e5f-7642be516d48 None admin] RBAC: Adding query filter params (group.id=c01c574806804757bafcab2ca2a44c80, role.id=14edb03a6a644798bdbf762bb59f6ef9, scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:28.139026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4014c-32ed-494c-8e5f-7642be516d48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:28.140900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4014c-32ed-494c-8e5f-7642be516d48 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:28.148660 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 186/372] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 23 10:39:27 2022] GET /identity/v3/role_assignments?group.id=c01c574806804757bafcab2ca2a44c80&scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf&role.id=14edb03a6a644798bdbf762bb59f6ef9 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:28.148867 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4014c-32ed-494c-8e5f-7642be516d48 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:28.273027 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4014c-32ed-494c-8e5f-7642be516d48 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:28.282974 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a9cf1-bda2-4804-8fc2-e91be4ffd956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:28.284807 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a9cf1-bda2-4804-8fc2-e91be4ffd956 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:28.313803 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e0c46-73b0-4ece-9058-845920124c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:28.314609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e0c46-73b0-4ece-9058-845920124c71 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:28.314978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e0c46-73b0-4ece-9058-845920124c71 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:28.315331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e0c46-73b0-4ece-9058-845920124c71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:28.371036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:28.374875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:28.397034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e0c46-73b0-4ece-9058-845920124c71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:28.398622 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e0c46-73b0-4ece-9058-845920124c71 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:28.514338 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 187/373] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:28.516358 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 187/374] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:28.521785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a9cf1-bda2-4804-8fc2-e91be4ffd956 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:28.521925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e0c46-73b0-4ece-9058-845920124c71 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:28.629855 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a9cf1-bda2-4804-8fc2-e91be4ffd956 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:28.630048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:28.653201 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e0c46-73b0-4ece-9058-845920124c71 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:28.681398 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41345ad8-2c86-423a-b168-7df110636f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:28.682285 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345ad8-2c86-423a-b168-7df110636f68 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:28.682566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345ad8-2c86-423a-b168-7df110636f68 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:28.682841 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345ad8-2c86-423a-b168-7df110636f68 None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:28.684107 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41345ad8-2c86-423a-b168-7df110636f68 None admin] RBAC: Authorizing `identity:get_project(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:28.685639 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41345ad8-2c86-423a-b168-7df110636f68 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:28.687496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 188/375] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:28 2022] GET /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:28.695898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41345ad8-2c86-423a-b168-7df110636f68 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:28.698138 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b559e77-9682-436f-8aaa-379f6ceef80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:28.699022 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b559e77-9682-436f-8aaa-379f6ceef80f None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:28.699310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b559e77-9682-436f-8aaa-379f6ceef80f None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:28.699593 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b559e77-9682-436f-8aaa-379f6ceef80f None admin] PATH_INFO: `/v3/projects/7866f693106e4323a208242e01a5fef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:28.701070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b559e77-9682-436f-8aaa-379f6ceef80f None admin] RBAC: Authorizing `identity:get_project(project_id=7866f693106e4323a208242e01a5fef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:28.702854 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b559e77-9682-436f-8aaa-379f6ceef80f None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:28.703272 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:28.705949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 188/376] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:28 2022] GET /identity/v3/projects/7866f693106e4323a208242e01a5fef9 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:28.712734 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b559e77-9682-436f-8aaa-379f6ceef80f None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:28.844731 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41345ad8-2c86-423a-b168-7df110636f68 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:28.883246 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b559e77-9682-436f-8aaa-379f6ceef80f None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:28.910414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e66ef-a92d-403a-a99a-1ee8fed3249a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:28.911281 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e66ef-a92d-403a-a99a-1ee8fed3249a None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:28.911792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e66ef-a92d-403a-a99a-1ee8fed3249a None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:28.912066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e66ef-a92d-403a-a99a-1ee8fed3249a None admin] PATH_INFO: `/v3/groups/c01c574806804757bafcab2ca2a44c80` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:28.914043 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e66ef-a92d-403a-a99a-1ee8fed3249a None admin] RBAC: Authorizing `identity:get_group(group_id=c01c574806804757bafcab2ca2a44c80)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:28.915481 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e66ef-a92d-403a-a99a-1ee8fed3249a None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:28.917475 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 189/377] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 23 10:39:28 2022] GET /identity/v3/groups/c01c574806804757bafcab2ca2a44c80 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:28.924767 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e66ef-a92d-403a-a99a-1ee8fed3249a None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:28.962600 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4326b-1f01-4f1d-8ce4-09630302b2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:28.963528 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4326b-1f01-4f1d-8ce4-09630302b2b4 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:28.963770 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4326b-1f01-4f1d-8ce4-09630302b2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:28.965825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4326b-1f01-4f1d-8ce4-09630302b2b4 None admin] PATH_INFO: `/v3/groups/c243361d46834d4fac9a697faa1b2325` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:28.983137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4326b-1f01-4f1d-8ce4-09630302b2b4 None admin] RBAC: Authorizing `identity:get_group(group_id=c243361d46834d4fac9a697faa1b2325)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:28.984673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4326b-1f01-4f1d-8ce4-09630302b2b4 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:28.986567 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 189/378] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 23 10:39:28 2022] GET /identity/v3/groups/c243361d46834d4fac9a697faa1b2325 => generated 229 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:28.998649 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4326b-1f01-4f1d-8ce4-09630302b2b4 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:29.019926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:29.030150 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:29.067250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e66ef-a92d-403a-a99a-1ee8fed3249a None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:29.104026 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187235d9-e93f-46c3-b2e2-8b26befa6415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:29.104888 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187235d9-e93f-46c3-b2e2-8b26befa6415 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:29.105248 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187235d9-e93f-46c3-b2e2-8b26befa6415 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:29.105645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187235d9-e93f-46c3-b2e2-8b26befa6415 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:29.107260 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187235d9-e93f-46c3-b2e2-8b26befa6415 None admin] RBAC: Adding query filter params (group.id=c01c574806804757bafcab2ca2a44c80, role.id=f86a1d8dfb24430a98414eab048c4be9, scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:29.107851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187235d9-e93f-46c3-b2e2-8b26befa6415 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:29.109724 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187235d9-e93f-46c3-b2e2-8b26befa6415 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:29.115808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 190/379] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 23 10:39:28 2022] GET /identity/v3/role_assignments?group.id=c01c574806804757bafcab2ca2a44c80&scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf&role.id=f86a1d8dfb24430a98414eab048c4be9 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:29.121367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2e6c6-fcbb-495c-a61a-6510c3597ad3 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:29.121747 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2e6c6-fcbb-495c-a61a-6510c3597ad3 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:29.122109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2e6c6-fcbb-495c-a61a-6510c3597ad3 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:29.124603 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 191/380] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:29.133878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc4a51-d414-45ff-a779-6463d4bcde5c None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:29.134058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc4a51-d414-45ff-a779-6463d4bcde5c None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:29.134419 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc4a51-d414-45ff-a779-6463d4bcde5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:29.138941 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4326b-1f01-4f1d-8ce4-09630302b2b4 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:29.164596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-ebcc4a51-d414-45ff-a779-6463d4bcde5c None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:29.166134 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ebcc4a51-d414-45ff-a779-6463d4bcde5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:29.188280 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d8c62-5295-4b60-9228-d37461046a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:29.189322 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d8c62-5295-4b60-9228-d37461046a6b None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:29.189791 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d8c62-5295-4b60-9228-d37461046a6b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:29.190244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d8c62-5295-4b60-9228-d37461046a6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:29.191524 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d8c62-5295-4b60-9228-d37461046a6b None admin] RBAC: Adding query filter params (group.id=c243361d46834d4fac9a697faa1b2325, role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.project.id=7866f693106e4323a208242e01a5fef9) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:29.192027 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d8c62-5295-4b60-9228-d37461046a6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:29.194335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d8c62-5295-4b60-9228-d37461046a6b None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:29.203145 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 190/381] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 23 10:39:28 2022] GET /identity/v3/role_assignments?group.id=c243361d46834d4fac9a697faa1b2325&scope.project.id=7866f693106e4323a208242e01a5fef9&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:29.289219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 192/382] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:39:29.334827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d8c62-5295-4b60-9228-d37461046a6b None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:29.445166 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:29.470019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d8c62-5295-4b60-9228-d37461046a6b None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:29.514376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b414bc6-7eeb-450f-aff6-d3f540a32557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:29.515246 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b414bc6-7eeb-450f-aff6-d3f540a32557 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:29.515474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b414bc6-7eeb-450f-aff6-d3f540a32557 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:29.515757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b414bc6-7eeb-450f-aff6-d3f540a32557 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:29.532085 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b414bc6-7eeb-450f-aff6-d3f540a32557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:29.541395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-5b414bc6-7eeb-450f-aff6-d3f540a32557 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:29.541395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:29.541395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:29.541395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:29.541395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:29.541395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:29.541395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:29.541395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:29.541395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:29.541395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:29.541395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:29.541395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:29.541395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:29.541395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:29.541395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:29.541395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:29.542288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:29.542288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:29.542288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:29.542288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:29.542288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:29.542288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:29.542288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:29.542288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:29.542288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:29.542288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:29.542288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:29.542288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:29.542288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:29.542288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:29.542288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:29.542288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:29.543061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:29.543061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:29.543061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:29.543061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:29.543061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:29.543061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:29.543061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:29.543061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:29.543061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:29.543061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:29.543061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:29.543061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:29.543061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 191/383] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:29.553779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc4a51-d414-45ff-a779-6463d4bcde5c None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:29.644962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:29.690848 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc4a51-d414-45ff-a779-6463d4bcde5c None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:29.734962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce094d12-8a2d-4404-a979-34a2d6bdd946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:29.735569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce094d12-8a2d-4404-a979-34a2d6bdd946 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:29.735860 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce094d12-8a2d-4404-a979-34a2d6bdd946 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:29.736184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce094d12-8a2d-4404-a979-34a2d6bdd946 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:29.737049 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce094d12-8a2d-4404-a979-34a2d6bdd946 None admin] RBAC: Adding query filter params (name=member) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:29.737368 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce094d12-8a2d-4404-a979-34a2d6bdd946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:29.738961 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce094d12-8a2d-4404-a979-34a2d6bdd946 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:29.753659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 193/384] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:29.759150 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b414bc6-7eeb-450f-aff6-d3f540a32557 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:29.780222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239f680-658d-4a53-a51b-2ababa8b1075 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:29.780525 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239f680-658d-4a53-a51b-2ababa8b1075 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:29.780813 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239f680-658d-4a53-a51b-2ababa8b1075 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:29.782486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 194/385] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:39:29.787493 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31267b-142c-487b-9ce7-12148572f4b1 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:29.787788 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31267b-142c-487b-9ce7-12148572f4b1 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:29.788083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31267b-142c-487b-9ce7-12148572f4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:29.817481 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-1e31267b-142c-487b-9ce7-12148572f4b1 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:29.818687 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-1e31267b-142c-487b-9ce7-12148572f4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:29.902702 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 195/386] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:39:29.929121 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31267b-142c-487b-9ce7-12148572f4b1 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:29.974077 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b414bc6-7eeb-450f-aff6-d3f540a32557 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:30.026924 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c0db3-204b-4fa4-a329-1fa737cd9649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:30.028139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c0db3-204b-4fa4-a329-1fa737cd9649 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:30.029198 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c0db3-204b-4fa4-a329-1fa737cd9649 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:30.029965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c0db3-204b-4fa4-a329-1fa737cd9649 None admin] PATH_INFO: `/v3/groups/c01c574806804757bafcab2ca2a44c80` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:30.031389 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c0db3-204b-4fa4-a329-1fa737cd9649 None admin] RBAC: Authorizing `identity:get_group(group_id=c01c574806804757bafcab2ca2a44c80)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:30.032994 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:30.033514 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c0db3-204b-4fa4-a329-1fa737cd9649 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:30.038075 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 192/387] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 23 10:39:29 2022] GET /identity/v3/groups/c01c574806804757bafcab2ca2a44c80 => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:30.041766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c0db3-204b-4fa4-a329-1fa737cd9649 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:30.047388 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:30.075144 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31267b-142c-487b-9ce7-12148572f4b1 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:30.115193 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034ad37-689e-4462-9510-a5e836f2e7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:30.116012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034ad37-689e-4462-9510-a5e836f2e7f0 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:30.116300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034ad37-689e-4462-9510-a5e836f2e7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:30.116581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034ad37-689e-4462-9510-a5e836f2e7f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:30.128621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034ad37-689e-4462-9510-a5e836f2e7f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:30.145240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-b034ad37-689e-4462-9510-a5e836f2e7f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:30.145240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:30.145240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:30.145240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:30.145240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:30.145240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:30.145240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:30.145240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:30.145240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:30.145240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:30.145240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:30.145240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:30.145240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:30.145240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:30.145240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:30.145240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:30.146311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:30.146311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:30.146311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:30.146311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:30.146311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:30.146311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:30.146311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:30.146311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:30.146311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:30.146311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:30.146311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:30.146311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:30.146311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:30.146311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:30.146311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:30.146311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:30.147231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:30.147231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:30.147231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:30.147231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:30.147231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:30.147231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:30.147231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:30.147231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:30.147231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:30.147231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:30.147231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:30.147231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:30.147231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 196/388] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:39:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:39:30.149128 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034ad37-689e-4462-9510-a5e836f2e7f0 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:30.201932 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c0db3-204b-4fa4-a329-1fa737cd9649 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:30.276103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a7f74-e444-428b-9f11-7ea3756130a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:30.277074 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a7f74-e444-428b-9f11-7ea3756130a7 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:30.277302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a7f74-e444-428b-9f11-7ea3756130a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:30.277582 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a7f74-e444-428b-9f11-7ea3756130a7 None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:30.281099 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a7f74-e444-428b-9f11-7ea3756130a7 None admin] RBAC: Authorizing `identity:get_project(project_id=ab32a97afff44105a351deb0fa2e7609)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:30.282578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a7f74-e444-428b-9f11-7ea3756130a7 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:30.284514 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 193/389] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:30 2022] GET /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:30.290141 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a7f74-e444-428b-9f11-7ea3756130a7 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:30.354749 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034ad37-689e-4462-9510-a5e836f2e7f0 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:30.395008 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:30.398155 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:30.436962 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a7f74-e444-428b-9f11-7ea3756130a7 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:30.442743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cbfec-88f6-45cc-9cb0-c1849e2197db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:30.450135 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cbfec-88f6-45cc-9cb0-c1849e2197db None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:30.450135 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cbfec-88f6-45cc-9cb0-c1849e2197db None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:30.450135 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cbfec-88f6-45cc-9cb0-c1849e2197db None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:30.450135 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262cbfec-88f6-45cc-9cb0-c1849e2197db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:30.450135 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262cbfec-88f6-45cc-9cb0-c1849e2197db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:30.450135 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262cbfec-88f6-45cc-9cb0-c1849e2197db None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:30.463758 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 197/390] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:30.469905 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cbfec-88f6-45cc-9cb0-c1849e2197db None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:30.481227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd40ae0-631f-475a-9ce9-9163a279fce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:30.482182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd40ae0-631f-475a-9ce9-9163a279fce5 None admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:30.482460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd40ae0-631f-475a-9ce9-9163a279fce5 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:30.482770 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd40ae0-631f-475a-9ce9-9163a279fce5 None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609/groups/c01c574806804757bafcab2ca2a44c80/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:30.485301 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd40ae0-631f-475a-9ce9-9163a279fce5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab32a97afff44105a351deb0fa2e7609, group_id=c01c574806804757bafcab2ca2a44c80, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:30.486741 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd40ae0-631f-475a-9ce9-9163a279fce5 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:30.568654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 194/391] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jun 23 10:39:30 2022] PUT /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609/groups/c01c574806804757bafcab2ca2a44c80/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:39:30.599473 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cbfec-88f6-45cc-9cb0-c1849e2197db None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:30.637160 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb5ede-305a-432f-8e45-76fffef7401f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:30.638573 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb5ede-305a-432f-8e45-76fffef7401f None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:30.638956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb5ede-305a-432f-8e45-76fffef7401f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:30.639449 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb5ede-305a-432f-8e45-76fffef7401f None admin] PATH_INFO: `/v3/groups/c01c574806804757bafcab2ca2a44c80` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:30.640785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb5ede-305a-432f-8e45-76fffef7401f None admin] RBAC: Authorizing `identity:get_group(group_id=c01c574806804757bafcab2ca2a44c80)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:30.642242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb5ede-305a-432f-8e45-76fffef7401f None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:30.644257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 198/392] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 23 10:39:30 2022] GET /identity/v3/groups/c01c574806804757bafcab2ca2a44c80 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:30.649591 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd40ae0-631f-475a-9ce9-9163a279fce5 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:30.724191 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a105b-d30d-46e5-a6fc-03c17407c53d None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:30.724511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a105b-d30d-46e5-a6fc-03c17407c53d None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:30.724787 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a105b-d30d-46e5-a6fc-03c17407c53d None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:30.726589 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 199/393] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:39:30.732133 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca62628-dce5-4bbd-af4c-e155eb0fdfb1 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:30.732648 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca62628-dce5-4bbd-af4c-e155eb0fdfb1 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:30.733052 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca62628-dce5-4bbd-af4c-e155eb0fdfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:30.752304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-dca62628-dce5-4bbd-af4c-e155eb0fdfb1 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:30.753877 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-dca62628-dce5-4bbd-af4c-e155eb0fdfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:30.801731 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:30.805328 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd40ae0-631f-475a-9ce9-9163a279fce5 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:30.830840 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 200/394] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:39:30.856554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca62628-dce5-4bbd-af4c-e155eb0fdfb1 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:30.867317 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:30.878633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001541b-71f6-4565-a4c1-1a4a24edc427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:30.881798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001541b-71f6-4565-a4c1-1a4a24edc427 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:30.881798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001541b-71f6-4565-a4c1-1a4a24edc427 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:30.881798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001541b-71f6-4565-a4c1-1a4a24edc427 None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:30.881798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001541b-71f6-4565-a4c1-1a4a24edc427 None admin] RBAC: Authorizing `identity:get_project(project_id=ab32a97afff44105a351deb0fa2e7609)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:30.882777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001541b-71f6-4565-a4c1-1a4a24edc427 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:30.884810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 195/395] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:30 2022] GET /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:30.890902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001541b-71f6-4565-a4c1-1a4a24edc427 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:30.991946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca62628-dce5-4bbd-af4c-e155eb0fdfb1 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:31.042055 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f035ff-027a-4d9b-a824-358a43b68d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:31.043282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f035ff-027a-4d9b-a824-358a43b68d91 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:31.043779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f035ff-027a-4d9b-a824-358a43b68d91 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:31.044840 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f035ff-027a-4d9b-a824-358a43b68d91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:31.056694 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001541b-71f6-4565-a4c1-1a4a24edc427 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:31.062722 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f035ff-027a-4d9b-a824-358a43b68d91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:31.077871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-a1f035ff-027a-4d9b-a824-358a43b68d91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:31.077871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:31.077871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:31.077871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:31.077871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:31.077871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:31.077871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:31.077871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:31.077871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:31.077871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:31.077871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:31.077871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:31.077871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:31.077871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:31.077871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:31.077871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:31.078823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:31.078823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:31.078823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:31.078823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:31.078823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:31.078823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:31.078823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:31.078823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:31.078823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:31.078823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:31.078823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:31.078823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:31.078823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:31.078823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:31.078823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:31.078823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:31.079636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:31.079636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:31.079636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:31.079636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:31.079636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:31.079636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:31.079636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:31.079636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:31.079636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:31.079636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:31.079636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:31.079636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:31.082513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 201/396] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:31.099110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f035ff-027a-4d9b-a824-358a43b68d91 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:31.102435 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76463a-e66e-4d9b-a61a-b453a1f7b89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:31.103558 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76463a-e66e-4d9b-a61a-b453a1f7b89c None admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:31.103729 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76463a-e66e-4d9b-a61a-b453a1f7b89c None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:31.104103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76463a-e66e-4d9b-a61a-b453a1f7b89c None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609/groups/c01c574806804757bafcab2ca2a44c80/roles/f86a1d8dfb24430a98414eab048c4be9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:31.106484 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76463a-e66e-4d9b-a61a-b453a1f7b89c None admin] RBAC: Authorizing `identity:create_grant(project_id=ab32a97afff44105a351deb0fa2e7609, group_id=c01c574806804757bafcab2ca2a44c80, role_id=f86a1d8dfb24430a98414eab048c4be9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:31.108175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76463a-e66e-4d9b-a61a-b453a1f7b89c None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:31.146295 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:31.202446 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 196/397] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jun 23 10:39:30 2022] PUT /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609/groups/c01c574806804757bafcab2ca2a44c80/roles/f86a1d8dfb24430a98414eab048c4be9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:39:31.224320 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f035ff-027a-4d9b-a824-358a43b68d91 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:31.272142 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f88fd-e9f1-447b-8e32-a785b005b823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:31.273438 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f88fd-e9f1-447b-8e32-a785b005b823 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:31.274127 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f88fd-e9f1-447b-8e32-a785b005b823 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:31.274833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f88fd-e9f1-447b-8e32-a785b005b823 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:31.276411 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f88fd-e9f1-447b-8e32-a785b005b823 None admin] RBAC: Adding query filter params (name=member) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:31.277039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f88fd-e9f1-447b-8e32-a785b005b823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:31.279269 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f88fd-e9f1-447b-8e32-a785b005b823 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:31.295514 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 202/398] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:31.300878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76463a-e66e-4d9b-a61a-b453a1f7b89c None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:31.400096 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:31.451135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76463a-e66e-4d9b-a61a-b453a1f7b89c None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:31.496194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6654c17-d2e1-4878-b453-826130947afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:31.497118 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6654c17-d2e1-4878-b453-826130947afb None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:31.497453 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6654c17-d2e1-4878-b453-826130947afb None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:31.497729 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6654c17-d2e1-4878-b453-826130947afb None admin] PATH_INFO: `/v3/groups/c01c574806804757bafcab2ca2a44c80` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:31.498932 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6654c17-d2e1-4878-b453-826130947afb None admin] RBAC: Authorizing `identity:get_group(group_id=c01c574806804757bafcab2ca2a44c80)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:31.500383 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6654c17-d2e1-4878-b453-826130947afb None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:31.502372 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 197/399] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 23 10:39:31 2022] GET /identity/v3/groups/c01c574806804757bafcab2ca2a44c80 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:31.509715 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f88fd-e9f1-447b-8e32-a785b005b823 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:31.687156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:31.692205 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f88fd-e9f1-447b-8e32-a785b005b823 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:31.748471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d12b49-e0df-4827-b318-5ecf9a21c2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:31.749382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d12b49-e0df-4827-b318-5ecf9a21c2fe None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:31.749671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d12b49-e0df-4827-b318-5ecf9a21c2fe None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:31.749951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d12b49-e0df-4827-b318-5ecf9a21c2fe None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:31.751184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d12b49-e0df-4827-b318-5ecf9a21c2fe None admin] RBAC: Authorizing `identity:get_project(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:31.752612 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d12b49-e0df-4827-b318-5ecf9a21c2fe None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:31.755838 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 203/400] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:31 2022] GET /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:31.760861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6654c17-d2e1-4878-b453-826130947afb None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:31.910995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6654c17-d2e1-4878-b453-826130947afb None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:31.943476 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:31.955413 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72353c2f-eddc-422c-8640-dd42006940b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:31.958087 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72353c2f-eddc-422c-8640-dd42006940b0 None admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:31.958087 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72353c2f-eddc-422c-8640-dd42006940b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:31.958087 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72353c2f-eddc-422c-8640-dd42006940b0 None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf/groups/c01c574806804757bafcab2ca2a44c80/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:31.958855 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72353c2f-eddc-422c-8640-dd42006940b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf, group_id=c01c574806804757bafcab2ca2a44c80, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:31.960480 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72353c2f-eddc-422c-8640-dd42006940b0 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:32.028534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f205d-dd77-44cf-af34-f61ca75132b3 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:32.028959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f205d-dd77-44cf-af34-f61ca75132b3 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:32.029204 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f205d-dd77-44cf-af34-f61ca75132b3 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:32.030677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 204/401] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:32.035671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f53b93-eb15-4fc4-a0c9-6c4e445069e2 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:32.038362 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f53b93-eb15-4fc4-a0c9-6c4e445069e2 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:32.038362 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f53b93-eb15-4fc4-a0c9-6c4e445069e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:32.054334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-39f53b93-eb15-4fc4-a0c9-6c4e445069e2 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:32.055523 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-39f53b93-eb15-4fc4-a0c9-6c4e445069e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:32.066412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 198/402] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jun 23 10:39:31 2022] PUT /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf/groups/c01c574806804757bafcab2ca2a44c80/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:39:32.149630 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 205/403] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:39:32.196247 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72353c2f-eddc-422c-8640-dd42006940b0 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:32.324233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72353c2f-eddc-422c-8640-dd42006940b0 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:32.342107 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c0b0b-e60f-43d6-9a06-12a8fe9abe33 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:32.342434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c0b0b-e60f-43d6-9a06-12a8fe9abe33 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:32.342676 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c0b0b-e60f-43d6-9a06-12a8fe9abe33 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:32.344317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 206/404] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:32.349444 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e992c2-1019-4a54-9119-0be5c80c3791 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:32.349742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e992c2-1019-4a54-9119-0be5c80c3791 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:32.350029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e992c2-1019-4a54-9119-0be5c80c3791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:32.369277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66cb3c-d6d1-4f29-bd5a-8c6d7bea6454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:32.370094 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66cb3c-d6d1-4f29-bd5a-8c6d7bea6454 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:32.370379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66cb3c-d6d1-4f29-bd5a-8c6d7bea6454 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:32.370655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66cb3c-d6d1-4f29-bd5a-8c6d7bea6454 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:32.372013 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-c6e992c2-1019-4a54-9119-0be5c80c3791 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:32.373804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c6e992c2-1019-4a54-9119-0be5c80c3791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:32.387954 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66cb3c-d6d1-4f29-bd5a-8c6d7bea6454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:32.397362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-8c66cb3c-d6d1-4f29-bd5a-8c6d7bea6454 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:32.397362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:32.397362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:32.397362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:32.397362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:32.397362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:32.397362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:32.397362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:32.397362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:32.397362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:32.397362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:32.397362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:32.397362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:32.397362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:32.397362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:32.397362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:32.398441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:32.398441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:32.398441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:32.398441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:32.398441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:32.398441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:32.398441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:32.398441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:32.398441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:32.398441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:32.398441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:32.398441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:32.398441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:32.398441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:32.398441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:32.398441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:32.399506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:32.399506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:32.399506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:32.399506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:32.399506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:32.399506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:32.399506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:32.399506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:32.399506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:32.399506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:32.399506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:32.399506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:32.399506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 199/405] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:39:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:32.406401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66cb3c-d6d1-4f29-bd5a-8c6d7bea6454 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:32.455399 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 207/406] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:39:32.479577 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e992c2-1019-4a54-9119-0be5c80c3791 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:32.491716 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:32.525151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:32.593472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e992c2-1019-4a54-9119-0be5c80c3791 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:32.603957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66cb3c-d6d1-4f29-bd5a-8c6d7bea6454 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:32.633666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21728f9-42af-4121-ae03-79d54ccfcf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:32.634883 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21728f9-42af-4121-ae03-79d54ccfcf09 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:32.635317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21728f9-42af-4121-ae03-79d54ccfcf09 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:32.635914 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21728f9-42af-4121-ae03-79d54ccfcf09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:32.648359 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21728f9-42af-4121-ae03-79d54ccfcf09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:32.657839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-d21728f9-42af-4121-ae03-79d54ccfcf09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:32.657839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:32.657839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:32.657839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:32.657839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:32.657839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:32.657839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:32.657839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:32.657839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:32.657839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:32.657839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:32.657839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:32.657839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:32.657839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:32.657839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:32.657839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:32.658957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:32.658957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:32.658957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:32.658957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:32.658957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:32.658957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:32.658957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:32.658957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:32.658957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:32.658957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:32.658957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:32.658957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:32.658957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:32.658957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:32.658957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:32.658957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:32.659942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:32.659942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:32.659942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:32.659942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:32.659942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:32.659942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:32.659942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:32.659942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:32.659942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:32.659942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:32.659942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:32.659942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:32.661898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 208/407] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:39:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:39:32.668140 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21728f9-42af-4121-ae03-79d54ccfcf09 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:32.698519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36953f4-637f-47f3-8a37-e7b225a604e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:32.699169 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36953f4-637f-47f3-8a37-e7b225a604e7 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:32.699465 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36953f4-637f-47f3-8a37-e7b225a604e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:32.699748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36953f4-637f-47f3-8a37-e7b225a604e7 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:32.700568 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36953f4-637f-47f3-8a37-e7b225a604e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:32.701159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36953f4-637f-47f3-8a37-e7b225a604e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:32.702948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36953f4-637f-47f3-8a37-e7b225a604e7 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:32.725180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 200/408] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:32.730897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36953f4-637f-47f3-8a37-e7b225a604e7 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:32.784321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21728f9-42af-4121-ae03-79d54ccfcf09 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:32.786564 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:32.825648 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44515a-5199-4143-8288-2f6122104a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:32.826809 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44515a-5199-4143-8288-2f6122104a17 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:32.827201 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44515a-5199-4143-8288-2f6122104a17 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:32.831808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44515a-5199-4143-8288-2f6122104a17 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:32.831808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44515a-5199-4143-8288-2f6122104a17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:32.831808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44515a-5199-4143-8288-2f6122104a17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:32.831808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44515a-5199-4143-8288-2f6122104a17 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:32.845056 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 209/409] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:32.847527 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44515a-5199-4143-8288-2f6122104a17 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:32.934339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36953f4-637f-47f3-8a37-e7b225a604e7 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:32.969113 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:33.026062 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39645758-b137-4c08-b27a-14459b3d64f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:33.026858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39645758-b137-4c08-b27a-14459b3d64f7 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:33.027144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39645758-b137-4c08-b27a-14459b3d64f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:33.027420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39645758-b137-4c08-b27a-14459b3d64f7 None admin] PATH_INFO: `/v3/groups/c01c574806804757bafcab2ca2a44c80` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:33.029853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39645758-b137-4c08-b27a-14459b3d64f7 None admin] RBAC: Authorizing `identity:get_group(group_id=c01c574806804757bafcab2ca2a44c80)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:33.031339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39645758-b137-4c08-b27a-14459b3d64f7 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:33.037448 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 201/410] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 23 10:39:32 2022] GET /identity/v3/groups/c01c574806804757bafcab2ca2a44c80 => generated 226 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:33.040730 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44515a-5199-4143-8288-2f6122104a17 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:33.045892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39645758-b137-4c08-b27a-14459b3d64f7 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:33.090348 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6548961-9f36-4760-966d-a0b55dfc205b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:33.091653 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6548961-9f36-4760-966d-a0b55dfc205b None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:33.091935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6548961-9f36-4760-966d-a0b55dfc205b None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:33.092214 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6548961-9f36-4760-966d-a0b55dfc205b None admin] PATH_INFO: `/v3/groups/c243361d46834d4fac9a697faa1b2325` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:33.096486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6548961-9f36-4760-966d-a0b55dfc205b None admin] RBAC: Authorizing `identity:get_group(group_id=c243361d46834d4fac9a697faa1b2325)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:33.098438 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6548961-9f36-4760-966d-a0b55dfc205b None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:33.103109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 210/411] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 23 10:39:32 2022] GET /identity/v3/groups/c243361d46834d4fac9a697faa1b2325 => generated 229 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:33.107740 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6548961-9f36-4760-966d-a0b55dfc205b None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:33.146860 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:33.239618 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39645758-b137-4c08-b27a-14459b3d64f7 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:33.254969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6548961-9f36-4760-966d-a0b55dfc205b None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:33.278611 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fc60c-a135-4e6b-88ac-c83d4a76e341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:33.279495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fc60c-a135-4e6b-88ac-c83d4a76e341 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:33.279874 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fc60c-a135-4e6b-88ac-c83d4a76e341 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:33.280168 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fc60c-a135-4e6b-88ac-c83d4a76e341 None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:33.281430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fc60c-a135-4e6b-88ac-c83d4a76e341 None admin] RBAC: Authorizing `identity:get_project(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:33.283135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fc60c-a135-4e6b-88ac-c83d4a76e341 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:33.285331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 202/412] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:33 2022] GET /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:33.286739 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f8f27-61af-454f-afed-16d2ac57c088 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:33.287036 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f8f27-61af-454f-afed-16d2ac57c088 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:33.287318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f8f27-61af-454f-afed-16d2ac57c088 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:33.288814 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 203/413] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:33.290443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f8f27-61af-454f-afed-16d2ac57c088 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:33.295435 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06815dd7-0e73-4675-8ba8-aff6214464f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:33.296318 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06815dd7-0e73-4675-8ba8-aff6214464f8 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:33.296598 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06815dd7-0e73-4675-8ba8-aff6214464f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:33.296905 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06815dd7-0e73-4675-8ba8-aff6214464f8 None admin] PATH_INFO: `/v3/projects/7866f693106e4323a208242e01a5fef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:33.298134 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06815dd7-0e73-4675-8ba8-aff6214464f8 None admin] RBAC: Authorizing `identity:get_project(project_id=7866f693106e4323a208242e01a5fef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:33.299575 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06815dd7-0e73-4675-8ba8-aff6214464f8 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:33.301634 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 211/414] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:33 2022] GET /identity/v3/projects/7866f693106e4323a208242e01a5fef9 => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:33.302908 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed5f86-4c92-4347-b8d6-035feece2fbc None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:33.303196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed5f86-4c92-4347-b8d6-035feece2fbc None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:33.303475 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed5f86-4c92-4347-b8d6-035feece2fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:33.320846 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-cfed5f86-4c92-4347-b8d6-035feece2fbc None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:33.322046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-cfed5f86-4c92-4347-b8d6-035feece2fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:33.345194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:33.400768 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 212/415] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:33.401663 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed5f86-4c92-4347-b8d6-035feece2fbc None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:33.407114 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f8f27-61af-454f-afed-16d2ac57c088 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:33.425962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:33.444366 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f2b37-2032-47e1-9372-45a353bf620d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:33.445578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f2b37-2032-47e1-9372-45a353bf620d None admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:33.446024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f2b37-2032-47e1-9372-45a353bf620d None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:33.446461 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f2b37-2032-47e1-9372-45a353bf620d None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf/groups/c01c574806804757bafcab2ca2a44c80/roles/f86a1d8dfb24430a98414eab048c4be9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:33.449003 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f2b37-2032-47e1-9372-45a353bf620d None admin] RBAC: Authorizing `identity:create_grant(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf, group_id=c01c574806804757bafcab2ca2a44c80, role_id=f86a1d8dfb24430a98414eab048c4be9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:33.451211 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f2b37-2032-47e1-9372-45a353bf620d None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:33.520984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed5f86-4c92-4347-b8d6-035feece2fbc None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:33.531735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 204/416] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jun 23 10:39:33 2022] PUT /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf/groups/c01c574806804757bafcab2ca2a44c80/roles/f86a1d8dfb24430a98414eab048c4be9 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:39:33.533500 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f2b37-2032-47e1-9372-45a353bf620d None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:33.605475 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb064f-9d2a-4007-b019-6bff5268d3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:33.606419 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb064f-9d2a-4007-b019-6bff5268d3c1 None admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:33.607243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb064f-9d2a-4007-b019-6bff5268d3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:33.607584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb064f-9d2a-4007-b019-6bff5268d3c1 None admin] PATH_INFO: `/v3/projects/7866f693106e4323a208242e01a5fef9/groups/c243361d46834d4fac9a697faa1b2325/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:33.613610 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb064f-9d2a-4007-b019-6bff5268d3c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7866f693106e4323a208242e01a5fef9, group_id=c243361d46834d4fac9a697faa1b2325, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:33.616591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb064f-9d2a-4007-b019-6bff5268d3c1 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:33.662808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f2b37-2032-47e1-9372-45a353bf620d None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:33.671800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:33.704235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13174dbe-facd-499f-b114-256617c68df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:33.705205 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13174dbe-facd-499f-b114-256617c68df4 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:33.705870 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13174dbe-facd-499f-b114-256617c68df4 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:33.706184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13174dbe-facd-499f-b114-256617c68df4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:33.719007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13174dbe-facd-499f-b114-256617c68df4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:33.726769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-13174dbe-facd-499f-b114-256617c68df4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:33.726769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:33.726769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:33.726769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:33.726769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:33.726769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:33.726769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:33.726769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:33.726769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:33.726769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:33.726769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:33.726769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:33.726769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:33.726769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:33.726769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:33.726769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:33.727926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:33.727926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:33.727926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:33.727926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:33.727926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:33.727926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:33.727926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:33.727926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:33.727926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:33.727926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:33.727926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:33.727926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:33.727926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:33.727926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:33.727926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:33.727926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:33.729006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:33.729006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:33.729006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:33.729006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:33.729006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:33.729006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:33.729006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:33.729006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:33.729006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:33.729006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:33.729006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:33.729006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:33.729006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 205/417] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:33.734579 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13174dbe-facd-499f-b114-256617c68df4 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:33.795799 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 213/418] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jun 23 10:39:33 2022] PUT /identity/v3/projects/7866f693106e4323a208242e01a5fef9/groups/c243361d46834d4fac9a697faa1b2325/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:39:33.867840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13174dbe-facd-499f-b114-256617c68df4 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:33.923640 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c4c94-f475-421d-865e-f5ffb2e88796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:33.924382 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c4c94-f475-421d-865e-f5ffb2e88796 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:33.924690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c4c94-f475-421d-865e-f5ffb2e88796 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:33.924975 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c4c94-f475-421d-865e-f5ffb2e88796 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:33.925747 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c4c94-f475-421d-865e-f5ffb2e88796 None admin] RBAC: Adding query filter params (name=member) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:33.926058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c4c94-f475-421d-865e-f5ffb2e88796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:33.927442 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c4c94-f475-421d-865e-f5ffb2e88796 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:33.944296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 206/419] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:33.946929 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e9f52-e6e4-4d2d-86b9-5cf3aca013cc None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:33.947216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e9f52-e6e4-4d2d-86b9-5cf3aca013cc None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:33.947493 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e9f52-e6e4-4d2d-86b9-5cf3aca013cc None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:33.950075 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 214/420] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:33.954858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c4c94-f475-421d-865e-f5ffb2e88796 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:33.955428 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6ee16-8b37-48a4-b691-309edc7babfc None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:33.955721 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6ee16-8b37-48a4-b691-309edc7babfc None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:33.956000 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6ee16-8b37-48a4-b691-309edc7babfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:33.973003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-c6d6ee16-8b37-48a4-b691-309edc7babfc None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:33.974200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c6d6ee16-8b37-48a4-b691-309edc7babfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:33.999176 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:34.096515 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 215/421] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:34.113575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c4c94-f475-421d-865e-f5ffb2e88796 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:34.121480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6ee16-8b37-48a4-b691-309edc7babfc None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:34.132864 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:34.159274 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bf5ce-a2a1-4ac6-a12d-e206d02381be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:34.160519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bf5ce-a2a1-4ac6-a12d-e206d02381be None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:34.160846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bf5ce-a2a1-4ac6-a12d-e206d02381be None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:34.161133 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bf5ce-a2a1-4ac6-a12d-e206d02381be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:34.243080 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bf5ce-a2a1-4ac6-a12d-e206d02381be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:34.244565 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bf5ce-a2a1-4ac6-a12d-e206d02381be None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:34.275190 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:34.318858 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6ee16-8b37-48a4-b691-309edc7babfc None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:34.380820 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 207/422] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:34.384833 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bf5ce-a2a1-4ac6-a12d-e206d02381be None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:34.387647 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e665bae-cb08-453b-ac7e-7b9dabce429f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:34.389072 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e665bae-cb08-453b-ac7e-7b9dabce429f None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:34.389356 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e665bae-cb08-453b-ac7e-7b9dabce429f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:34.389630 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e665bae-cb08-453b-ac7e-7b9dabce429f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:34.421714 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e665bae-cb08-453b-ac7e-7b9dabce429f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:34.439215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-3e665bae-cb08-453b-ac7e-7b9dabce429f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:34.439215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:34.439215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:34.439215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:34.439215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:34.439215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:34.439215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:34.439215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:34.439215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:34.439215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:34.439215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:34.439215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:34.439215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:34.439215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:34.439215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:34.439215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:34.440339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:34.440339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:34.440339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:34.440339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:34.440339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:34.440339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:34.440339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:34.440339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:34.440339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:34.440339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:34.440339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:34.440339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:34.440339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:34.440339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:34.440339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:34.440339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:34.441323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:34.441323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:34.441323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:34.441323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:34.441323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:34.441323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:34.441323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:34.441323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:34.441323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:34.441323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:34.441323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:34.441323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:34.441323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 216/423] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:39:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:39:34.447729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e665bae-cb08-453b-ac7e-7b9dabce429f None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:34.523495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bf5ce-a2a1-4ac6-a12d-e206d02381be None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:34.548048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:34.581629 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:34.588309 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e665bae-cb08-453b-ac7e-7b9dabce429f None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:34.605896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f753ab3-7b31-4e50-81e0-94614076f251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:34.607441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f753ab3-7b31-4e50-81e0-94614076f251 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:34.607814 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f753ab3-7b31-4e50-81e0-94614076f251 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:34.611117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f753ab3-7b31-4e50-81e0-94614076f251 None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:34.611908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f753ab3-7b31-4e50-81e0-94614076f251 None admin] RBAC: Authorizing `identity:get_project(project_id=ab32a97afff44105a351deb0fa2e7609)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:34.614115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f753ab3-7b31-4e50-81e0-94614076f251 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:34.622921 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 208/424] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:34 2022] GET /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:34.628691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a03ae-7ec6-4b17-8ac2-08fb64c93a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:34.628691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a03ae-7ec6-4b17-8ac2-08fb64c93a3e None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:34.628691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a03ae-7ec6-4b17-8ac2-08fb64c93a3e None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:34.628691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a03ae-7ec6-4b17-8ac2-08fb64c93a3e None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:34.629016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a03ae-7ec6-4b17-8ac2-08fb64c93a3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:34.629228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a03ae-7ec6-4b17-8ac2-08fb64c93a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:34.629603 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f753ab3-7b31-4e50-81e0-94614076f251 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:34.630515 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a03ae-7ec6-4b17-8ac2-08fb64c93a3e None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:34.643272 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 217/425] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:34.649065 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a03ae-7ec6-4b17-8ac2-08fb64c93a3e None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:34.755020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a03ae-7ec6-4b17-8ac2-08fb64c93a3e None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:34.793119 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:34.809332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cc61c-f9ec-4090-88e4-d44a6c057d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:34.810662 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cc61c-f9ec-4090-88e4-d44a6c057d4b None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:34.811772 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cc61c-f9ec-4090-88e4-d44a6c057d4b None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:34.811772 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cc61c-f9ec-4090-88e4-d44a6c057d4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:34.828683 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f753ab3-7b31-4e50-81e0-94614076f251 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:34.895554 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49322c9-1993-413b-be09-d492e30df614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:34.896346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49322c9-1993-413b-be09-d492e30df614 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:34.896624 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49322c9-1993-413b-be09-d492e30df614 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:34.896924 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49322c9-1993-413b-be09-d492e30df614 None admin] PATH_INFO: `/v3/groups/c01c574806804757bafcab2ca2a44c80` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:34.898184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49322c9-1993-413b-be09-d492e30df614 None admin] RBAC: Authorizing `identity:get_group(group_id=c01c574806804757bafcab2ca2a44c80)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:34.899636 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49322c9-1993-413b-be09-d492e30df614 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:34.906144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 209/426] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 23 10:39:34 2022] GET /identity/v3/groups/c01c574806804757bafcab2ca2a44c80 => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:34.907491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec1271-c552-4d7b-9452-ce52efdc66ba None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:34.907779 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec1271-c552-4d7b-9452-ce52efdc66ba None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:34.908058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec1271-c552-4d7b-9452-ce52efdc66ba None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:34.909830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 210/427] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:34.914504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec1271-c552-4d7b-9452-ce52efdc66ba None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:34.926600 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cc61c-f9ec-4090-88e4-d44a6c057d4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:34.928783 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cc61c-f9ec-4090-88e4-d44a6c057d4b None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:34.999591 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:35.036732 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 218/428] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:35.038075 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6633a1-7d6a-4d48-8958-07bb398c2879 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:35.038364 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6633a1-7d6a-4d48-8958-07bb398c2879 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:35.038647 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6633a1-7d6a-4d48-8958-07bb398c2879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:35.054312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec1271-c552-4d7b-9452-ce52efdc66ba None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:35.059728 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-ff6633a1-7d6a-4d48-8958-07bb398c2879 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:35.061923 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ff6633a1-7d6a-4d48-8958-07bb398c2879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:35.088284 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:35.098442 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ce125-ed59-4ec5-bbd6-69a86c5434f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:35.098442 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ce125-ed59-4ec5-bbd6-69a86c5434f1 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:35.098875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ce125-ed59-4ec5-bbd6-69a86c5434f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:35.099164 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ce125-ed59-4ec5-bbd6-69a86c5434f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:35.102882 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ce125-ed59-4ec5-bbd6-69a86c5434f1 None admin] RBAC: Adding query filter params (group.id=c01c574806804757bafcab2ca2a44c80, role.id=14edb03a6a644798bdbf762bb59f6ef9, scope.project.id=ab32a97afff44105a351deb0fa2e7609) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:35.102882 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ce125-ed59-4ec5-bbd6-69a86c5434f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:35.102882 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ce125-ed59-4ec5-bbd6-69a86c5434f1 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:35.114658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 211/429] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 23 10:39:34 2022] GET /identity/v3/role_assignments?group.id=c01c574806804757bafcab2ca2a44c80&scope.project.id=ab32a97afff44105a351deb0fa2e7609&role.id=14edb03a6a644798bdbf762bb59f6ef9 => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:35.115500 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ce125-ed59-4ec5-bbd6-69a86c5434f1 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:35.182133 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 219/430] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:35.246974 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6633a1-7d6a-4d48-8958-07bb398c2879 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:35.303014 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ce125-ed59-4ec5-bbd6-69a86c5434f1 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:35.351450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:35.362002 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6100dc-4fe6-475c-b311-be1ef1a9e20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:35.362771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6100dc-4fe6-475c-b311-be1ef1a9e20f None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:35.363069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6100dc-4fe6-475c-b311-be1ef1a9e20f None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:35.363380 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6100dc-4fe6-475c-b311-be1ef1a9e20f None admin] PATH_INFO: `/v3/projects/ab32a97afff44105a351deb0fa2e7609` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:35.365039 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6100dc-4fe6-475c-b311-be1ef1a9e20f None admin] RBAC: Authorizing `identity:get_project(project_id=ab32a97afff44105a351deb0fa2e7609)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:35.367686 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6100dc-4fe6-475c-b311-be1ef1a9e20f None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:35.371769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 212/431] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:35 2022] GET /identity/v3/projects/ab32a97afff44105a351deb0fa2e7609 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:35.379317 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6100dc-4fe6-475c-b311-be1ef1a9e20f None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:35.406805 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6633a1-7d6a-4d48-8958-07bb398c2879 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:35.445750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c00535-a7d1-4ce3-942d-485a8daf8d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:35.446483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c00535-a7d1-4ce3-942d-485a8daf8d53 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:35.446782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c00535-a7d1-4ce3-942d-485a8daf8d53 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:35.447053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c00535-a7d1-4ce3-942d-485a8daf8d53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:35.458959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c00535-a7d1-4ce3-942d-485a8daf8d53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:35.467106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-40c00535-a7d1-4ce3-942d-485a8daf8d53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:35.467106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:35.467106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:35.467106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:35.467106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:35.467106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:35.467106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:35.467106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:35.467106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:35.467106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:35.467106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:35.467106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:35.467106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:35.467106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:35.467106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:35.467106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:35.468010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:35.468010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:35.468010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:35.468010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:35.468010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:35.468010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:35.468010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:35.468010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:35.468010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:35.468010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:35.468010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:35.468010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:35.468010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:35.468010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:35.468010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:35.468010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:35.469242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:35.469242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:35.469242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:35.469242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:35.469242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:35.469242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:35.469242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:35.469242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:35.469242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:35.469242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:35.469242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:39:35.469242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:35.469242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 220/432] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:39:35.474200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c00535-a7d1-4ce3-942d-485a8daf8d53 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:35.491321 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6100dc-4fe6-475c-b311-be1ef1a9e20f None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:35.496348 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:35.530458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba6145-3a59-4fc6-a7b8-3ac9c8dd833a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:35.531695 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba6145-3a59-4fc6-a7b8-3ac9c8dd833a None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:35.532187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba6145-3a59-4fc6-a7b8-3ac9c8dd833a None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:35.532679 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba6145-3a59-4fc6-a7b8-3ac9c8dd833a None admin] PATH_INFO: `/v3/groups/c01c574806804757bafcab2ca2a44c80` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:35.534099 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba6145-3a59-4fc6-a7b8-3ac9c8dd833a None admin] RBAC: Authorizing `identity:get_group(group_id=c01c574806804757bafcab2ca2a44c80)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:35.535732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba6145-3a59-4fc6-a7b8-3ac9c8dd833a None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:35.540927 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 213/433] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 23 10:39:35 2022] GET /identity/v3/groups/c01c574806804757bafcab2ca2a44c80 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:35.543986 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba6145-3a59-4fc6-a7b8-3ac9c8dd833a None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:35.590296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c00535-a7d1-4ce3-942d-485a8daf8d53 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:35.631257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070de02d-118d-4eb4-a63e-ac8eb433babb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:35.631947 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070de02d-118d-4eb4-a63e-ac8eb433babb None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:35.632235 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070de02d-118d-4eb4-a63e-ac8eb433babb None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:35.632518 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070de02d-118d-4eb4-a63e-ac8eb433babb None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:35.633143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:35.633418 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070de02d-118d-4eb4-a63e-ac8eb433babb None admin] RBAC: Adding query filter params (name=member) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:35.633738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070de02d-118d-4eb4-a63e-ac8eb433babb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:35.635137 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070de02d-118d-4eb4-a63e-ac8eb433babb None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:35.646154 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 221/434] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:39:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:35.651714 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070de02d-118d-4eb4-a63e-ac8eb433babb None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:35.658126 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba6145-3a59-4fc6-a7b8-3ac9c8dd833a None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:35.695856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef67886-0c3e-4cb3-976a-8ac1591b1878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:35.696490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef67886-0c3e-4cb3-976a-8ac1591b1878 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:35.696912 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef67886-0c3e-4cb3-976a-8ac1591b1878 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:35.697200 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef67886-0c3e-4cb3-976a-8ac1591b1878 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:35.698263 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef67886-0c3e-4cb3-976a-8ac1591b1878 None admin] RBAC: Adding query filter params (group.id=c01c574806804757bafcab2ca2a44c80, role.id=f86a1d8dfb24430a98414eab048c4be9, scope.project.id=ab32a97afff44105a351deb0fa2e7609) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:35.698587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef67886-0c3e-4cb3-976a-8ac1591b1878 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:35.700301 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef67886-0c3e-4cb3-976a-8ac1591b1878 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:35.712781 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 214/435] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 23 10:39:35 2022] GET /identity/v3/role_assignments?group.id=c01c574806804757bafcab2ca2a44c80&scope.project.id=ab32a97afff44105a351deb0fa2e7609&role.id=f86a1d8dfb24430a98414eab048c4be9 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:35.745050 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:35.772515 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070de02d-118d-4eb4-a63e-ac8eb433babb None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:35.813491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800abeb1-5bfd-4ae6-a65b-b2bb499a8430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:35.814151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800abeb1-5bfd-4ae6-a65b-b2bb499a8430 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:35.814446 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800abeb1-5bfd-4ae6-a65b-b2bb499a8430 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:35.814730 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800abeb1-5bfd-4ae6-a65b-b2bb499a8430 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:35.891793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800abeb1-5bfd-4ae6-a65b-b2bb499a8430 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:35.893322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800abeb1-5bfd-4ae6-a65b-b2bb499a8430 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:35.938497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5813-0edc-4712-9331-21cb4b80de6f None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:35.938785 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5813-0edc-4712-9331-21cb4b80de6f None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:35.939069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5813-0edc-4712-9331-21cb4b80de6f None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:35.941001 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 215/436] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:39:35.946958 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9396a3-a705-4a3e-8edd-5dea16addeca None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:35.947196 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9396a3-a705-4a3e-8edd-5dea16addeca None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:35.947463 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9396a3-a705-4a3e-8edd-5dea16addeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:35.978433 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-2c9396a3-a705-4a3e-8edd-5dea16addeca None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:35.980004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-2c9396a3-a705-4a3e-8edd-5dea16addeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:35.999982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:36.024906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 222/437] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 10:39:36.034306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800abeb1-5bfd-4ae6-a65b-b2bb499a8430 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:36.078219 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 216/438] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:36.101433 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9396a3-a705-4a3e-8edd-5dea16addeca None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:36.155975 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800abeb1-5bfd-4ae6-a65b-b2bb499a8430 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:36.178524 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:36.195510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f11cf-0eea-442e-bdc2-7ea4789a2ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:36.196380 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f11cf-0eea-442e-bdc2-7ea4789a2ce1 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:36.196690 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f11cf-0eea-442e-bdc2-7ea4789a2ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:36.197024 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f11cf-0eea-442e-bdc2-7ea4789a2ce1 None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:36.200267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f11cf-0eea-442e-bdc2-7ea4789a2ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:36.202016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f11cf-0eea-442e-bdc2-7ea4789a2ce1 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:36.204115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 223/439] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:36 2022] GET /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:36.209131 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f11cf-0eea-442e-bdc2-7ea4789a2ce1 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:36.239382 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9396a3-a705-4a3e-8edd-5dea16addeca None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:36.267073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:36.287593 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bd1bd-7b85-47d9-9d28-80d0fa0c19d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:36.288424 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bd1bd-7b85-47d9-9d28-80d0fa0c19d3 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:36.288762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bd1bd-7b85-47d9-9d28-80d0fa0c19d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:36.289043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bd1bd-7b85-47d9-9d28-80d0fa0c19d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:36.300473 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bd1bd-7b85-47d9-9d28-80d0fa0c19d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:36.308653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-d90bd1bd-7b85-47d9-9d28-80d0fa0c19d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:36.308653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:36.308653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:36.308653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:36.308653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:36.308653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:36.308653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:36.308653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:36.308653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:36.308653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:36.308653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:36.308653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:36.308653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:36.308653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:36.308653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:36.308653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:36.309533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:36.309533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:36.309533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:36.309533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:36.309533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:36.309533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:36.309533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:36.309533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:36.309533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:36.309533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:36.309533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:36.309533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:36.309533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:36.309533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:36.309533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:36.309533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:36.311281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:36.311281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:36.311281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:36.311281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:36.311281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:36.311281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:36.311281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:36.311281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:36.311281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:36.311281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:36.311281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:36.311281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:36.311281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 217/440] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:39:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:36.315957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bd1bd-7b85-47d9-9d28-80d0fa0c19d3 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:36.327768 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f11cf-0eea-442e-bdc2-7ea4789a2ce1 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:36.364718 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d7ba0-9cc1-4c2f-8953-60aeffe3dd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:36.365627 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d7ba0-9cc1-4c2f-8953-60aeffe3dd82 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:36.365908 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d7ba0-9cc1-4c2f-8953-60aeffe3dd82 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:36.366184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d7ba0-9cc1-4c2f-8953-60aeffe3dd82 None admin] PATH_INFO: `/v3/groups/c01c574806804757bafcab2ca2a44c80` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:36.367357 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d7ba0-9cc1-4c2f-8953-60aeffe3dd82 None admin] RBAC: Authorizing `identity:get_group(group_id=c01c574806804757bafcab2ca2a44c80)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:36.368817 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d7ba0-9cc1-4c2f-8953-60aeffe3dd82 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:36.370426 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 224/441] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 23 10:39:36 2022] GET /identity/v3/groups/c01c574806804757bafcab2ca2a44c80 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:36.371683 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10b463-cd86-4208-9f6b-c4855cd00f0a None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:36.372066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10b463-cd86-4208-9f6b-c4855cd00f0a None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:36.372247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10b463-cd86-4208-9f6b-c4855cd00f0a None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:36.374273 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 225/442] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:36.377279 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10b463-cd86-4208-9f6b-c4855cd00f0a None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:36.417448 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bd1bd-7b85-47d9-9d28-80d0fa0c19d3 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:36.434629 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:36.451084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431aa93-c5f9-4963-94ad-d471caf84802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:36.451692 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431aa93-c5f9-4963-94ad-d471caf84802 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:36.451977 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431aa93-c5f9-4963-94ad-d471caf84802 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:36.452256 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431aa93-c5f9-4963-94ad-d471caf84802 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:36.453045 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431aa93-c5f9-4963-94ad-d471caf84802 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:36.453403 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431aa93-c5f9-4963-94ad-d471caf84802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:36.454773 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431aa93-c5f9-4963-94ad-d471caf84802 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:36.462998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 218/443] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:36.464180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49292f-33d9-4ddf-8d6a-8412d30842d2 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:36.464469 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49292f-33d9-4ddf-8d6a-8412d30842d2 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:36.464816 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49292f-33d9-4ddf-8d6a-8412d30842d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:36.476973 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10b463-cd86-4208-9f6b-c4855cd00f0a None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:36.480447 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-8d49292f-33d9-4ddf-8d6a-8412d30842d2 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:36.481662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8d49292f-33d9-4ddf-8d6a-8412d30842d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:36.491126 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:36.511533 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b402d-ba7b-4352-a489-7b9af9620501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:36.512187 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b402d-ba7b-4352-a489-7b9af9620501 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:36.512480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b402d-ba7b-4352-a489-7b9af9620501 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:36.512798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b402d-ba7b-4352-a489-7b9af9620501 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:36.513735 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b402d-ba7b-4352-a489-7b9af9620501 None admin] RBAC: Adding query filter params (group.id=c01c574806804757bafcab2ca2a44c80, role.id=14edb03a6a644798bdbf762bb59f6ef9, scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:36.514046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b402d-ba7b-4352-a489-7b9af9620501 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:36.515481 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b402d-ba7b-4352-a489-7b9af9620501 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:36.521774 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 226/444] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 23 10:39:36 2022] GET /identity/v3/role_assignments?group.id=c01c574806804757bafcab2ca2a44c80&scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf&role.id=14edb03a6a644798bdbf762bb59f6ef9 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:36.526265 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b402d-ba7b-4352-a489-7b9af9620501 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:36.555473 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 219/445] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:36.579420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49292f-33d9-4ddf-8d6a-8412d30842d2 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:36.649008 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b402d-ba7b-4352-a489-7b9af9620501 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:36.691339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc040f-e13c-420c-9efe-88072d918c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:36.691998 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc040f-e13c-420c-9efe-88072d918c26 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:36.692288 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc040f-e13c-420c-9efe-88072d918c26 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:36.692561 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc040f-e13c-420c-9efe-88072d918c26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:36.697896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49292f-33d9-4ddf-8d6a-8412d30842d2 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:36.711072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:36.742230 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d89160-ea62-414f-bd66-94bdf16c0933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:36.743040 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d89160-ea62-414f-bd66-94bdf16c0933 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:36.743443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d89160-ea62-414f-bd66-94bdf16c0933 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:36.743610 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d89160-ea62-414f-bd66-94bdf16c0933 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:36.751077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:36.757243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d89160-ea62-414f-bd66-94bdf16c0933 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:36.766873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-b7d89160-ea62-414f-bd66-94bdf16c0933 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:36.766873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:36.766873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:36.766873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:36.766873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:36.766873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:36.766873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:36.766873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:36.766873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:36.766873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:36.766873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:36.766873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:36.766873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:36.766873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:36.766873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:36.766873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:36.768072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:36.768072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:36.768072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:36.768072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:36.768072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:36.768072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:36.768072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:36.768072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:36.768072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:36.768072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:36.768072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:36.768072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:36.768072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:36.768072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:36.768072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:36.768072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:36.768875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:36.768875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:36.768875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:36.768875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:36.768875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:36.768875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:36.768875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:36.768875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:36.768875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:36.768875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:36.768875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:36.768875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:36.768875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 220/446] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:39:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:39:36.773988 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d89160-ea62-414f-bd66-94bdf16c0933 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:36.777321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc040f-e13c-420c-9efe-88072d918c26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:36.779114 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc040f-e13c-420c-9efe-88072d918c26 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:36.892605 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d89160-ea62-414f-bd66-94bdf16c0933 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:36.896542 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 227/447] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:36.902005 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc040f-e13c-420c-9efe-88072d918c26 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:36.926781 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415c18d-9507-4999-bbe0-00dfb2e34dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:36.927457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415c18d-9507-4999-bbe0-00dfb2e34dc5 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:36.927746 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415c18d-9507-4999-bbe0-00dfb2e34dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:36.928028 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415c18d-9507-4999-bbe0-00dfb2e34dc5 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:36.928811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415c18d-9507-4999-bbe0-00dfb2e34dc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:36.929125 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415c18d-9507-4999-bbe0-00dfb2e34dc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:36.930501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415c18d-9507-4999-bbe0-00dfb2e34dc5 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:36.938927 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 221/448] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:36.944310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415c18d-9507-4999-bbe0-00dfb2e34dc5 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:36.976137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:36.982435 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:37.004079 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc040f-e13c-420c-9efe-88072d918c26 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:37.037503 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071a322-85bc-4b47-a78e-59ee69a2e753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:37.038368 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071a322-85bc-4b47-a78e-59ee69a2e753 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:37.038654 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071a322-85bc-4b47-a78e-59ee69a2e753 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:37.038931 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071a322-85bc-4b47-a78e-59ee69a2e753 None admin] PATH_INFO: `/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:37.040110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071a322-85bc-4b47-a78e-59ee69a2e753 None admin] RBAC: Authorizing `identity:get_project(project_id=c8ac4f9587f94b4ca2b19728f8a69cdf)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:37.041604 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071a322-85bc-4b47-a78e-59ee69a2e753 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:37.043327 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 228/449] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:36 2022] GET /identity/v3/projects/c8ac4f9587f94b4ca2b19728f8a69cdf => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:37.045625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415c18d-9507-4999-bbe0-00dfb2e34dc5 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:37.049580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071a322-85bc-4b47-a78e-59ee69a2e753 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:37.080756 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343879b-1af3-4334-bad6-28eb6279bfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:37.081410 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343879b-1af3-4334-bad6-28eb6279bfc0 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:37.081701 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343879b-1af3-4334-bad6-28eb6279bfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:37.081991 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343879b-1af3-4334-bad6-28eb6279bfc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:37.149193 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071a322-85bc-4b47-a78e-59ee69a2e753 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:37.151214 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343879b-1af3-4334-bad6-28eb6279bfc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:37.152708 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343879b-1af3-4334-bad6-28eb6279bfc0 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:37.181694 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:37.182971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab478c2-d9d5-44ec-b3aa-22d1fb6fd437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:37.183827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab478c2-d9d5-44ec-b3aa-22d1fb6fd437 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:37.184112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab478c2-d9d5-44ec-b3aa-22d1fb6fd437 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:37.184391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab478c2-d9d5-44ec-b3aa-22d1fb6fd437 None admin] PATH_INFO: `/v3/groups/c01c574806804757bafcab2ca2a44c80` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:37.186225 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab478c2-d9d5-44ec-b3aa-22d1fb6fd437 None admin] RBAC: Authorizing `identity:get_group(group_id=c01c574806804757bafcab2ca2a44c80)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:37.187673 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab478c2-d9d5-44ec-b3aa-22d1fb6fd437 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:37.190442 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 229/450] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 23 10:39:37 2022] GET /identity/v3/groups/c01c574806804757bafcab2ca2a44c80 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:37.195010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab478c2-d9d5-44ec-b3aa-22d1fb6fd437 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:37.209963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:37.251466 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 222/451] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 10:39:37.257111 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343879b-1af3-4334-bad6-28eb6279bfc0 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:37.294028 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab478c2-d9d5-44ec-b3aa-22d1fb6fd437 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:37.328334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46e671-3536-4893-b9ce-fd7930f86d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:37.329017 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46e671-3536-4893-b9ce-fd7930f86d97 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:37.329302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46e671-3536-4893-b9ce-fd7930f86d97 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:37.329580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46e671-3536-4893-b9ce-fd7930f86d97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:37.330417 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46e671-3536-4893-b9ce-fd7930f86d97 None admin] RBAC: Adding query filter params (group.id=c01c574806804757bafcab2ca2a44c80, role.id=f86a1d8dfb24430a98414eab048c4be9, scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:37.330730 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46e671-3536-4893-b9ce-fd7930f86d97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:37.332166 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46e671-3536-4893-b9ce-fd7930f86d97 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:37.337926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 230/452] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 23 10:39:37 2022] GET /identity/v3/role_assignments?group.id=c01c574806804757bafcab2ca2a44c80&scope.project.id=c8ac4f9587f94b4ca2b19728f8a69cdf&role.id=f86a1d8dfb24430a98414eab048c4be9 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:37.352171 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343879b-1af3-4334-bad6-28eb6279bfc0 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:37.384891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:37.390218 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2f3ad-edf3-4f55-9788-a99dd6c500ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:37.391104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2f3ad-edf3-4f55-9788-a99dd6c500ab None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:37.391385 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2f3ad-edf3-4f55-9788-a99dd6c500ab None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:37.391659 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2f3ad-edf3-4f55-9788-a99dd6c500ab None admin] PATH_INFO: `/v3/projects/7866f693106e4323a208242e01a5fef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:37.392989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2f3ad-edf3-4f55-9788-a99dd6c500ab None admin] RBAC: Authorizing `identity:get_project(project_id=7866f693106e4323a208242e01a5fef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:37.396428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2f3ad-edf3-4f55-9788-a99dd6c500ab None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:37.396428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 223/453] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:37 2022] GET /identity/v3/projects/7866f693106e4323a208242e01a5fef9 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:37.401901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46e671-3536-4893-b9ce-fd7930f86d97 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:37.485707 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:37.507619 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46e671-3536-4893-b9ce-fd7930f86d97 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:37.540857 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7f613-7f9c-47ba-92c6-955f6b0e145f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:37.541744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7f613-7f9c-47ba-92c6-955f6b0e145f None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:37.542433 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7f613-7f9c-47ba-92c6-955f6b0e145f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:37.542719 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7f613-7f9c-47ba-92c6-955f6b0e145f None admin] PATH_INFO: `/v3/groups/c243361d46834d4fac9a697faa1b2325` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:37.543909 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7f613-7f9c-47ba-92c6-955f6b0e145f None admin] RBAC: Authorizing `identity:get_group(group_id=c243361d46834d4fac9a697faa1b2325)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:37.546102 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7f613-7f9c-47ba-92c6-955f6b0e145f None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:37.547738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 231/454] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 23 10:39:37 2022] GET /identity/v3/groups/c243361d46834d4fac9a697faa1b2325 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:37.553770 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2f3ad-edf3-4f55-9788-a99dd6c500ab None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:37.658715 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2f3ad-edf3-4f55-9788-a99dd6c500ab None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:37.693907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2f617-4200-460e-badf-5650ebc36dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:37.694568 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2f617-4200-460e-badf-5650ebc36dcc None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:37.694852 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2f617-4200-460e-badf-5650ebc36dcc None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:37.695132 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2f617-4200-460e-badf-5650ebc36dcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:37.695969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2f617-4200-460e-badf-5650ebc36dcc None admin] RBAC: Adding query filter params (group.id=c243361d46834d4fac9a697faa1b2325, role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.project.id=7866f693106e4323a208242e01a5fef9) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:37.696285 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2f617-4200-460e-badf-5650ebc36dcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:37.697818 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2f617-4200-460e-badf-5650ebc36dcc None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:37.704911 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 224/455] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 23 10:39:37 2022] GET /identity/v3/role_assignments?group.id=c243361d46834d4fac9a697faa1b2325&scope.project.id=7866f693106e4323a208242e01a5fef9&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:40.171982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a473c-ed61-401f-a39d-5617ef4b6c90 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:40.172524 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a473c-ed61-401f-a39d-5617ef4b6c90 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:40.172524 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a473c-ed61-401f-a39d-5617ef4b6c90 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:40.174185 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 232/456] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:40.179751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9183648-a351-4464-9277-b1e6d0875844 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:40.180153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9183648-a351-4464-9277-b1e6d0875844 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:40.180337 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9183648-a351-4464-9277-b1e6d0875844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:40.205641 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-b9183648-a351-4464-9277-b1e6d0875844 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:40.206851 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-b9183648-a351-4464-9277-b1e6d0875844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:40.289531 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:40.303210 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 225/457] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:40.351332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a473c-ed61-401f-a39d-5617ef4b6c90 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:40.435477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea72aa6-9158-4e52-8b68-b7665121840c None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:40.435759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea72aa6-9158-4e52-8b68-b7665121840c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:40.436048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea72aa6-9158-4e52-8b68-b7665121840c None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:40.437934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 226/458] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:40.443156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368faec-2ac0-4070-94ed-dab4d094dfae None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:40.443451 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368faec-2ac0-4070-94ed-dab4d094dfae None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:40.443737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368faec-2ac0-4070-94ed-dab4d094dfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:40.481799 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-7368faec-2ac0-4070-94ed-dab4d094dfae None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:40.483174 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-7368faec-2ac0-4070-94ed-dab4d094dfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:40.487205 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a473c-ed61-401f-a39d-5617ef4b6c90 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:40.523352 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ab197-8945-4e17-a97a-33e133e0a202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:40.524472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ab197-8945-4e17-a97a-33e133e0a202 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:40.524962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ab197-8945-4e17-a97a-33e133e0a202 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:40.525416 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ab197-8945-4e17-a97a-33e133e0a202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:40.537469 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ab197-8945-4e17-a97a-33e133e0a202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:40.539185 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ab197-8945-4e17-a97a-33e133e0a202 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:40.546875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:40.558238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-318ab197-8945-4e17-a97a-33e133e0a202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:40.558238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:40.558238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:40.558238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:40.558238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:40.558238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:40.558238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:40.558238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:40.558238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:40.558238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:40.558238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:40.558238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:40.558238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:40.558238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:40.558238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:40.559120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:40.559120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:40.559120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:40.559120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:40.559120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:40.559120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:40.559120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:40.559120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:40.559120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:40.559120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:40.559120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:40.559120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:40.559120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:40.559120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:40.559120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:40.559120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:40.559120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:40.560055 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:40.560055 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:40.560055 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:40.560055 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:40.561975 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 233/459] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:40.567654 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ab197-8945-4e17-a97a-33e133e0a202 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:40.629522 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 227/460] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:40.665540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368faec-2ac0-4070-94ed-dab4d094dfae None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:40.706230 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ab197-8945-4e17-a97a-33e133e0a202 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:40.753341 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f56e4-7027-421e-9b1d-a2f69ee6165d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:40.754264 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f56e4-7027-421e-9b1d-a2f69ee6165d None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:40.754549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f56e4-7027-421e-9b1d-a2f69ee6165d None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:40.754828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f56e4-7027-421e-9b1d-a2f69ee6165d None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:40.755559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f56e4-7027-421e-9b1d-a2f69ee6165d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:40.755869 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f56e4-7027-421e-9b1d-a2f69ee6165d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:40.757271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f56e4-7027-421e-9b1d-a2f69ee6165d None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:40.774254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 234/461] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:40.775466 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f56e4-7027-421e-9b1d-a2f69ee6165d None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:40.842038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:40.851924 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368faec-2ac0-4070-94ed-dab4d094dfae None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:40.876433 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:40.888525 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f56e4-7027-421e-9b1d-a2f69ee6165d None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:40.890386 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c196bd7-9bf8-4826-8e18-8c512bffe42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:40.891465 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c196bd7-9bf8-4826-8e18-8c512bffe42c None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:40.891465 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c196bd7-9bf8-4826-8e18-8c512bffe42c None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:40.891771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c196bd7-9bf8-4826-8e18-8c512bffe42c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:40.902140 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c196bd7-9bf8-4826-8e18-8c512bffe42c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:40.903506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c196bd7-9bf8-4826-8e18-8c512bffe42c None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:40.923633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-4c196bd7-9bf8-4826-8e18-8c512bffe42c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:40.923633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:40.923633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:40.923633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:40.923633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:40.923633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:40.923633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:40.923633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:40.923633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:40.923633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:40.923633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:40.923633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:40.923633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:40.923633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:40.923633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:40.924513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:40.924513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:40.924513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:40.924513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:40.924513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:40.924513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:40.924513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:40.924513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:40.924513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:40.924513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:40.924513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:40.924513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:40.924513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:40.924513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:40.924513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:40.924513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:40.924513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:40.932286 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:40.932286 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:40.932286 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:40.932286 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:40.932498 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a7d7d-75db-41d1-b512-1d7c74785352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:40.932498 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a7d7d-75db-41d1-b512-1d7c74785352 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:40.932498 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a7d7d-75db-41d1-b512-1d7c74785352 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:40.932498 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a7d7d-75db-41d1-b512-1d7c74785352 None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:40.933104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 228/462] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:39:40.933183 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a7d7d-75db-41d1-b512-1d7c74785352 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:40.933251 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dd2d6-c132-4bba-8e08-1761f4261e10 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:40.933251 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dd2d6-c132-4bba-8e08-1761f4261e10 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:40.933251 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dd2d6-c132-4bba-8e08-1761f4261e10 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:40.933438 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a7d7d-75db-41d1-b512-1d7c74785352 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:40.933502 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 229/463] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:40.933502 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc25587-e8dc-4ba2-9cda-af7d787faa47 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:40.933502 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc25587-e8dc-4ba2-9cda-af7d787faa47 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:40.933502 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc25587-e8dc-4ba2-9cda-af7d787faa47 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:40.933502 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 230/464] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:40.936005 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc25587-e8dc-4ba2-9cda-af7d787faa47 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:41.032695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 235/465] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 23 10:39:40 2022] POST /identity/v3/users => generated 246 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:39:41.033837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225ce27-4286-4919-a32a-897b2a30a0d0 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:41.034195 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225ce27-4286-4919-a32a-897b2a30a0d0 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:41.034547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225ce27-4286-4919-a32a-897b2a30a0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:41.050818 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc25587-e8dc-4ba2-9cda-af7d787faa47 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:41.056375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-7225ce27-4286-4919-a32a-897b2a30a0d0 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:41.057744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-7225ce27-4286-4919-a32a-897b2a30a0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:41.104771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63beea-53e5-4459-b5b4-7e2f20738f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:41.106179 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63beea-53e5-4459-b5b4-7e2f20738f50 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:41.106660 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63beea-53e5-4459-b5b4-7e2f20738f50 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:41.108236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63beea-53e5-4459-b5b4-7e2f20738f50 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:41.109256 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63beea-53e5-4459-b5b4-7e2f20738f50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:41.109814 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63beea-53e5-4459-b5b4-7e2f20738f50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:41.111447 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63beea-53e5-4459-b5b4-7e2f20738f50 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:41.129287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 231/466] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:41.129287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f51558-6767-47e3-84af-1dfb0bd95996 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:41.129287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f51558-6767-47e3-84af-1dfb0bd95996 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:41.134826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f51558-6767-47e3-84af-1dfb0bd95996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:41.152124 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 236/467] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:41.153340 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225ce27-4286-4919-a32a-897b2a30a0d0 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:41.156850 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-a8f51558-6767-47e3-84af-1dfb0bd95996 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:41.158933 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a8f51558-6767-47e3-84af-1dfb0bd95996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:41.189577 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:41.209511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:41.231560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 232/468] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:41.233529 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f51558-6767-47e3-84af-1dfb0bd95996 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:41.274151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225ce27-4286-4919-a32a-897b2a30a0d0 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:41.318609 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ef335-5fdd-46b1-82af-2b51bd1d2e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:41.319369 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ef335-5fdd-46b1-82af-2b51bd1d2e01 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:41.319583 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ef335-5fdd-46b1-82af-2b51bd1d2e01 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:41.319861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ef335-5fdd-46b1-82af-2b51bd1d2e01 None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:41.320678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ef335-5fdd-46b1-82af-2b51bd1d2e01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:41.322039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ef335-5fdd-46b1-82af-2b51bd1d2e01 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:41.355260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f51558-6767-47e3-84af-1dfb0bd95996 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:41.392956 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24a8be-3840-4668-b91a-14844de8b9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:41.394038 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24a8be-3840-4668-b91a-14844de8b9d3 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:41.394511 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24a8be-3840-4668-b91a-14844de8b9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:41.394955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24a8be-3840-4668-b91a-14844de8b9d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:41.406490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24a8be-3840-4668-b91a-14844de8b9d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:41.408255 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24a8be-3840-4668-b91a-14844de8b9d3 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:41.432019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-db24a8be-3840-4668-b91a-14844de8b9d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:41.432019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:41.432019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:41.432019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:41.432019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:41.432019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:41.432019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:41.432019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:41.432019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:41.432019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:41.432019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:41.432019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:41.432019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:41.432019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:41.432019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:41.432974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:41.432974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:41.432974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:41.432974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:41.432974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:41.432974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:41.432974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:41.432974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:41.432974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:41.432974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:41.432974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:41.432974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:41.432974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:41.432974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:41.432974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:41.432974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:41.432974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:41.433846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:41.433846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:41.433846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:41.433846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:41.433846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 233/470] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:41.433846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24a8be-3840-4668-b91a-14844de8b9d3 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:41.434236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 237/470] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 23 10:39:41 2022] POST /identity/v3/users => generated 248 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:39:41.446159 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ef335-5fdd-46b1-82af-2b51bd1d2e01 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:41.459808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:41.555490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24a8be-3840-4668-b91a-14844de8b9d3 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:41.576054 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:41.579976 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ef335-5fdd-46b1-82af-2b51bd1d2e01 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:41.598655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed7b17-dca8-4d82-9b29-b0a68d39a4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:41.599607 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed7b17-dca8-4d82-9b29-b0a68d39a4f7 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:41.599897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed7b17-dca8-4d82-9b29-b0a68d39a4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:41.600172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed7b17-dca8-4d82-9b29-b0a68d39a4f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:41.612883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed7b17-dca8-4d82-9b29-b0a68d39a4f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:41.614683 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed7b17-dca8-4d82-9b29-b0a68d39a4f7 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:41.631943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a812b-2e79-4063-8a50-2a2c91b5f8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:41.632761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a812b-2e79-4063-8a50-2a2c91b5f8f0 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:41.633100 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a812b-2e79-4063-8a50-2a2c91b5f8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:41.633388 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a812b-2e79-4063-8a50-2a2c91b5f8f0 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:41.634121 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a812b-2e79-4063-8a50-2a2c91b5f8f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:41.634439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a812b-2e79-4063-8a50-2a2c91b5f8f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:41.635930 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a812b-2e79-4063-8a50-2a2c91b5f8f0 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:41.637892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-b0ed7b17-dca8-4d82-9b29-b0a68d39a4f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:41.637892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:41.637892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:41.637892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:41.637892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:41.637892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:41.637892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:41.637892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:41.637892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:41.637892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:41.637892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:41.637892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:41.637892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:41.637892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:41.637892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:41.639227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:41.639227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:41.639227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:41.639227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:41.639227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:41.639227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:41.639227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:41.639227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:41.639227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:41.639227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:41.639227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:41.639227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:41.639227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:41.639227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:41.639227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:41.639227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:41.639227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:41.640068 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:41.640068 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:41.640068 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:41.640068 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:41.642250 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 234/471] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:41.642250 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6b0bd-8be5-4c4f-b069-c1c59ce15563 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:41.642250 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6b0bd-8be5-4c4f-b069-c1c59ce15563 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:41.642250 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6b0bd-8be5-4c4f-b069-c1c59ce15563 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:41.643398 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 235/472] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:41.648522 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef784a-3a7a-4493-90ac-df52f587d81b None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:41.648880 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef784a-3a7a-4493-90ac-df52f587d81b None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:41.649553 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef784a-3a7a-4493-90ac-df52f587d81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:41.660798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 238/473] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:41.660798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a812b-2e79-4063-8a50-2a2c91b5f8f0 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:41.667664 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-32ef784a-3a7a-4493-90ac-df52f587d81b None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:41.668891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-32ef784a-3a7a-4493-90ac-df52f587d81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:41.740952 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:41.747040 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 236/474] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:39:41.754994 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef784a-3a7a-4493-90ac-df52f587d81b None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:41.785508 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a812b-2e79-4063-8a50-2a2c91b5f8f0 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:41.830657 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ba1bf-7151-421b-a7d6-19342d750d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:41.831406 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ba1bf-7151-421b-a7d6-19342d750d10 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:41.831705 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ba1bf-7151-421b-a7d6-19342d750d10 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:41.832297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ba1bf-7151-421b-a7d6-19342d750d10 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:41.833357 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ba1bf-7151-421b-a7d6-19342d750d10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:41.833676 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ba1bf-7151-421b-a7d6-19342d750d10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:41.835125 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ba1bf-7151-421b-a7d6-19342d750d10 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:41.853022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 239/475] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:41.853945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ba1bf-7151-421b-a7d6-19342d750d10 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:41.876836 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef784a-3a7a-4493-90ac-df52f587d81b None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:41.882942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:41.917957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723c936-631c-40f9-b88e-217de85f9fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:41.918646 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723c936-631c-40f9-b88e-217de85f9fb2 None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:41.918936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723c936-631c-40f9-b88e-217de85f9fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:41.919219 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723c936-631c-40f9-b88e-217de85f9fb2 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:41.920300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723c936-631c-40f9-b88e-217de85f9fb2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:41.922031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723c936-631c-40f9-b88e-217de85f9fb2 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:41.975066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ba1bf-7151-421b-a7d6-19342d750d10 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:42.011483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fcc13-cec0-400c-bd96-c1bffc01e15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:42.012422 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fcc13-cec0-400c-bd96-c1bffc01e15a None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:42.012880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fcc13-cec0-400c-bd96-c1bffc01e15a None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:42.013902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fcc13-cec0-400c-bd96-c1bffc01e15a None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:42.014984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fcc13-cec0-400c-bd96-c1bffc01e15a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:42.016620 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fcc13-cec0-400c-bd96-c1bffc01e15a None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:42.032413 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 237/476] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 23 10:39:41 2022] POST /identity/v3/users => generated 249 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:39:42.032413 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723c936-631c-40f9-b88e-217de85f9fb2 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:42.077731 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.sql.core [None req-1f5fcc13-cec0-400c-bd96-c1bffc01e15a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 10:39:42.077731 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 10:39:42.077731 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [parameters: {'id': '4f6d5957694f4b19a55bf3acdcf8c46c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 10:39:42.077731 dv-cinder-846146-4-smb devstack@keystone.service[92003]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92003) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 10:39:42.097306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-1f5fcc13-cec0-400c-bd96-c1bffc01e15a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 10:39:42.097306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:42.097306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 10:39:42.097306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 10:39:42.097306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 10:39:42.097306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 10:39:42.097306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 10:39:42.097306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 10:39:42.097306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 10:39:42.097306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application conn.query(q) Jun 23 10:39:42.097306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 10:39:42.097306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 10:39:42.097306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 10:39:42.097306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application result.read() Jun 23 10:39:42.097306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 10:39:42.098241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 10:39:42.098241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 10:39:42.098241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 10:39:42.098241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 10:39:42.098241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 10:39:42.098241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 10:39:42.098241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 10:39:42.098241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 10:39:42.098241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:42.098241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 10:39:42.098241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:42.098241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:42.098241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 10:39:42.098241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 10:39:42.098241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 23 10:39:42.098241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return ref.to_dict() Jun 23 10:39:42.098241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 10:39:42.098241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application next(self.gen) Jun 23 10:39:42.099132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 10:39:42.099132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application yield resource Jun 23 10:39:42.099132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 10:39:42.099132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application next(self.gen) Jun 23 10:39:42.099132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 10:39:42.099132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 10:39:42.099132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 10:39:42.099132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 10:39:42.099132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 10:39:42.099132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise self.value Jun 23 10:39:42.099132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 10:39:42.099132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 10:39:42.099132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 10:39:42.099132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application session.commit() Jun 23 10:39:42.099132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 10:39:42.099132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 10:39:42.099132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 10:39:42.099986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 10:39:42.099986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 10:39:42.099986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self.session.flush() Jun 23 10:39:42.099986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 10:39:42.099986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 10:39:42.099986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 10:39:42.099986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 10:39:42.099986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 10:39:42.099986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application compat.raise_( Jun 23 10:39:42.099986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 10:39:42.099986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception Jun 23 10:39:42.099986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 10:39:42.099986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 10:39:42.099986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 10:39:42.099986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 10:39:42.099986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 10:39:42.099986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 10:39:42.100904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 10:39:42.100904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 10:39:42.100904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 10:39:42.100904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 10:39:42.100904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 10:39:42.100904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 10:39:42.100904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 10:39:42.100904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 10:39:42.100904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 10:39:42.100904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 10:39:42.100904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 10:39:42.100904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 10:39:42.100904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 10:39:42.100904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 10:39:42.100904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 10:39:42.100904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception Jun 23 10:39:42.101704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 10:39:42.101704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 10:39:42.101704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 10:39:42.101704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 10:39:42.101704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 10:39:42.101704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 10:39:42.101704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 10:39:42.101704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application conn.query(q) Jun 23 10:39:42.101704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 10:39:42.101704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 10:39:42.101704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 10:39:42.101704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application result.read() Jun 23 10:39:42.101704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 10:39:42.101704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 10:39:42.101704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 10:39:42.101704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 10:39:42.102480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 10:39:42.102480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 10:39:42.102480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 10:39:42.102480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 10:39:42.102480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 10:39:42.102480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 10:39:42.102480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [parameters: {'id': '4f6d5957694f4b19a55bf3acdcf8c46c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 10:39:42.102480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 10:39:42.102480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:42.102480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:39:42.102480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:42.102480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:42.102480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:42.102480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:42.102480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:42.102480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:42.103252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:42.103252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:42.103252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:42.103252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:42.103252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:42.103252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:42.103252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 23 10:39:42.103252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 23 10:39:42.103252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:42.103252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:42.103252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 23 10:39:42.103252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 23 10:39:42.103252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 10:39:42.103252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 10:39:42.103252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 10:39:42.103252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:42.108568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 240/477] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jun 23 10:39:41 2022] POST /identity/v3/roles => generated 144 bytes in 255 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:42.113827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fcc13-cec0-400c-bd96-c1bffc01e15a None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:42.125048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:42.228246 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723c936-631c-40f9-b88e-217de85f9fb2 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:42.255983 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:42.269328 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86663466-2a1d-4187-a2c3-3799e6fcb764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:42.270017 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86663466-2a1d-4187-a2c3-3799e6fcb764 None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:42.270306 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86663466-2a1d-4187-a2c3-3799e6fcb764 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:42.270592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86663466-2a1d-4187-a2c3-3799e6fcb764 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:42.272565 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86663466-2a1d-4187-a2c3-3799e6fcb764 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:42.274063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86663466-2a1d-4187-a2c3-3799e6fcb764 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:42.280513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fcc13-cec0-400c-bd96-c1bffc01e15a None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:42.327269 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c20f2-1aeb-42d9-a222-99104e5ec16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:42.328462 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c20f2-1aeb-42d9-a222-99104e5ec16e None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:42.328991 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c20f2-1aeb-42d9-a222-99104e5ec16e None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:42.329460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c20f2-1aeb-42d9-a222-99104e5ec16e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:42.339945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c20f2-1aeb-42d9-a222-99104e5ec16e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:42.349176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-277c20f2-1aeb-42d9-a222-99104e5ec16e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:42.349176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:42.349176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:42.349176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:42.349176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:42.349176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:42.349176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:42.349176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:42.349176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:42.349176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:42.349176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:42.349176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:42.349176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:42.349176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:42.349176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:42.349176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:42.350083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:42.350083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:42.350083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:42.350083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:42.350083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:42.350083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:42.350083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:42.350083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:42.350083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:42.350083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:42.350083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:42.350083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:42.350083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:42.350083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:42.350083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:42.350083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:42.350859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:42.350859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:42.350859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:42.350859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:42.350859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:42.350859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:42.350859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:42.350859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:42.350859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:42.350859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:42.350859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:39:42.350859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:42.353601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 241/478] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:39:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:39:42.358802 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c20f2-1aeb-42d9-a222-99104e5ec16e None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:42.407584 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 238/479] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 23 10:39:42 2022] POST /identity/v3/users => generated 248 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:39:42.477228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c20f2-1aeb-42d9-a222-99104e5ec16e None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:42.515455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7777e-2f59-4ddc-94e5-cbf47c82c51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:42.516170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7777e-2f59-4ddc-94e5-cbf47c82c51d None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:42.516463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7777e-2f59-4ddc-94e5-cbf47c82c51d None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:42.516771 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7777e-2f59-4ddc-94e5-cbf47c82c51d None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:42.517586 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7777e-2f59-4ddc-94e5-cbf47c82c51d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:42.517899 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7777e-2f59-4ddc-94e5-cbf47c82c51d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:42.519270 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7777e-2f59-4ddc-94e5-cbf47c82c51d None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:42.531486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 242/480] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:43.320251 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636bbd4-c5e9-487e-8397-f1e86768b4a1 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:43.320805 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636bbd4-c5e9-487e-8397-f1e86768b4a1 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:43.320881 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636bbd4-c5e9-487e-8397-f1e86768b4a1 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:43.322480 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 239/481] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:43.328032 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50baf1-6c07-47a7-810a-8953977e6c25 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:43.328463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50baf1-6c07-47a7-810a-8953977e6c25 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:43.328657 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50baf1-6c07-47a7-810a-8953977e6c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:43.340352 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:43.353592 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-af50baf1-6c07-47a7-810a-8953977e6c25 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:43.354816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-af50baf1-6c07-47a7-810a-8953977e6c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:43.446963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 243/482] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:43.487476 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636bbd4-c5e9-487e-8397-f1e86768b4a1 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:43.651295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636bbd4-c5e9-487e-8397-f1e86768b4a1 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:43.668381 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:43.697041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b086d-a1d6-42e0-b51e-a689a436f81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:43.697846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b086d-a1d6-42e0-b51e-a689a436f81c None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:43.698137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b086d-a1d6-42e0-b51e-a689a436f81c None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:43.698419 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b086d-a1d6-42e0-b51e-a689a436f81c None admin] PATH_INFO: `/v3/roles/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:43.717444 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b086d-a1d6-42e0-b51e-a689a436f81c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:43.725034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-018b086d-a1d6-42e0-b51e-a689a436f81c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:43.725034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:43.725034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:43.725034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:43.725034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:43.725034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:43.725034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:43.725034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:43.725034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:43.725034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:43.725034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:43.725034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:43.725034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:43.725034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:43.725034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:43.725034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:43.725876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:43.725876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:43.725876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:43.725876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:43.725876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:43.725876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:43.725876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:43.725876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:43.725876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:43.725876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:43.725876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:43.725876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:43.725876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:43.725876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:43.725876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:43.725876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:43.727097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:43.727097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:43.727097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:43.727097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:43.727097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:43.727097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:43.727097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:43.727097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:43.727097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:43.727097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:43.727097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:43.727097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:43.727097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 240/483] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:39:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:43.731995 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50baf1-6c07-47a7-810a-8953977e6c25 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:43.901259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50baf1-6c07-47a7-810a-8953977e6c25 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:43.954271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25498525-ff5c-47eb-9b48-b8a7939a2262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:43.954964 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25498525-ff5c-47eb-9b48-b8a7939a2262 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:43.955255 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25498525-ff5c-47eb-9b48-b8a7939a2262 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:43.955535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25498525-ff5c-47eb-9b48-b8a7939a2262 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:43.956297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25498525-ff5c-47eb-9b48-b8a7939a2262 None admin] RBAC: Adding query filter params (name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:43.956609 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25498525-ff5c-47eb-9b48-b8a7939a2262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:43.958009 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25498525-ff5c-47eb-9b48-b8a7939a2262 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:43.963332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:43.970856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835a52e-bb8a-47e5-928a-2113511857db None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:43.971150 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835a52e-bb8a-47e5-928a-2113511857db None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:43.971435 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835a52e-bb8a-47e5-928a-2113511857db None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:43.971777 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 244/484] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:39:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:43.973029 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 241/485] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:43.978179 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25498525-ff5c-47eb-9b48-b8a7939a2262 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:43.982900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ec7f5-b7ff-4bc1-9365-af7ad6a08502 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:43.983195 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ec7f5-b7ff-4bc1-9365-af7ad6a08502 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:43.983483 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ec7f5-b7ff-4bc1-9365-af7ad6a08502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:44.011555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-292ec7f5-b7ff-4bc1-9365-af7ad6a08502 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:44.012806 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-292ec7f5-b7ff-4bc1-9365-af7ad6a08502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:44.137705 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 242/486] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:39:44.141913 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25498525-ff5c-47eb-9b48-b8a7939a2262 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:44.161867 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ec7f5-b7ff-4bc1-9365-af7ad6a08502 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:44.203691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e11f0-db59-4f26-abf8-5be7efc3a1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:44.204492 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e11f0-db59-4f26-abf8-5be7efc3a1cc None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:44.204808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e11f0-db59-4f26-abf8-5be7efc3a1cc None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:44.205089 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e11f0-db59-4f26-abf8-5be7efc3a1cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:44.225958 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e11f0-db59-4f26-abf8-5be7efc3a1cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:44.227436 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e11f0-db59-4f26-abf8-5be7efc3a1cc None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:44.248476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-a79e11f0-db59-4f26-abf8-5be7efc3a1cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:44.248476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:44.248476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:44.248476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:44.248476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:44.248476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:44.248476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:44.248476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:44.248476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:44.248476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:44.248476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:44.248476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:44.248476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:44.248476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:44.248476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:44.249378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:44.249378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:44.249378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:44.249378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:44.249378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:44.249378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:44.249378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:44.249378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:44.249378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:44.249378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:44.249378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:44.249378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:44.249378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:44.249378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:44.249378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:44.249378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:44.249378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:44.250499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:44.250499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:44.250499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:44.250499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:44.250499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 245/487] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:44.255804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e11f0-db59-4f26-abf8-5be7efc3a1cc None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:44.323645 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ec7f5-b7ff-4bc1-9365-af7ad6a08502 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:44.337031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:44.364298 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb6d6d-635e-4692-a16a-b6e09dde8dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:44.365137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb6d6d-635e-4692-a16a-b6e09dde8dde None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:44.365421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb6d6d-635e-4692-a16a-b6e09dde8dde None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:44.365697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb6d6d-635e-4692-a16a-b6e09dde8dde None admin] PATH_INFO: `/v3/roles/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:44.373464 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:44.391432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb6d6d-635e-4692-a16a-b6e09dde8dde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:44.401957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-abbb6d6d-635e-4692-a16a-b6e09dde8dde None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:44.401957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:44.401957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:44.401957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:44.401957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:44.401957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:44.401957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:44.401957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:44.401957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:44.401957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:44.401957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:44.401957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:44.401957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:44.401957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:44.401957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:44.401957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:44.402807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:44.402807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:44.402807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:44.402807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:44.402807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:44.402807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:44.402807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:44.402807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:44.402807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:44.402807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:44.402807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:44.402807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:44.402807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:44.402807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:44.402807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:44.402807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:44.403943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:44.403943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:44.403943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:44.403943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:44.403943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:44.403943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:44.403943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:44.403943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:44.403943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:44.403943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:44.403943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:44.403943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:44.403943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 243/488] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:39:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:39:44.409560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb6d6d-635e-4692-a16a-b6e09dde8dde None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:44.445619 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e11f0-db59-4f26-abf8-5be7efc3a1cc None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:44.480883 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e48002-9280-4858-8209-7bddc53ed1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:44.481557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e48002-9280-4858-8209-7bddc53ed1bb None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:44.481883 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e48002-9280-4858-8209-7bddc53ed1bb None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:44.482171 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e48002-9280-4858-8209-7bddc53ed1bb None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:44.482901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e48002-9280-4858-8209-7bddc53ed1bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:44.483215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e48002-9280-4858-8209-7bddc53ed1bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:44.484583 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e48002-9280-4858-8209-7bddc53ed1bb None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:44.506279 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 246/489] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:44.512668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e48002-9280-4858-8209-7bddc53ed1bb None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:44.591821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb6d6d-635e-4692-a16a-b6e09dde8dde None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:44.639450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021181da-6fdb-4de7-ba06-400ea4ef3ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:44.640153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021181da-6fdb-4de7-ba06-400ea4ef3ba2 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:44.640460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021181da-6fdb-4de7-ba06-400ea4ef3ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:44.641195 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021181da-6fdb-4de7-ba06-400ea4ef3ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:44.641954 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021181da-6fdb-4de7-ba06-400ea4ef3ba2 None admin] RBAC: Adding query filter params (name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:44.642264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021181da-6fdb-4de7-ba06-400ea4ef3ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:44.644040 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021181da-6fdb-4de7-ba06-400ea4ef3ba2 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:44.655191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 244/490] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:39:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:44.659876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15a817-29a9-4ec1-a99b-a0cee84fff96 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:44.659876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15a817-29a9-4ec1-a99b-a0cee84fff96 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:44.659876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15a817-29a9-4ec1-a99b-a0cee84fff96 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:44.660716 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 245/491] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:44.661674 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15a817-29a9-4ec1-a99b-a0cee84fff96 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:44.675160 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e48002-9280-4858-8209-7bddc53ed1bb None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:44.687383 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:44.701277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:44.716254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354f268-dd3c-439d-926c-6c87e6f041c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:44.717149 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354f268-dd3c-439d-926c-6c87e6f041c5 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:44.717779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354f268-dd3c-439d-926c-6c87e6f041c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:44.718364 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354f268-dd3c-439d-926c-6c87e6f041c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:44.726908 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354f268-dd3c-439d-926c-6c87e6f041c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:44.728918 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354f268-dd3c-439d-926c-6c87e6f041c5 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:44.745228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-c354f268-dd3c-439d-926c-6c87e6f041c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:39:44.745228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:44.745228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:44.745228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:44.745228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:44.745228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:44.745228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:44.745228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:44.745228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:44.745228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:44.745228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:44.745228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:44.745228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:39:44.745228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:39:44.745228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:39:44.745228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:39:44.746198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:44.746198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:44.746198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:39:44.746198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:44.746198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:39:44.746198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:44.746198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:44.746198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:44.746198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:44.746198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:44.746198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:44.746198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:44.746198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:44.746198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:44.746198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:44.746198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:44.746198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:44.746198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:44.747070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:44.747070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:44.747070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:39:44.747070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:39:44.747070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:39:44.747070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:39:44.747070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:39:44.747070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:39:44.747070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:39:44.747070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:44.749076 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 247/492] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jun 23 10:39:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:39:44.750388 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae050ed-5409-4671-bc84-efd8f14d456a None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:44.751013 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae050ed-5409-4671-bc84-efd8f14d456a None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:44.751013 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae050ed-5409-4671-bc84-efd8f14d456a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:44.768500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-0ae050ed-5409-4671-bc84-efd8f14d456a None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:44.769823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-0ae050ed-5409-4671-bc84-efd8f14d456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:44.802122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15a817-29a9-4ec1-a99b-a0cee84fff96 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:44.843973 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76067484-ddf4-43e5-aa81-58bc3efa5124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:44.844917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76067484-ddf4-43e5-aa81-58bc3efa5124 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:44.845308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76067484-ddf4-43e5-aa81-58bc3efa5124 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:44.845842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76067484-ddf4-43e5-aa81-58bc3efa5124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:44.852204 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 248/493] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:44.853309 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae050ed-5409-4671-bc84-efd8f14d456a None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:44.870672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76067484-ddf4-43e5-aa81-58bc3efa5124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:44.872275 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76067484-ddf4-43e5-aa81-58bc3efa5124 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:44.899401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-76067484-ddf4-43e5-aa81-58bc3efa5124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:44.899401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:44.899401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:44.899401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:44.899401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:44.899401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:44.899401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:44.899401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:44.899401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:44.899401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:44.899401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:44.899401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:44.899401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:44.899401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:44.899401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:44.900489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:44.900489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:44.900489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:44.900489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:44.900489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:44.900489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:44.900489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:44.900489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:44.900489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:44.900489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:44.900489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:44.900489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:44.900489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:44.900489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:44.900489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:44.900489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:44.900489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:44.901560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:44.901560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:44.901560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:44.901560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:44.903291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 246/494] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:44.908912 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76067484-ddf4-43e5-aa81-58bc3efa5124 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:44.981336 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:44.986095 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae050ed-5409-4671-bc84-efd8f14d456a None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:44.991443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:45.015976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76067484-ddf4-43e5-aa81-58bc3efa5124 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:45.023768 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28632b6b-2a88-4c58-bdb8-704f90da2159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:45.024807 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28632b6b-2a88-4c58-bdb8-704f90da2159 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:45.025308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28632b6b-2a88-4c58-bdb8-704f90da2159 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:45.025802 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28632b6b-2a88-4c58-bdb8-704f90da2159 None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:45.026840 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28632b6b-2a88-4c58-bdb8-704f90da2159 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:45.027347 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28632b6b-2a88-4c58-bdb8-704f90da2159 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:45.029609 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28632b6b-2a88-4c58-bdb8-704f90da2159 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:45.052967 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb4389-b444-4351-9c39-8110b09c43d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:45.053837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb4389-b444-4351-9c39-8110b09c43d7 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:45.054125 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb4389-b444-4351-9c39-8110b09c43d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:45.054400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb4389-b444-4351-9c39-8110b09c43d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:45.065939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb4389-b444-4351-9c39-8110b09c43d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:45.072054 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 249/495] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jun 23 10:39:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:45.073218 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28632b6b-2a88-4c58-bdb8-704f90da2159 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:45.074310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-26cb4389-b444-4351-9c39-8110b09c43d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:45.074310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:45.074310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:45.074310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:45.074310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:45.074310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:45.074310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:45.074310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:45.074310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:45.074310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:45.074310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:45.074310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:45.074310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:45.074310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:45.074310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:45.074310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:45.075156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:45.075156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:45.075156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:45.075156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:45.075156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:45.075156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:45.075156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:45.075156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:45.075156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:45.075156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:45.075156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:45.075156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:45.075156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:45.075156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:45.075156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:45.075156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:45.076769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:45.076769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:45.076769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:45.076769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:45.076769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:45.076769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:45.076769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:45.076769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:45.076769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:45.076769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:45.076769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:45.076769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:45.076769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 247/496] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:39:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:45.081920 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb4389-b444-4351-9c39-8110b09c43d7 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:45.188698 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28632b6b-2a88-4c58-bdb8-704f90da2159 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:45.191702 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb4389-b444-4351-9c39-8110b09c43d7 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:45.227823 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57e870-3bd4-408d-9bfd-646e114fc0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:45.228141 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd384226-ca7f-4e53-903c-97f21aa65f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:45.228845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd384226-ca7f-4e53-903c-97f21aa65f66 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:45.229132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd384226-ca7f-4e53-903c-97f21aa65f66 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:45.229377 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57e870-3bd4-408d-9bfd-646e114fc0fd None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:45.229476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd384226-ca7f-4e53-903c-97f21aa65f66 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:45.229938 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57e870-3bd4-408d-9bfd-646e114fc0fd None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:45.230118 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd384226-ca7f-4e53-903c-97f21aa65f66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:45.230434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd384226-ca7f-4e53-903c-97f21aa65f66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:45.230739 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57e870-3bd4-408d-9bfd-646e114fc0fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:45.231940 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd384226-ca7f-4e53-903c-97f21aa65f66 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:45.235731 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:45.245112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 250/497] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:45.246015 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd384226-ca7f-4e53-903c-97f21aa65f66 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:45.266825 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:45.312844 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57e870-3bd4-408d-9bfd-646e114fc0fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:45.314314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57e870-3bd4-408d-9bfd-646e114fc0fd None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:45.349841 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd384226-ca7f-4e53-903c-97f21aa65f66 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:45.384175 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875715d-1230-46ee-a871-250365dc9225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:45.384871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875715d-1230-46ee-a871-250365dc9225 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:45.385161 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875715d-1230-46ee-a871-250365dc9225 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:45.385439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875715d-1230-46ee-a871-250365dc9225 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:45.386187 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875715d-1230-46ee-a871-250365dc9225 None admin] RBAC: Adding query filter params (name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:45.386496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875715d-1230-46ee-a871-250365dc9225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:45.387876 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875715d-1230-46ee-a871-250365dc9225 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:45.396269 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 251/498] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:39:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:45.397523 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fac609-eb49-4c05-a16c-e0f517690eea None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:45.397819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fac609-eb49-4c05-a16c-e0f517690eea None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:45.398107 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fac609-eb49-4c05-a16c-e0f517690eea None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:45.399336 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 252/499] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:45.400035 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fac609-eb49-4c05-a16c-e0f517690eea None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:45.416301 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 248/500] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:45.418313 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f9e5a-39ff-4001-a0b9-e54d4e6bf4ed None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:45.418673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f9e5a-39ff-4001-a0b9-e54d4e6bf4ed None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:45.419024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f9e5a-39ff-4001-a0b9-e54d4e6bf4ed None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:45.420420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 249/501] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:45.421225 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f9e5a-39ff-4001-a0b9-e54d4e6bf4ed None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:45.455908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:45.488995 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:45.509262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fac609-eb49-4c05-a16c-e0f517690eea None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:45.519962 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f9e5a-39ff-4001-a0b9-e54d4e6bf4ed None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:45.542900 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeeed13-8e8e-4c1f-9b6a-593bb4a15825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:45.543681 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeed13-8e8e-4c1f-9b6a-593bb4a15825 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:45.543959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeed13-8e8e-4c1f-9b6a-593bb4a15825 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:45.544229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeed13-8e8e-4c1f-9b6a-593bb4a15825 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:45.551487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeeed13-8e8e-4c1f-9b6a-593bb4a15825 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:45.552610 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566247-88e4-4646-b221-51b1a3352cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:45.552941 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeeed13-8e8e-4c1f-9b6a-593bb4a15825 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:45.553416 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566247-88e4-4646-b221-51b1a3352cd4 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:45.553699 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566247-88e4-4646-b221-51b1a3352cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:45.553972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566247-88e4-4646-b221-51b1a3352cd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:45.563774 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89566247-88e4-4646-b221-51b1a3352cd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:45.565233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89566247-88e4-4646-b221-51b1a3352cd4 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:45.566709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-bbeeed13-8e8e-4c1f-9b6a-593bb4a15825 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 10:39:45.566709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:45.566709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:45.566709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:45.566709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:45.566709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:45.566709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:45.566709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:45.566709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:45.566709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:45.566709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:45.566709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:45.566709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:39:45.566709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:39:45.566709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:39:45.566709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:39:45.567819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:45.567819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:45.567819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:39:45.567819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:45.567819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:39:45.567819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:45.567819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:45.567819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:45.567819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:45.567819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:45.567819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:45.567819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:45.567819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:45.567819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:45.567819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:45.567819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:45.567819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:45.567819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:45.568801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:45.568801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:45.568801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:39:45.568801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:39:45.568801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:39:45.568801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:39:45.568801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:39:45.568801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:39:45.568801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 10:39:45.568801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:45.568801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 253/502] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:45.569449 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d94b27-bf59-4bd4-92a0-e14d4856d339 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:45.569449 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d94b27-bf59-4bd4-92a0-e14d4856d339 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:45.569606 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d94b27-bf59-4bd4-92a0-e14d4856d339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:45.587157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-89566247-88e4-4646-b221-51b1a3352cd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:45.587157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:45.587157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:45.587157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:45.587157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:45.587157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:45.587157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:45.587157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:45.587157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:45.587157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:45.587157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:45.587157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:45.587157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:45.587157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:45.587157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:45.588050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:45.588050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:45.588050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:45.588050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:45.588050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:45.588050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:45.588050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:45.588050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:45.588050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:45.588050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:45.588050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:45.588050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:45.588050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:45.588050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:45.588050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:45.588050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:45.588050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:45.588948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:45.588948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:45.588948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:45.588948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:45.589162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-01d94b27-bf59-4bd4-92a0-e14d4856d339 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:45.589233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 250/503] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:45.589298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-01d94b27-bf59-4bd4-92a0-e14d4856d339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:45.589363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566247-88e4-4646-b221-51b1a3352cd4 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:45.663257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 254/504] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:45.664838 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d427-1a96-45c4-9152-858a26bd846f None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:45.665290 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d427-1a96-45c4-9152-858a26bd846f None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:45.665714 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d427-1a96-45c4-9152-858a26bd846f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:45.681190 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:45.681480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-b7d2d427-1a96-45c4-9152-858a26bd846f None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:45.682690 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b7d2d427-1a96-45c4-9152-858a26bd846f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:45.694485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566247-88e4-4646-b221-51b1a3352cd4 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:45.728392 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b60f7-a22e-4437-9a2b-89951c5470c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:45.729214 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b60f7-a22e-4437-9a2b-89951c5470c5 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:45.729498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b60f7-a22e-4437-9a2b-89951c5470c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:45.729775 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b60f7-a22e-4437-9a2b-89951c5470c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:45.740425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b60f7-a22e-4437-9a2b-89951c5470c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:45.741847 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b60f7-a22e-4437-9a2b-89951c5470c5 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:45.745570 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:45.750123 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 255/505] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:45.750916 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2d427-1a96-45c4-9152-858a26bd846f None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:45.759346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-cf0b60f7-a22e-4437-9a2b-89951c5470c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:45.759346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:45.759346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:45.759346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:45.759346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:45.759346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:45.759346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:45.759346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:45.759346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:45.759346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:45.759346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:45.759346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:45.759346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:45.759346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:45.759346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:45.765813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:45.765813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:45.765813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:45.765813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:45.765813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:45.765813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:45.765813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:45.765813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:45.765813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:45.765813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:45.765813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:45.765813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:45.765813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:45.765813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:45.765813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:45.765813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:45.765813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:45.766866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:45.766866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:45.766866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:45.766866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:45.766866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 251/506] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:45.766866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b60f7-a22e-4437-9a2b-89951c5470c5 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:45.853734 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2d427-1a96-45c4-9152-858a26bd846f None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:45.859393 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b60f7-a22e-4437-9a2b-89951c5470c5 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:45.888795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a5266-741d-46a0-956f-4872866cf44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:45.889471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a5266-741d-46a0-956f-4872866cf44f None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:45.889757 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a5266-741d-46a0-956f-4872866cf44f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:45.890040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a5266-741d-46a0-956f-4872866cf44f None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:45.890883 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a5266-741d-46a0-956f-4872866cf44f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:45.891197 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a5266-741d-46a0-956f-4872866cf44f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:45.892631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a5266-741d-46a0-956f-4872866cf44f None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:45.892757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce5377-74a6-4b82-b4da-56fa53d7a240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:45.893342 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce5377-74a6-4b82-b4da-56fa53d7a240 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:45.893626 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce5377-74a6-4b82-b4da-56fa53d7a240 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:45.893904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce5377-74a6-4b82-b4da-56fa53d7a240 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:45.894622 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce5377-74a6-4b82-b4da-56fa53d7a240 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:45.894930 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce5377-74a6-4b82-b4da-56fa53d7a240 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:45.896288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce5377-74a6-4b82-b4da-56fa53d7a240 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:45.904838 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:45.912408 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 252/507] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:45.912408 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce5377-74a6-4b82-b4da-56fa53d7a240 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:45.912617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 256/508] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jun 23 10:39:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:45.912617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a5266-741d-46a0-956f-4872866cf44f None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:45.971614 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:46.008703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce5377-74a6-4b82-b4da-56fa53d7a240 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:46.011884 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a5266-741d-46a0-956f-4872866cf44f None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:46.042574 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48d9d7-c8c2-4b0f-be70-989a270f4bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:46.043366 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48d9d7-c8c2-4b0f-be70-989a270f4bb8 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:46.043649 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48d9d7-c8c2-4b0f-be70-989a270f4bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:46.043925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48d9d7-c8c2-4b0f-be70-989a270f4bb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:46.047075 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a054f44-e5f1-4203-bf0e-e2f26d5b352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:46.047748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a054f44-e5f1-4203-bf0e-e2f26d5b352e None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:46.048041 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a054f44-e5f1-4203-bf0e-e2f26d5b352e None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:46.048326 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a054f44-e5f1-4203-bf0e-e2f26d5b352e None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:46.049083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a054f44-e5f1-4203-bf0e-e2f26d5b352e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:46.049396 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a054f44-e5f1-4203-bf0e-e2f26d5b352e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:46.050777 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a054f44-e5f1-4203-bf0e-e2f26d5b352e None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:46.054873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48d9d7-c8c2-4b0f-be70-989a270f4bb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:46.056316 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48d9d7-c8c2-4b0f-be70-989a270f4bb8 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:46.062093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 257/509] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:46.062891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a054f44-e5f1-4203-bf0e-e2f26d5b352e None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:46.077811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-bb48d9d7-c8c2-4b0f-be70-989a270f4bb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:46.077811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:46.077811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:46.077811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:46.077811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:46.077811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:46.077811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:46.077811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:46.077811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:46.077811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:46.077811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:46.077811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:46.077811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:46.077811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:46.077811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:46.078723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:46.078723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:46.078723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:46.078723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:46.078723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:46.078723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:46.078723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:46.078723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:46.078723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:46.078723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:46.078723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:46.078723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:46.078723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:46.078723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:46.078723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:46.078723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:46.078723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:46.079535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:46.079535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:46.079535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:46.079535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:46.079535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 253/510] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:46.079790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48d9d7-c8c2-4b0f-be70-989a270f4bb8 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:46.130536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:46.168006 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a054f44-e5f1-4203-bf0e-e2f26d5b352e None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:46.178430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48d9d7-c8c2-4b0f-be70-989a270f4bb8 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:46.184305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:46.201410 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7fbca-50d3-428f-91e5-75807c9de0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:46.202198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7fbca-50d3-428f-91e5-75807c9de0d0 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:46.202484 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7fbca-50d3-428f-91e5-75807c9de0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:46.202756 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7fbca-50d3-428f-91e5-75807c9de0d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:46.211580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac746a17-98c9-476d-bb0f-087016cb35a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:46.212372 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac746a17-98c9-476d-bb0f-087016cb35a0 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:46.212721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac746a17-98c9-476d-bb0f-087016cb35a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:46.213012 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac746a17-98c9-476d-bb0f-087016cb35a0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:46.213123 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7fbca-50d3-428f-91e5-75807c9de0d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:46.220925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac746a17-98c9-476d-bb0f-087016cb35a0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:46.221821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-f5d7fbca-50d3-428f-91e5-75807c9de0d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:46.221821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:46.221821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:46.221821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:46.221821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:46.221821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:46.221821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:46.221821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:46.221821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:46.221821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:46.221821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:46.221821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:46.221821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:46.221821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:46.221821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:46.221821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:46.222893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:46.222893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:46.222893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:46.222893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:46.222893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:46.222893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:46.222893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:46.222893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:46.222893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:46.222893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:46.222893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:46.222893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:46.222893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:46.222893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:46.222893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:46.222893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:46.223793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:46.223793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:46.223793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:46.223793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:46.223793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:46.223793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:46.223793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:46.223793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:46.223793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:46.223793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:46.223793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:46.223793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:46.224420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac746a17-98c9-476d-bb0f-087016cb35a0 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:46.224496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 258/511] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:39:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:46.224496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7fbca-50d3-428f-91e5-75807c9de0d0 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:46.239690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-ac746a17-98c9-476d-bb0f-087016cb35a0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 10:39:46.239690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:46.239690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:46.239690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:46.239690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:46.239690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:46.239690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:46.239690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:46.239690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:46.239690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:46.239690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:46.239690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:46.239690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:39:46.239690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:39:46.239690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:39:46.239690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:39:46.240685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:46.240685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:46.240685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:39:46.240685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:46.240685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:39:46.240685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:46.240685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:46.240685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:46.240685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:46.240685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:46.240685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:46.240685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:46.240685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:46.240685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:46.240685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:46.240685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:46.240685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:46.240685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:46.241561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:46.241561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:46.241561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:39:46.241561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:39:46.241561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:39:46.241561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:39:46.241561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:39:46.241561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:39:46.241561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 10:39:46.241561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:46.241561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 254/512] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:39:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:46.242142 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac746a17-98c9-476d-bb0f-087016cb35a0 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:46.329314 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7fbca-50d3-428f-91e5-75807c9de0d0 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:46.338399 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac746a17-98c9-476d-bb0f-087016cb35a0 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:46.351520 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:46.363308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f7c95-39ff-4e5b-865c-0be69dcf9810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:46.376234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f7c95-39ff-4e5b-865c-0be69dcf9810 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:46.376234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f7c95-39ff-4e5b-865c-0be69dcf9810 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:46.376234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f7c95-39ff-4e5b-865c-0be69dcf9810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:46.376479 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706583fb-868c-4b1d-a47f-6a492c34a709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:46.376479 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706583fb-868c-4b1d-a47f-6a492c34a709 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:46.376479 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706583fb-868c-4b1d-a47f-6a492c34a709 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:46.376479 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706583fb-868c-4b1d-a47f-6a492c34a709 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:46.380660 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706583fb-868c-4b1d-a47f-6a492c34a709 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:46.382145 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706583fb-868c-4b1d-a47f-6a492c34a709 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:46.397281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-706583fb-868c-4b1d-a47f-6a492c34a709 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:46.397281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:46.397281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:46.397281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:46.397281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:46.397281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:46.397281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:46.397281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:46.397281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:46.397281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:46.397281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:46.397281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:46.397281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:39:46.397281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:39:46.397281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:39:46.398302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:39:46.398302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:46.398302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:46.398302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:46.398302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:46.398302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:46.398302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:46.398302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:46.398302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:46.398302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:46.398302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:46.398302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:46.398302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:46.398302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:46.398302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:46.398302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:46.398302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:46.399341 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:39:46.399341 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:39:46.399341 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:39:46.399341 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:39:46.399341 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:39:46.399341 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:39:46.399341 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:46.399341 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:46.401285 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 255/513] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:46.402311 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706583fb-868c-4b1d-a47f-6a492c34a709 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:46.413949 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:46.436165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f7c95-39ff-4e5b-865c-0be69dcf9810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:46.437671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f7c95-39ff-4e5b-865c-0be69dcf9810 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:46.501864 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706583fb-868c-4b1d-a47f-6a492c34a709 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:46.535830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f849f-a33a-43c0-b5b3-8632885a93d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:46.536094 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 259/514] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:46.536498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f849f-a33a-43c0-b5b3-8632885a93d5 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:46.536819 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f849f-a33a-43c0-b5b3-8632885a93d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:46.536976 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f7c95-39ff-4e5b-865c-0be69dcf9810 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:46.537125 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f849f-a33a-43c0-b5b3-8632885a93d5 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:46.537896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f849f-a33a-43c0-b5b3-8632885a93d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:46.538233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f849f-a33a-43c0-b5b3-8632885a93d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:46.539613 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f849f-a33a-43c0-b5b3-8632885a93d5 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:46.551360 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 256/515] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:46.552163 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f849f-a33a-43c0-b5b3-8632885a93d5 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:46.583200 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:46.623245 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:46.645159 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f7c95-39ff-4e5b-865c-0be69dcf9810 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:46.650587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f849f-a33a-43c0-b5b3-8632885a93d5 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:46.677761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23ebab-471d-43a4-bc9c-40176256dbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:46.678431 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23ebab-471d-43a4-bc9c-40176256dbe6 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:46.678720 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23ebab-471d-43a4-bc9c-40176256dbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:46.679000 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23ebab-471d-43a4-bc9c-40176256dbe6 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:46.679746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23ebab-471d-43a4-bc9c-40176256dbe6 None admin] RBAC: Adding query filter params (name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:46.680056 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23ebab-471d-43a4-bc9c-40176256dbe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:46.681471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23ebab-471d-43a4-bc9c-40176256dbe6 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:46.684495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9b3bf-abd3-4154-8efa-a149b25f1df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:46.685973 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9b3bf-abd3-4154-8efa-a149b25f1df8 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:46.686339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9b3bf-abd3-4154-8efa-a149b25f1df8 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:46.686625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9b3bf-abd3-4154-8efa-a149b25f1df8 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:46.687492 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9b3bf-abd3-4154-8efa-a149b25f1df8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:46.687815 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9b3bf-abd3-4154-8efa-a149b25f1df8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:46.689283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9b3bf-abd3-4154-8efa-a149b25f1df8 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:46.689863 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 260/516] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:39:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:46.690660 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23ebab-471d-43a4-bc9c-40176256dbe6 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:46.727051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 257/517] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Jun 23 10:39:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:46.727896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9b3bf-abd3-4154-8efa-a149b25f1df8 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:46.789157 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23ebab-471d-43a4-bc9c-40176256dbe6 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:46.817006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:46.822794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e288a-a4b1-4125-97a3-2d73c0c2b4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:46.823455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e288a-a4b1-4125-97a3-2d73c0c2b4a4 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:46.823739 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e288a-a4b1-4125-97a3-2d73c0c2b4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:46.824039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e288a-a4b1-4125-97a3-2d73c0c2b4a4 None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:46.824840 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e288a-a4b1-4125-97a3-2d73c0c2b4a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:46.825155 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e288a-a4b1-4125-97a3-2d73c0c2b4a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:46.825944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9b3bf-abd3-4154-8efa-a149b25f1df8 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:46.826971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e288a-a4b1-4125-97a3-2d73c0c2b4a4 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:46.841271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:46.845131 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 261/518] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:46.845746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e288a-a4b1-4125-97a3-2d73c0c2b4a4 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:46.860459 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59571788-1991-4372-9eb0-e5e16d9b80a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:46.861303 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59571788-1991-4372-9eb0-e5e16d9b80a0 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:46.861621 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59571788-1991-4372-9eb0-e5e16d9b80a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:46.861937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59571788-1991-4372-9eb0-e5e16d9b80a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:46.872017 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59571788-1991-4372-9eb0-e5e16d9b80a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:46.874251 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59571788-1991-4372-9eb0-e5e16d9b80a0 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:46.891363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-59571788-1991-4372-9eb0-e5e16d9b80a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:46.891363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:46.891363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:46.891363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:46.891363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:46.891363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:46.891363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:46.891363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:46.891363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:46.891363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:46.891363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:46.891363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:46.891363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:46.891363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:46.891363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:46.892379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:46.892379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:46.892379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:46.892379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:46.892379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:46.892379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:46.892379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:46.892379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:46.892379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:46.892379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:46.892379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:46.892379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:46.892379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:46.892379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:46.892379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:46.892379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:46.892379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:46.893274 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:46.893274 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:46.893274 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:46.893274 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:46.893274 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 258/519] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:46.893733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59571788-1991-4372-9eb0-e5e16d9b80a0 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:46.946833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e288a-a4b1-4125-97a3-2d73c0c2b4a4 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:46.980416 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56362155-0507-485c-91b1-d48dbe0c8615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:46.981213 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56362155-0507-485c-91b1-d48dbe0c8615 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:46.981508 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56362155-0507-485c-91b1-d48dbe0c8615 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:46.981793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56362155-0507-485c-91b1-d48dbe0c8615 None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:46.983008 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56362155-0507-485c-91b1-d48dbe0c8615 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:46.984444 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56362155-0507-485c-91b1-d48dbe0c8615 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:46.992119 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59571788-1991-4372-9eb0-e5e16d9b80a0 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:47.025162 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dc2d5-7f21-445e-9411-7a2e3d9bf6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:47.025949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dc2d5-7f21-445e-9411-7a2e3d9bf6ea None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:47.026230 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dc2d5-7f21-445e-9411-7a2e3d9bf6ea None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:47.026504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dc2d5-7f21-445e-9411-7a2e3d9bf6ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:47.036754 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642dc2d5-7f21-445e-9411-7a2e3d9bf6ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:47.038208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642dc2d5-7f21-445e-9411-7a2e3d9bf6ea None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:47.039898 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:47.055538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-642dc2d5-7f21-445e-9411-7a2e3d9bf6ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:47.055538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:47.055538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:47.055538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:47.055538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:47.055538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:47.055538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:47.055538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:47.055538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:47.055538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:47.055538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:47.055538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:47.055538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:47.055538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:47.055538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:47.056536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:47.056536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:47.056536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:47.056536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:47.056536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:47.056536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:47.056536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:47.056536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:47.056536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:47.056536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:47.056536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:47.056536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:47.056536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:47.056536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:47.056536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:47.056536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:47.056536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:47.057633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:47.057633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:47.057633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:47.057633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:47.057633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 259/520] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:47.057633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dc2d5-7f21-445e-9411-7a2e3d9bf6ea None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:47.075384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 262/521] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 23 10:39:46 2022] POST /identity/v3/users => generated 247 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:39:47.075384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56362155-0507-485c-91b1-d48dbe0c8615 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:47.142711 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:47.182330 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dc2d5-7f21-445e-9411-7a2e3d9bf6ea None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:47.191341 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56362155-0507-485c-91b1-d48dbe0c8615 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:47.224914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd451ba-c7b9-4c05-8ea6-12a7150bafaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:47.225584 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd451ba-c7b9-4c05-8ea6-12a7150bafaa None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:47.225870 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd451ba-c7b9-4c05-8ea6-12a7150bafaa None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:47.226148 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd451ba-c7b9-4c05-8ea6-12a7150bafaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:47.227666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed2860-a556-4f70-b326-e7652f8f136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:47.228323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed2860-a556-4f70-b326-e7652f8f136f None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:47.228667 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed2860-a556-4f70-b326-e7652f8f136f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:47.228981 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed2860-a556-4f70-b326-e7652f8f136f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:47.230776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed2860-a556-4f70-b326-e7652f8f136f None admin] RBAC: Adding query filter params (role.id=3522dd96085d47688d7a42ed133484a9, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=39840f048d254831bdb963b38520f706) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:47.231153 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed2860-a556-4f70-b326-e7652f8f136f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:47.233312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed2860-a556-4f70-b326-e7652f8f136f None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:47.239943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 263/522] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:47 2022] GET /identity/v3/role_assignments?user.id=39840f048d254831bdb963b38520f706&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=3522dd96085d47688d7a42ed133484a9 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:47.240878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed2860-a556-4f70-b326-e7652f8f136f None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:47.303357 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:47.317758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd451ba-c7b9-4c05-8ea6-12a7150bafaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:47.320119 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd451ba-c7b9-4c05-8ea6-12a7150bafaa None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:47.369771 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed2860-a556-4f70-b326-e7652f8f136f None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:47.405428 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:47.427458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d284c5-c46f-4430-a54f-d38a528c8df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:47.428244 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d284c5-c46f-4430-a54f-d38a528c8df8 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:47.428539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d284c5-c46f-4430-a54f-d38a528c8df8 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:47.428852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d284c5-c46f-4430-a54f-d38a528c8df8 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:47.429697 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d284c5-c46f-4430-a54f-d38a528c8df8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:47.430022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d284c5-c46f-4430-a54f-d38a528c8df8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:47.431785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d284c5-c46f-4430-a54f-d38a528c8df8 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:47.447179 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 264/523] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:47.453300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d284c5-c46f-4430-a54f-d38a528c8df8 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:47.456239 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 260/524] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:47.461424 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd451ba-c7b9-4c05-8ea6-12a7150bafaa None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:47.561461 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:47.568199 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd451ba-c7b9-4c05-8ea6-12a7150bafaa None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:47.569044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d284c5-c46f-4430-a54f-d38a528c8df8 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:47.604441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef01b4-6c9b-4370-b633-4289680dd292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:47.605272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef01b4-6c9b-4370-b633-4289680dd292 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:47.605659 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef01b4-6c9b-4370-b633-4289680dd292 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:47.605942 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef01b4-6c9b-4370-b633-4289680dd292 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:47.616929 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77268c-61f0-4e07-b141-ab310d0b5d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:47.617632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77268c-61f0-4e07-b141-ab310d0b5d47 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:47.617927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77268c-61f0-4e07-b141-ab310d0b5d47 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:47.618194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77268c-61f0-4e07-b141-ab310d0b5d47 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:47.618936 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77268c-61f0-4e07-b141-ab310d0b5d47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:47.619250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77268c-61f0-4e07-b141-ab310d0b5d47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:47.620699 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77268c-61f0-4e07-b141-ab310d0b5d47 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:47.625816 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef01b4-6c9b-4370-b633-4289680dd292 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:47.627526 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef01b4-6c9b-4370-b633-4289680dd292 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:47.640260 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 265/525] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:47.641292 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77268c-61f0-4e07-b141-ab310d0b5d47 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:47.645669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-b7ef01b4-6c9b-4370-b633-4289680dd292 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:47.645669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:47.645669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:47.645669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:47.645669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:47.645669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:47.645669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:47.645669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:47.645669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:47.645669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:47.645669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:47.645669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:47.645669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:39:47.645669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:39:47.645669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:39:47.646519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:39:47.646519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:47.646519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:47.646519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:47.646519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:47.646519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:47.646519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:47.646519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:47.646519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:47.646519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:47.646519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:47.646519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:47.646519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:47.646519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:47.646519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:47.646519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:47.646519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:47.647353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:39:47.647353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:39:47.647353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:39:47.647353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:39:47.647353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:39:47.647353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:39:47.647353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:47.647353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:47.649857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 261/526] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:47.650965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef01b4-6c9b-4370-b633-4289680dd292 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:47.693223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:47.760426 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77268c-61f0-4e07-b141-ab310d0b5d47 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:47.763761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef01b4-6c9b-4370-b633-4289680dd292 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:47.798874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9b424-0b3c-4ea8-86a9-ca1e098a88cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:47.799778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9b424-0b3c-4ea8-86a9-ca1e098a88cd None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:47.800071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9b424-0b3c-4ea8-86a9-ca1e098a88cd None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:47.800355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9b424-0b3c-4ea8-86a9-ca1e098a88cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:47.801012 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7860f-678f-4421-9ed1-4c591788fa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:47.802201 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7860f-678f-4421-9ed1-4c591788fa8c None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:47.802937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7860f-678f-4421-9ed1-4c591788fa8c None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:47.803944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7860f-678f-4421-9ed1-4c591788fa8c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:47.813512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9b424-0b3c-4ea8-86a9-ca1e098a88cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:47.814664 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7860f-678f-4421-9ed1-4c591788fa8c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:47.814977 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9b424-0b3c-4ea8-86a9-ca1e098a88cd None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:47.817031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7860f-678f-4421-9ed1-4c591788fa8c None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:47.833299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-e9e9b424-0b3c-4ea8-86a9-ca1e098a88cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:47.833299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:47.833299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:47.833299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:47.833299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:47.833299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:47.833299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:47.833299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:47.833299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:47.833299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:47.833299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:47.833299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:47.833299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:47.833299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:47.833299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:47.834208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:47.834208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:47.834208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:47.834208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:47.834208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:47.834208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:47.834208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:47.834208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:47.834208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:47.834208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:47.834208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:47.834208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:47.834208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:47.834208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:47.834208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:47.834208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:47.834208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:47.835041 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:47.835041 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:47.835041 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:47.835041 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:47.836019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-e8e7860f-678f-4421-9ed1-4c591788fa8c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:39:47.836019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:47.836019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:47.836019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:47.836019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:47.836019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:47.836019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:47.836019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:47.836019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:47.836019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:47.836019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:47.836019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:47.836019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:39:47.836019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:39:47.836019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:39:47.836019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:39:47.836908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:47.836908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:47.836908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:39:47.836908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:47.836908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:39:47.836908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:47.836908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:47.836908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:47.836908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:47.836908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:47.836908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:47.836908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:47.836908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:47.836908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:47.836908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:47.836908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:47.836908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:47.836908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:47.837788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:47.837788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:47.837788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:39:47.837788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:39:47.837788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:39:47.837788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:39:47.837788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:39:47.837788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:39:47.837788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:39:47.837788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:47.839124 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 266/527] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:47.840029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9b424-0b3c-4ea8-86a9-ca1e098a88cd None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:47.840660 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 262/528] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:47.841869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7860f-678f-4421-9ed1-4c591788fa8c None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:47.860140 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:47.951960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:47.959052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7860f-678f-4421-9ed1-4c591788fa8c None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:47.962048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9b424-0b3c-4ea8-86a9-ca1e098a88cd None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:48.001885 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be0fa6-2665-46f1-ab0b-d40a43648f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:48.002907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be0fa6-2665-46f1-ab0b-d40a43648f9f None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:48.003393 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be0fa6-2665-46f1-ab0b-d40a43648f9f None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:48.004110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be0fa6-2665-46f1-ab0b-d40a43648f9f None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:48.005101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be0fa6-2665-46f1-ab0b-d40a43648f9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:48.005633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be0fa6-2665-46f1-ab0b-d40a43648f9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:48.006272 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc12a40-e4c7-4efb-852e-be4081b1aabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:48.006945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc12a40-e4c7-4efb-852e-be4081b1aabc None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:48.007236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc12a40-e4c7-4efb-852e-be4081b1aabc None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:48.007518 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc12a40-e4c7-4efb-852e-be4081b1aabc None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:48.008077 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be0fa6-2665-46f1-ab0b-d40a43648f9f None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:48.008315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc12a40-e4c7-4efb-852e-be4081b1aabc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:48.008629 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc12a40-e4c7-4efb-852e-be4081b1aabc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:48.010060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc12a40-e4c7-4efb-852e-be4081b1aabc None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:48.022291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 263/529] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:48.023377 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be0fa6-2665-46f1-ab0b-d40a43648f9f None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:48.029591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 267/530] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:39:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:48.031288 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc12a40-e4c7-4efb-852e-be4081b1aabc None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:48.128468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:48.147132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc12a40-e4c7-4efb-852e-be4081b1aabc None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:48.163548 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be0fa6-2665-46f1-ab0b-d40a43648f9f None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:48.186460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9154be-817b-4e47-adff-73f8da3d3019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:48.187643 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9154be-817b-4e47-adff-73f8da3d3019 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:48.188148 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9154be-817b-4e47-adff-73f8da3d3019 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:48.188624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9154be-817b-4e47-adff-73f8da3d3019 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:48.196097 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9154be-817b-4e47-adff-73f8da3d3019 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:48.198005 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9154be-817b-4e47-adff-73f8da3d3019 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:48.206958 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a9d13-8229-488f-a05a-687eb15ea8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:48.207575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a9d13-8229-488f-a05a-687eb15ea8b8 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:48.207865 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a9d13-8229-488f-a05a-687eb15ea8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:48.208145 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a9d13-8229-488f-a05a-687eb15ea8b8 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:48.209013 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a9d13-8229-488f-a05a-687eb15ea8b8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:48.209326 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a9d13-8229-488f-a05a-687eb15ea8b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:48.210749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a9d13-8229-488f-a05a-687eb15ea8b8 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:48.215631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-dc9154be-817b-4e47-adff-73f8da3d3019 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:48.215631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:48.215631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:48.215631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:48.215631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:48.215631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:48.215631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:48.215631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:48.215631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:48.215631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:48.215631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:48.215631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:48.215631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:39:48.215631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:39:48.215631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:39:48.217007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:39:48.217007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:48.217007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:48.217007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:48.217007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:48.217007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:48.217007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:48.217007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:48.217007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:48.217007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:48.217007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:48.217007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:48.217007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:48.217007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:48.217007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:48.217007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:48.217007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:48.217859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:39:48.217859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:39:48.217859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:39:48.217859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:39:48.217859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:39:48.217859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:39:48.217859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:48.217859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:48.224770 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 268/531] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:48.225950 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9154be-817b-4e47-adff-73f8da3d3019 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:48.229394 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 264/532] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jun 23 10:39:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:48.232968 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a9d13-8229-488f-a05a-687eb15ea8b8 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:48.247654 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:48.355379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a9d13-8229-488f-a05a-687eb15ea8b8 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:48.356184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9154be-817b-4e47-adff-73f8da3d3019 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:48.393636 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:48.399705 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cb21d-176e-4a30-bf25-37d0703f9e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:48.400485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cb21d-176e-4a30-bf25-37d0703f9e6e None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:48.403527 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cb21d-176e-4a30-bf25-37d0703f9e6e None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:48.403527 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cb21d-176e-4a30-bf25-37d0703f9e6e None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:48.403752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f4c5d-f6ec-45b0-b0b5-4c75ca8c170c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:48.403868 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cb21d-176e-4a30-bf25-37d0703f9e6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:48.403941 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f4c5d-f6ec-45b0-b0b5-4c75ca8c170c None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:48.404498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cb21d-176e-4a30-bf25-37d0703f9e6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:48.404574 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f4c5d-f6ec-45b0-b0b5-4c75ca8c170c None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:48.404574 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f4c5d-f6ec-45b0-b0b5-4c75ca8c170c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:48.404724 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cb21d-176e-4a30-bf25-37d0703f9e6e None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:48.405318 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f4c5d-f6ec-45b0-b0b5-4c75ca8c170c None admin] RBAC: Adding query filter params (role.id=3522dd96085d47688d7a42ed133484a9, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=06498e12426947908d5217e2c948519d) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:48.405833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f4c5d-f6ec-45b0-b0b5-4c75ca8c170c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:48.407619 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f4c5d-f6ec-45b0-b0b5-4c75ca8c170c None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:48.414208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 269/533] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:48 2022] GET /identity/v3/role_assignments?user.id=06498e12426947908d5217e2c948519d&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=3522dd96085d47688d7a42ed133484a9 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:48.415279 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f4c5d-f6ec-45b0-b0b5-4c75ca8c170c None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:48.430911 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 265/534] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:48.436959 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cb21d-176e-4a30-bf25-37d0703f9e6e None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:48.564589 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:48.590655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f4c5d-f6ec-45b0-b0b5-4c75ca8c170c None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:48.648578 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7f274-75f0-43e9-a4f0-c671a865add8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:48.649526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7f274-75f0-43e9-a4f0-c671a865add8 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:48.649929 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7f274-75f0-43e9-a4f0-c671a865add8 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:48.650356 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7f274-75f0-43e9-a4f0-c671a865add8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:48.658682 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cb21d-176e-4a30-bf25-37d0703f9e6e None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:48.699280 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86339df-5083-4f16-abc3-b0ca8286e2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:48.700281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86339df-5083-4f16-abc3-b0ca8286e2a1 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:48.700573 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86339df-5083-4f16-abc3-b0ca8286e2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:48.701494 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86339df-5083-4f16-abc3-b0ca8286e2a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:48.702590 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86339df-5083-4f16-abc3-b0ca8286e2a1 None admin] RBAC: Adding query filter params (role.id=3522dd96085d47688d7a42ed133484a9, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=0348261a78984c62aced60af2768688e) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:48.702910 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86339df-5083-4f16-abc3-b0ca8286e2a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:48.704882 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86339df-5083-4f16-abc3-b0ca8286e2a1 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:48.711845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 266/535] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:48 2022] GET /identity/v3/role_assignments?user.id=0348261a78984c62aced60af2768688e&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=3522dd96085d47688d7a42ed133484a9 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:48.738538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7f274-75f0-43e9-a4f0-c671a865add8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:48.740041 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7f274-75f0-43e9-a4f0-c671a865add8 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:48.830536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:48.859712 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 270/536] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:48.865422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86339df-5083-4f16-abc3-b0ca8286e2a1 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:48.941366 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:49.002471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86339df-5083-4f16-abc3-b0ca8286e2a1 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:49.051849 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7d42a-12a4-4375-ab01-5a7c559f481c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:49.052738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7d42a-12a4-4375-ab01-5a7c559f481c None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:49.053026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7d42a-12a4-4375-ab01-5a7c559f481c None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:49.053310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7d42a-12a4-4375-ab01-5a7c559f481c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:49.068885 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7d42a-12a4-4375-ab01-5a7c559f481c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:49.070376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7d42a-12a4-4375-ab01-5a7c559f481c None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:49.090848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-08b7d42a-12a4-4375-ab01-5a7c559f481c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:49.090848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:49.090848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:49.090848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:49.090848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:49.090848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:49.090848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:49.090848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:49.090848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:49.090848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:49.090848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:49.090848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:49.090848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:49.090848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:49.090848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:49.092519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:49.092519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:49.092519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:49.092519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:49.092519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:49.092519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:49.092519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:49.092519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:49.092519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:49.092519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:49.092519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:49.092519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:49.092519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:49.092519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:49.092519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:49.092519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:49.092519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:49.093388 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:49.093388 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:49.093388 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:49.093388 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:49.093388 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 267/537] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:49.099545 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7f274-75f0-43e9-a4f0-c671a865add8 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:49.220446 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7f274-75f0-43e9-a4f0-c671a865add8 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:49.260574 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e1e61-067b-4ef4-854e-3794b89614b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:49.261275 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e1e61-067b-4ef4-854e-3794b89614b5 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:49.261565 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e1e61-067b-4ef4-854e-3794b89614b5 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:49.261848 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e1e61-067b-4ef4-854e-3794b89614b5 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:49.262588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e1e61-067b-4ef4-854e-3794b89614b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:49.262906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e1e61-067b-4ef4-854e-3794b89614b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:49.265267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e1e61-067b-4ef4-854e-3794b89614b5 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:49.285325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 271/538] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:49.290737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7d42a-12a4-4375-ab01-5a7c559f481c None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:49.393891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4e0d3-0de5-4dea-99cd-a839d58e8be8 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:49.394237 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4e0d3-0de5-4dea-99cd-a839d58e8be8 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:49.394463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4e0d3-0de5-4dea-99cd-a839d58e8be8 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:49.395954 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 272/539] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:39:49.409286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc5b4f-5a8d-416a-808c-f3ddad50f756 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:49.409579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc5b4f-5a8d-416a-808c-f3ddad50f756 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:49.409865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc5b4f-5a8d-416a-808c-f3ddad50f756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:49.438488 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-87fc5b4f-5a8d-416a-808c-f3ddad50f756 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:49.439687 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-87fc5b4f-5a8d-416a-808c-f3ddad50f756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:49.445434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7d42a-12a4-4375-ab01-5a7c559f481c None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:49.461158 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:49.498185 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:49.505334 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d5a4b-9b86-434a-9101-fa5c78c5dca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:49.507335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d5a4b-9b86-434a-9101-fa5c78c5dca4 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:49.509011 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d5a4b-9b86-434a-9101-fa5c78c5dca4 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:49.509460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d5a4b-9b86-434a-9101-fa5c78c5dca4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:49.529512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d5a4b-9b86-434a-9101-fa5c78c5dca4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:49.531488 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d5a4b-9b86-434a-9101-fa5c78c5dca4 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:49.546762 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 273/540] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:39:49.555450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-ce2d5a4b-9b86-434a-9101-fa5c78c5dca4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:49.555450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:49.555450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:49.555450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:49.555450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:49.555450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:49.555450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:49.555450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:49.555450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:49.555450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:49.555450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:49.555450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:49.555450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:39:49.555450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:39:49.555450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:39:49.556268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:39:49.556268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:49.556268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:49.556268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:49.556268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:49.556268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:49.556268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:49.556268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:49.556268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:49.556268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:49.556268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:49.556268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:49.556268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:49.556268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:49.556268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:49.556268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:49.556268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:49.557136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:39:49.557136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:39:49.557136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:39:49.557136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:39:49.557136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:39:49.557136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:39:49.557136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:49.557136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:49.561087 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 268/541] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:49.562671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc5b4f-5a8d-416a-808c-f3ddad50f756 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:49.582803 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d5a4b-9b86-434a-9101-fa5c78c5dca4 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:49.674937 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc5b4f-5a8d-416a-808c-f3ddad50f756 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:49.711712 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec978f1e-33f0-4776-9d5a-2a305cfcca9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:49.712805 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec978f1e-33f0-4776-9d5a-2a305cfcca9d None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:49.713296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec978f1e-33f0-4776-9d5a-2a305cfcca9d None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:49.713772 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec978f1e-33f0-4776-9d5a-2a305cfcca9d None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:49.714799 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec978f1e-33f0-4776-9d5a-2a305cfcca9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:49.715332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec978f1e-33f0-4776-9d5a-2a305cfcca9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:49.717896 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec978f1e-33f0-4776-9d5a-2a305cfcca9d None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:49.730856 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 274/542] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:39:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:49.733177 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e1aa1-857f-40db-ad47-4297f0af6553 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:49.733482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e1aa1-857f-40db-ad47-4297f0af6553 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:49.733761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e1aa1-857f-40db-ad47-4297f0af6553 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:49.735268 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 275/543] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:49.739981 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e1aa1-857f-40db-ad47-4297f0af6553 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:49.766677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:49.770600 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d5a4b-9b86-434a-9101-fa5c78c5dca4 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:49.808740 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eaeffe-c6ca-487a-bccd-ef956b9b8537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:49.809774 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaeffe-c6ca-487a-bccd-ef956b9b8537 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:49.810248 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaeffe-c6ca-487a-bccd-ef956b9b8537 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:49.810816 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaeffe-c6ca-487a-bccd-ef956b9b8537 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:49.821269 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eaeffe-c6ca-487a-bccd-ef956b9b8537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:49.829735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-f1eaeffe-c6ca-487a-bccd-ef956b9b8537 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:49.829735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:49.829735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:49.829735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:49.829735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:49.829735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:49.829735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:49.829735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:49.829735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:49.829735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:49.829735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:49.829735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:49.829735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:49.829735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:49.829735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:49.829735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:49.830615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:49.830615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:49.830615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:49.830615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:49.830615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:49.830615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:49.830615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:49.830615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:49.830615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:49.830615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:49.830615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:49.830615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:49.830615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:49.830615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:49.830615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:49.830615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:49.831395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:49.831395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:49.831395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:49.831395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:49.831395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:49.831395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:49.831395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:49.831395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:49.831395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:49.831395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:49.831395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:49.831395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:49.834228 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 269/544] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:39:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:49.835585 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448fa2a-d1db-41fc-9a0a-54387426c843 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:49.836038 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448fa2a-d1db-41fc-9a0a-54387426c843 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:49.836488 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448fa2a-d1db-41fc-9a0a-54387426c843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:49.846722 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e1aa1-857f-40db-ad47-4297f0af6553 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:49.853778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-e448fa2a-d1db-41fc-9a0a-54387426c843 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:49.855182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e448fa2a-d1db-41fc-9a0a-54387426c843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:49.881338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdb60a-1e2a-4309-a98b-0ff432e67031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:49.882016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdb60a-1e2a-4309-a98b-0ff432e67031 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:49.882351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdb60a-1e2a-4309-a98b-0ff432e67031 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:49.882635 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdb60a-1e2a-4309-a98b-0ff432e67031 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:49.883470 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdb60a-1e2a-4309-a98b-0ff432e67031 None admin] RBAC: Adding query filter params (role.id=3522dd96085d47688d7a42ed133484a9, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=d804e11eb85e4050adaecfbaaa6e5a12) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:49.883783 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdb60a-1e2a-4309-a98b-0ff432e67031 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:49.885323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdb60a-1e2a-4309-a98b-0ff432e67031 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:49.887143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:49.900666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 276/545] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:49 2022] GET /identity/v3/role_assignments?user.id=d804e11eb85e4050adaecfbaaa6e5a12&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=3522dd96085d47688d7a42ed133484a9 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:49.900666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdb60a-1e2a-4309-a98b-0ff432e67031 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:49.967325 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 270/546] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:50.015305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448fa2a-d1db-41fc-9a0a-54387426c843 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:50.059290 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:50.086744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdb60a-1e2a-4309-a98b-0ff432e67031 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:50.132897 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299073e-63a2-49d3-8c0d-435ed0618dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:50.133635 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299073e-63a2-49d3-8c0d-435ed0618dfe None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:50.133926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299073e-63a2-49d3-8c0d-435ed0618dfe None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:50.134205 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299073e-63a2-49d3-8c0d-435ed0618dfe None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:50.135080 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299073e-63a2-49d3-8c0d-435ed0618dfe None admin] RBAC: Adding query filter params (name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:50.135399 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299073e-63a2-49d3-8c0d-435ed0618dfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:50.136942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299073e-63a2-49d3-8c0d-435ed0618dfe None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:50.155836 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448fa2a-d1db-41fc-9a0a-54387426c843 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:50.158053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 277/547] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:39:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:50.163160 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299073e-63a2-49d3-8c0d-435ed0618dfe None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:50.206334 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bae9d-943d-4c54-8e37-2381cdbd4d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:50.207153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bae9d-943d-4c54-8e37-2381cdbd4d0c None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:50.207440 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bae9d-943d-4c54-8e37-2381cdbd4d0c None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:50.207720 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bae9d-943d-4c54-8e37-2381cdbd4d0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:50.230150 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5bae9d-943d-4c54-8e37-2381cdbd4d0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:50.238760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-5a5bae9d-943d-4c54-8e37-2381cdbd4d0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:50.238760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:50.238760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:50.238760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:50.238760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:50.238760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:50.238760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:50.238760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:50.238760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:50.238760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:50.238760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:50.238760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:50.238760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:50.238760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:50.238760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:50.238760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:50.239732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:50.239732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:50.239732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:50.239732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:50.239732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:50.239732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:50.239732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:50.239732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:50.239732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:50.239732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:50.239732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:50.239732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:50.239732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:50.239732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:50.239732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:50.239732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:50.240504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:50.240504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:50.240504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:50.240504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:50.240504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:50.240504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:50.240504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:50.240504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:50.240504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:50.240504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:50.240504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:50.240504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:50.240504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 271/548] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:39:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:50.253878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bae9d-943d-4c54-8e37-2381cdbd4d0c None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:50.296613 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:50.371629 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299073e-63a2-49d3-8c0d-435ed0618dfe None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:50.413166 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d195d-de03-4648-a84f-654708db5cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:50.414080 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d195d-de03-4648-a84f-654708db5cab None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:50.414374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d195d-de03-4648-a84f-654708db5cab None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:50.414663 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d195d-de03-4648-a84f-654708db5cab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:50.431978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bae9d-943d-4c54-8e37-2381cdbd4d0c None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:50.440386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d195d-de03-4648-a84f-654708db5cab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:50.442015 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d195d-de03-4648-a84f-654708db5cab None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:50.469875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f8132-1f58-40b2-9962-23a57b8f2d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:50.470932 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f8132-1f58-40b2-9962-23a57b8f2d68 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:50.471514 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f8132-1f58-40b2-9962-23a57b8f2d68 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:50.472022 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f8132-1f58-40b2-9962-23a57b8f2d68 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:50.472536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-c41d195d-de03-4648-a84f-654708db5cab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:50.472536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:50.472536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:50.472536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:50.472536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:50.472536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:50.472536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:50.472536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:50.472536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:50.472536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:50.472536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:50.472536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:50.472536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:50.472536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:50.472536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:50.473375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:50.473375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:50.473375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:50.473375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:50.473375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:50.473375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:50.473375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:50.473375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:50.473375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:50.473375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:50.473375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:50.473375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:50.473375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:50.473375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:50.473375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:50.473375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:50.473375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:50.474240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:50.474240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:50.474240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:50.474240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:50.474240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 278/549] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:50.475477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f8132-1f58-40b2-9962-23a57b8f2d68 None admin] RBAC: Adding query filter params (name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:50.476018 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f8132-1f58-40b2-9962-23a57b8f2d68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:50.477659 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f8132-1f58-40b2-9962-23a57b8f2d68 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:50.481346 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d195d-de03-4648-a84f-654708db5cab None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:50.487786 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:50.496060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 272/550] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:39:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:50.502427 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f8132-1f58-40b2-9962-23a57b8f2d68 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:50.650715 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:50.688611 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f8132-1f58-40b2-9962-23a57b8f2d68 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:50.706637 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d195d-de03-4648-a84f-654708db5cab None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:50.758532 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea2dac-c33d-494c-9f00-43b55f4c0cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:50.760618 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea2dac-c33d-494c-9f00-43b55f4c0cf6 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:50.761275 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea2dac-c33d-494c-9f00-43b55f4c0cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:50.761773 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea2dac-c33d-494c-9f00-43b55f4c0cf6 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:50.762711 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea2dac-c33d-494c-9f00-43b55f4c0cf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:50.763262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea2dac-c33d-494c-9f00-43b55f4c0cf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:50.764977 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea2dac-c33d-494c-9f00-43b55f4c0cf6 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:50.765086 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf7527-ec42-4ecf-8d57-686d3e38b5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:50.765798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf7527-ec42-4ecf-8d57-686d3e38b5cb None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:50.766082 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf7527-ec42-4ecf-8d57-686d3e38b5cb None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:50.766361 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf7527-ec42-4ecf-8d57-686d3e38b5cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:50.779228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 279/551] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:50.780271 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf7527-ec42-4ecf-8d57-686d3e38b5cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:50.780806 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e0b8c-08b5-418c-949d-b835f125f6ea None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:50.781065 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e0b8c-08b5-418c-949d-b835f125f6ea None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:50.781346 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e0b8c-08b5-418c-949d-b835f125f6ea None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:50.782969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf7527-ec42-4ecf-8d57-686d3e38b5cb None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:50.783615 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 280/552] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:50.784554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e0b8c-08b5-418c-949d-b835f125f6ea None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:50.813180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-f9bf7527-ec42-4ecf-8d57-686d3e38b5cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:50.813180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:50.813180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:50.813180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:50.813180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:50.813180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:50.813180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:50.813180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:50.813180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:50.813180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:50.813180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:50.813180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:50.813180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:50.813180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:50.813180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:50.814107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:50.814107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:50.814107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:50.814107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:50.814107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:50.814107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:50.814107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:50.814107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:50.814107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:50.814107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:50.814107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:50.814107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:50.814107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:50.814107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:50.814107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:50.814107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:50.814107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:50.814942 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:50.814942 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:50.814942 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:50.814942 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:50.817307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 273/553] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:50.818875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e520a-9277-4315-8c82-d008c171ee43 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:50.819344 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e520a-9277-4315-8c82-d008c171ee43 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:50.819915 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e520a-9277-4315-8c82-d008c171ee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:50.837477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-fb4e520a-9277-4315-8c82-d008c171ee43 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:50.838984 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-fb4e520a-9277-4315-8c82-d008c171ee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:50.856728 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:50.904489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e0b8c-08b5-418c-949d-b835f125f6ea None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:50.920899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 274/554] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:50.921957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e520a-9277-4315-8c82-d008c171ee43 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:50.947797 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ee97f-ea26-4b3d-be50-e182268eedc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:50.948941 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ee97f-ea26-4b3d-be50-e182268eedc8 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:50.950593 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ee97f-ea26-4b3d-be50-e182268eedc8 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:50.951749 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ee97f-ea26-4b3d-be50-e182268eedc8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:50.964160 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ee97f-ea26-4b3d-be50-e182268eedc8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:50.966968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ee97f-ea26-4b3d-be50-e182268eedc8 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:50.986374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-c05ee97f-ea26-4b3d-be50-e182268eedc8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:39:50.986374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:50.986374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:50.986374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:50.986374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:50.986374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:50.986374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:50.986374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:50.986374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:50.986374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:50.986374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:50.986374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:50.986374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:39:50.986374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:39:50.986374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:39:50.986374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:39:50.987338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:50.987338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:50.987338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:39:50.987338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:50.987338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:39:50.987338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:50.987338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:50.987338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:50.987338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:50.987338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:50.987338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:50.987338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:50.987338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:50.987338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:50.987338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:50.987338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:50.987338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:50.987338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:50.988229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:50.988229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:50.988229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:39:50.988229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:39:50.988229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:39:50.988229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:39:50.988229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:39:50.988229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:39:50.988229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:39:50.988229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:50.988229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 281/555] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:39:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:50.989479 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ee97f-ea26-4b3d-be50-e182268eedc8 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:51.003818 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:51.052463 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e520a-9277-4315-8c82-d008c171ee43 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:51.091401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018f8d7-9ab8-4bb7-a044-55c355acdfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:51.092480 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018f8d7-9ab8-4bb7-a044-55c355acdfcb None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:51.093049 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018f8d7-9ab8-4bb7-a044-55c355acdfcb None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:51.093683 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018f8d7-9ab8-4bb7-a044-55c355acdfcb None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:51.094636 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018f8d7-9ab8-4bb7-a044-55c355acdfcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:51.095128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018f8d7-9ab8-4bb7-a044-55c355acdfcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:51.096834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018f8d7-9ab8-4bb7-a044-55c355acdfcb None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:51.109531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ee97f-ea26-4b3d-be50-e182268eedc8 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:51.110760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 275/556] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:51.111950 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018f8d7-9ab8-4bb7-a044-55c355acdfcb None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:51.135014 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:51.150450 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57257473-5d15-41f1-8a0f-83e22482ee89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:51.152933 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57257473-5d15-41f1-8a0f-83e22482ee89 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:51.153648 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57257473-5d15-41f1-8a0f-83e22482ee89 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:51.154831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57257473-5d15-41f1-8a0f-83e22482ee89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:51.172424 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57257473-5d15-41f1-8a0f-83e22482ee89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:51.183596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-57257473-5d15-41f1-8a0f-83e22482ee89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:51.183596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:51.183596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:51.183596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:51.183596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:51.183596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:51.183596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:51.183596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:51.183596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:51.183596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:51.183596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:51.183596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:51.183596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:51.183596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:51.183596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:51.183596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:51.184489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:51.184489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:51.184489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:51.184489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:51.184489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:51.184489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:51.184489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:51.184489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:51.184489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:51.184489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:51.184489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:51.184489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:51.184489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:51.184489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:51.184489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:51.184489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:51.186323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:51.186323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:51.186323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:51.186323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:51.186323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:51.186323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:51.186323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:51.186323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:51.186323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:51.186323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:51.186323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:51.186323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:51.186948 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 282/557] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:39:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:51.187844 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57257473-5d15-41f1-8a0f-83e22482ee89 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:51.231104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018f8d7-9ab8-4bb7-a044-55c355acdfcb None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:51.257328 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:51.269873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86c078-a802-4ae4-a7bd-0ced826ddadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:51.271040 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86c078-a802-4ae4-a7bd-0ced826ddadf None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:51.271040 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86c078-a802-4ae4-a7bd-0ced826ddadf None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:51.271213 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86c078-a802-4ae4-a7bd-0ced826ddadf None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:51.271930 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86c078-a802-4ae4-a7bd-0ced826ddadf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:51.272241 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86c078-a802-4ae4-a7bd-0ced826ddadf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:51.273931 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86c078-a802-4ae4-a7bd-0ced826ddadf None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:51.298907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 276/558] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jun 23 10:39:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:51.298907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86c078-a802-4ae4-a7bd-0ced826ddadf None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:51.330576 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57257473-5d15-41f1-8a0f-83e22482ee89 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:51.369132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401fd12-0d9b-48e8-8005-4dc25e7264a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:51.369917 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401fd12-0d9b-48e8-8005-4dc25e7264a0 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:51.370200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401fd12-0d9b-48e8-8005-4dc25e7264a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:51.370559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401fd12-0d9b-48e8-8005-4dc25e7264a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:51.378150 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401fd12-0d9b-48e8-8005-4dc25e7264a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:51.379948 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401fd12-0d9b-48e8-8005-4dc25e7264a0 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:51.395547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-a401fd12-0d9b-48e8-8005-4dc25e7264a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:39:51.395547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:51.395547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:51.395547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:51.395547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:51.395547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:51.395547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:51.395547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:51.395547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:51.395547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:51.395547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:51.395547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:51.395547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:39:51.395547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:39:51.395547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:39:51.395547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:39:51.396680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:51.396680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:51.396680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:39:51.396680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:51.396680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:39:51.396680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:51.396680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:51.396680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:51.396680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:51.396680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:51.396680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:51.396680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:51.396680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:51.396680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:51.396680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:51.396680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:51.396680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:51.396680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:51.397741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:51.397741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:51.397741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:39:51.397741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:39:51.397741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:39:51.397741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:39:51.397741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:39:51.397741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:39:51.397741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:39:51.397741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:51.397741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 283/559] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jun 23 10:39:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:51.398321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401fd12-0d9b-48e8-8005-4dc25e7264a0 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:51.408842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86c078-a802-4ae4-a7bd-0ced826ddadf None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:51.443219 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7863ac-9759-46a8-b645-d38635c7e363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:51.443894 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7863ac-9759-46a8-b645-d38635c7e363 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:51.444182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7863ac-9759-46a8-b645-d38635c7e363 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:51.444464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7863ac-9759-46a8-b645-d38635c7e363 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:51.445059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:51.445250 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7863ac-9759-46a8-b645-d38635c7e363 None admin] RBAC: Adding query filter params (name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:51.445845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7863ac-9759-46a8-b645-d38635c7e363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:51.446936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7863ac-9759-46a8-b645-d38635c7e363 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:51.455931 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 277/560] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:39:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:51.465024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71283d26-7704-4bbc-b81b-9afae1ac7cdc None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:51.465024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71283d26-7704-4bbc-b81b-9afae1ac7cdc None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:51.465024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71283d26-7704-4bbc-b81b-9afae1ac7cdc None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:51.465024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 278/561] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:51.465024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71283d26-7704-4bbc-b81b-9afae1ac7cdc None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:51.508804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401fd12-0d9b-48e8-8005-4dc25e7264a0 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:51.510081 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:51.544786 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0212d4-dd0b-40c0-8557-832d21a83920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:51.545715 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0212d4-dd0b-40c0-8557-832d21a83920 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:51.546008 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0212d4-dd0b-40c0-8557-832d21a83920 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:51.546291 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0212d4-dd0b-40c0-8557-832d21a83920 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:51.578586 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71283d26-7704-4bbc-b81b-9afae1ac7cdc None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:51.618348 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0212d4-dd0b-40c0-8557-832d21a83920 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:51.620061 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0212d4-dd0b-40c0-8557-832d21a83920 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:51.621515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ed2d4-20f2-4b6d-96dd-f8973ad3cfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:51.622202 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ed2d4-20f2-4b6d-96dd-f8973ad3cfc6 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:51.622488 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ed2d4-20f2-4b6d-96dd-f8973ad3cfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:51.622802 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ed2d4-20f2-4b6d-96dd-f8973ad3cfc6 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:51.624054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ed2d4-20f2-4b6d-96dd-f8973ad3cfc6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:51.624054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ed2d4-20f2-4b6d-96dd-f8973ad3cfc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:51.625446 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ed2d4-20f2-4b6d-96dd-f8973ad3cfc6 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:51.648185 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 279/562] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jun 23 10:39:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:51.649577 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ed2d4-20f2-4b6d-96dd-f8973ad3cfc6 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:51.669818 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:51.745172 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 284/563] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:51.746655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d60d76-7389-493a-9458-39ce8164fc97 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:51.746950 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d60d76-7389-493a-9458-39ce8164fc97 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:51.747232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d60d76-7389-493a-9458-39ce8164fc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:51.760144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:51.763331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ed2d4-20f2-4b6d-96dd-f8973ad3cfc6 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:51.766608 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-06d60d76-7389-493a-9458-39ce8164fc97 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:51.767247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-06d60d76-7389-493a-9458-39ce8164fc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:51.797544 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ab541-ec24-4f22-84d5-4ab3928561eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:51.799540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ab541-ec24-4f22-84d5-4ab3928561eb None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:51.800196 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ab541-ec24-4f22-84d5-4ab3928561eb None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:51.801141 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ab541-ec24-4f22-84d5-4ab3928561eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:51.812454 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ab541-ec24-4f22-84d5-4ab3928561eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:51.813958 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ab541-ec24-4f22-84d5-4ab3928561eb None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:51.832501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-177ab541-ec24-4f22-84d5-4ab3928561eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:51.832501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:51.832501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:51.832501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:51.832501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:51.832501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:51.832501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:51.832501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:51.832501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:51.832501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:51.832501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:51.832501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:51.832501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:51.832501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:51.832501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:51.833468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:51.833468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:51.833468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:51.833468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:51.833468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:51.833468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:51.833468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:51.833468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:51.833468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:51.833468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:51.833468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:51.833468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:51.833468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:51.833468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:51.833468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:51.833468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:51.833468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:51.834334 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:51.834334 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:51.834334 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:51.834334 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:51.834334 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 280/564] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:51.837538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ab541-ec24-4f22-84d5-4ab3928561eb None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:51.847266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 285/565] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:51.848107 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d60d76-7389-493a-9458-39ce8164fc97 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:51.939405 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:51.941680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ab541-ec24-4f22-84d5-4ab3928561eb None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:51.969137 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d60d76-7389-493a-9458-39ce8164fc97 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:51.980708 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cb938-9668-4785-8b07-ecbc08ffcff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:51.981786 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cb938-9668-4785-8b07-ecbc08ffcff1 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:51.982354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cb938-9668-4785-8b07-ecbc08ffcff1 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:51.983002 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cb938-9668-4785-8b07-ecbc08ffcff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:51.993965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cb938-9668-4785-8b07-ecbc08ffcff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:51.995659 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cb938-9668-4785-8b07-ecbc08ffcff1 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:52.004857 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4a00e-24ab-439c-b19b-9c4512ee179c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:52.005662 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4a00e-24ab-439c-b19b-9c4512ee179c None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:52.005999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4a00e-24ab-439c-b19b-9c4512ee179c None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:52.006274 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4a00e-24ab-439c-b19b-9c4512ee179c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:52.016197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-867cb938-9668-4785-8b07-ecbc08ffcff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:52.016197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:52.016197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:52.016197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:52.016197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:52.016197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:52.016197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:52.016197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:52.016197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:52.016197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:52.016197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:52.016197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:52.016197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:52.016197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:52.016197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:52.022845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:52.022845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:52.022845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:52.022845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:52.022845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:52.022845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:52.022845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:52.022845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:52.022845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:52.022845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:52.022845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:52.022845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:52.022845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:52.022845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:52.022845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:52.022845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:52.022845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:52.023726 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:52.023726 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:52.023726 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:52.023726 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:52.023726 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 281/566] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:52.024003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4a00e-24ab-439c-b19b-9c4512ee179c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:52.024073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cb938-9668-4785-8b07-ecbc08ffcff1 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:52.024139 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4a00e-24ab-439c-b19b-9c4512ee179c None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:52.026551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:52.043650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-9ed4a00e-24ab-439c-b19b-9c4512ee179c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:52.043650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:52.043650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:52.043650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:52.043650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:52.043650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:52.043650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:52.043650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:52.043650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:52.043650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:52.043650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:52.043650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:52.043650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:52.043650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:52.043650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:52.045471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:52.045471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:52.045471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:52.045471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:52.045471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:52.045471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:52.045471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:52.045471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:52.045471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:52.045471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:52.045471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:52.045471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:52.045471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:52.045471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:52.045471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:52.045471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:52.045471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:52.046344 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:52.046344 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:52.046344 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:52.046344 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:52.046344 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 286/567] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:52.046865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4a00e-24ab-439c-b19b-9c4512ee179c None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:52.133341 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cb938-9668-4785-8b07-ecbc08ffcff1 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:52.149820 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4a00e-24ab-439c-b19b-9c4512ee179c None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:52.166726 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03374be-4ac9-4bc3-8d23-afb4bd48cf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:52.167388 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03374be-4ac9-4bc3-8d23-afb4bd48cf72 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:52.167671 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03374be-4ac9-4bc3-8d23-afb4bd48cf72 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:52.167949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03374be-4ac9-4bc3-8d23-afb4bd48cf72 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:52.168727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03374be-4ac9-4bc3-8d23-afb4bd48cf72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:52.169037 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03374be-4ac9-4bc3-8d23-afb4bd48cf72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:52.170660 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03374be-4ac9-4bc3-8d23-afb4bd48cf72 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:52.175373 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:52.185530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 282/568] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:52.185530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03374be-4ac9-4bc3-8d23-afb4bd48cf72 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:52.186144 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34322ce6-ef19-4705-a4d6-14cf53713669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:52.186943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34322ce6-ef19-4705-a4d6-14cf53713669 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:52.187228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34322ce6-ef19-4705-a4d6-14cf53713669 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:52.187602 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34322ce6-ef19-4705-a4d6-14cf53713669 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:52.197783 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34322ce6-ef19-4705-a4d6-14cf53713669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:52.206306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-34322ce6-ef19-4705-a4d6-14cf53713669 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:52.206306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:52.206306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:52.206306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:52.206306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:52.206306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:52.206306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:52.206306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:52.206306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:52.206306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:52.206306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:52.206306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:52.206306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:52.206306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:52.206306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:52.206306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:52.207402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:52.207402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:52.207402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:52.207402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:52.207402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:52.207402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:52.207402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:52.207402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:52.207402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:52.207402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:52.207402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:52.207402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:52.207402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:52.207402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:52.207402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:52.207402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:52.208238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:52.208238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:52.208238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:52.208238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:52.208238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:52.208238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:52.208238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:52.208238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:52.208238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:52.208238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:52.208238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:52.208238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:52.208238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 287/569] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:39:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:52.209012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34322ce6-ef19-4705-a4d6-14cf53713669 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:52.250808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:52.288243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03374be-4ac9-4bc3-8d23-afb4bd48cf72 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:52.307643 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34322ce6-ef19-4705-a4d6-14cf53713669 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:52.320382 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5957b-cfcf-40f1-a28f-54f01e6b8e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:52.321077 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5957b-cfcf-40f1-a28f-54f01e6b8e62 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:52.321678 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5957b-cfcf-40f1-a28f-54f01e6b8e62 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:52.321678 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5957b-cfcf-40f1-a28f-54f01e6b8e62 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:52.322350 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5957b-cfcf-40f1-a28f-54f01e6b8e62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:52.322657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5957b-cfcf-40f1-a28f-54f01e6b8e62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:52.324032 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5957b-cfcf-40f1-a28f-54f01e6b8e62 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:52.335460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 283/570] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:52.336687 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db66f4-b5db-4b9f-a730-a05e78b43ba8 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:52.336986 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db66f4-b5db-4b9f-a730-a05e78b43ba8 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:52.337263 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db66f4-b5db-4b9f-a730-a05e78b43ba8 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:52.340131 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 284/571] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:52.340131 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db66f4-b5db-4b9f-a730-a05e78b43ba8 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:52.344502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10ac60-4626-4c37-bbfb-38a09cf112ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:52.345195 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10ac60-4626-4c37-bbfb-38a09cf112ac None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:52.345483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10ac60-4626-4c37-bbfb-38a09cf112ac None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:52.345754 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10ac60-4626-4c37-bbfb-38a09cf112ac None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:52.346476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10ac60-4626-4c37-bbfb-38a09cf112ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:52.346782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10ac60-4626-4c37-bbfb-38a09cf112ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:52.348130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10ac60-4626-4c37-bbfb-38a09cf112ac None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:52.359708 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 288/572] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:52.360489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10ac60-4626-4c37-bbfb-38a09cf112ac None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:52.406445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:52.443374 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db66f4-b5db-4b9f-a730-a05e78b43ba8 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:52.460607 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10ac60-4626-4c37-bbfb-38a09cf112ac None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:52.473826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:52.484116 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecc40a-b71e-425b-8dfd-87c1c76f61d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:52.484949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecc40a-b71e-425b-8dfd-87c1c76f61d6 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:52.485229 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecc40a-b71e-425b-8dfd-87c1c76f61d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:52.485512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecc40a-b71e-425b-8dfd-87c1c76f61d6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:52.493131 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aecc40a-b71e-425b-8dfd-87c1c76f61d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:52.493489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d0b1a-82df-4c81-9a9f-fa7a66c3998b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:52.494203 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d0b1a-82df-4c81-9a9f-fa7a66c3998b None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:52.494488 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d0b1a-82df-4c81-9a9f-fa7a66c3998b None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:52.494579 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aecc40a-b71e-425b-8dfd-87c1c76f61d6 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:52.494768 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d0b1a-82df-4c81-9a9f-fa7a66c3998b None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:52.495523 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d0b1a-82df-4c81-9a9f-fa7a66c3998b None admin] RBAC: Adding query filter params (name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:52.495835 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d0b1a-82df-4c81-9a9f-fa7a66c3998b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:52.497235 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d0b1a-82df-4c81-9a9f-fa7a66c3998b None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:52.506052 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 289/573] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:39:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:52.506846 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d0b1a-82df-4c81-9a9f-fa7a66c3998b None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:52.509470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-3aecc40a-b71e-425b-8dfd-87c1c76f61d6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 10:39:52.509470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:52.509470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:52.509470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:52.509470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:52.509470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:52.509470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:52.509470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:52.509470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:52.509470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:52.509470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:52.509470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:52.509470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:39:52.509470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:39:52.509470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:39:52.509470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:39:52.510349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:52.510349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:52.510349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:39:52.510349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:52.510349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:39:52.510349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:52.510349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:52.510349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:52.510349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:52.510349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:52.510349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:52.510349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:52.510349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:52.510349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:52.510349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:52.510349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:52.510349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:52.510349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:52.511283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:52.511283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:52.511283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:39:52.511283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:39:52.511283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:39:52.511283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:39:52.511283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:39:52.511283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:39:52.511283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 10:39:52.511283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:52.511283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 285/574] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:52.512302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3159f6-1a6a-47bc-b14a-b5a39630254c None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:52.512678 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3159f6-1a6a-47bc-b14a-b5a39630254c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:52.512986 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3159f6-1a6a-47bc-b14a-b5a39630254c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:52.530330 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-db3159f6-1a6a-47bc-b14a-b5a39630254c None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:52.531518 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-db3159f6-1a6a-47bc-b14a-b5a39630254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:52.597341 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 286/575] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:52.598187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3159f6-1a6a-47bc-b14a-b5a39630254c None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:52.608630 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d0b1a-82df-4c81-9a9f-fa7a66c3998b None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:52.620308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:52.645611 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509b7f9-63b2-43e2-a97c-009d9e7a65aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:52.646397 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509b7f9-63b2-43e2-a97c-009d9e7a65aa None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:52.646680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509b7f9-63b2-43e2-a97c-009d9e7a65aa None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:52.646950 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509b7f9-63b2-43e2-a97c-009d9e7a65aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:52.653352 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509b7f9-63b2-43e2-a97c-009d9e7a65aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:52.654848 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509b7f9-63b2-43e2-a97c-009d9e7a65aa None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:52.669487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-3509b7f9-63b2-43e2-a97c-009d9e7a65aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:52.669487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:52.669487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:52.669487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:52.669487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:52.669487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:52.669487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:52.669487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:52.669487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:52.669487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:52.669487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:52.669487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:52.669487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:39:52.669487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:39:52.669487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:39:52.670562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:39:52.670562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:52.670562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:52.670562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:52.670562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:52.670562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:52.670562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:52.670562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:52.670562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:52.670562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:52.670562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:52.670562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:52.670562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:52.670562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:52.670562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:52.670562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:52.670562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:52.671878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:39:52.671878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:39:52.671878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:39:52.671878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:39:52.671878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:39:52.671878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:39:52.671878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:52.671878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:52.671878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 290/576] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:52.671878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509b7f9-63b2-43e2-a97c-009d9e7a65aa None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:52.705803 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3159f6-1a6a-47bc-b14a-b5a39630254c None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:52.721633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:52.740872 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0d8bc-0d88-4fe1-8327-dd55a410f43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:52.741664 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0d8bc-0d88-4fe1-8327-dd55a410f43b None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:52.741951 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0d8bc-0d88-4fe1-8327-dd55a410f43b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:52.742231 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0d8bc-0d88-4fe1-8327-dd55a410f43b None admin] PATH_INFO: `/v3/projects/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:52.749372 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0d8bc-0d88-4fe1-8327-dd55a410f43b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:52.750832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0d8bc-0d88-4fe1-8327-dd55a410f43b None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:52.765737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-19b0d8bc-0d88-4fe1-8327-dd55a410f43b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:52.765737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:52.765737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:52.765737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:52.765737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:52.765737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:52.765737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:52.765737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:52.765737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:52.765737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:52.765737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:52.765737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:52.765737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:39:52.765737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:39:52.765737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:39:52.766777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:39:52.766777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:52.766777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:52.766777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:52.766777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:52.766777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:52.766777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:52.766777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:52.766777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:52.766777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:52.766777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:52.766777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:52.766777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:52.766777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:52.766777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:52.766777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:52.766777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:52.767752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:39:52.767752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:39:52.767752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:39:52.767752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:39:52.767752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:39:52.767752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:39:52.767752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:52.767752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:52.767752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 287/577] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:52.768226 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0d8bc-0d88-4fe1-8327-dd55a410f43b None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:52.771252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509b7f9-63b2-43e2-a97c-009d9e7a65aa None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:52.804764 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192942f2-8d60-4dcc-8338-f0a51e606bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:52.805556 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192942f2-8d60-4dcc-8338-f0a51e606bc2 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:52.805838 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192942f2-8d60-4dcc-8338-f0a51e606bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:52.806114 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192942f2-8d60-4dcc-8338-f0a51e606bc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:52.816408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192942f2-8d60-4dcc-8338-f0a51e606bc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:52.817979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192942f2-8d60-4dcc-8338-f0a51e606bc2 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:52.835633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-192942f2-8d60-4dcc-8338-f0a51e606bc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:52.835633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:52.835633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:52.835633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:52.835633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:52.835633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:52.835633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:52.835633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:52.835633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:52.835633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:52.835633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:52.835633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:52.835633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:52.835633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:52.835633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:52.836723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:52.836723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:52.836723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:52.836723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:52.836723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:52.836723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:52.836723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:52.836723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:52.836723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:52.836723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:52.836723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:52.836723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:52.836723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:52.836723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:52.836723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:52.836723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:52.836723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:52.837652 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:52.837652 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:52.837652 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:52.837652 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:52.837652 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 291/578] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:52.837652 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192942f2-8d60-4dcc-8338-f0a51e606bc2 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:52.860044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:52.871837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0d8bc-0d88-4fe1-8327-dd55a410f43b None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:52.905480 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbe359-50af-4aee-a815-7fa9c61b6c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:52.906153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbe359-50af-4aee-a815-7fa9c61b6c92 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:52.906440 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbe359-50af-4aee-a815-7fa9c61b6c92 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:52.906717 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbe359-50af-4aee-a815-7fa9c61b6c92 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:52.907548 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbe359-50af-4aee-a815-7fa9c61b6c92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:52.907861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbe359-50af-4aee-a815-7fa9c61b6c92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:52.909327 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbe359-50af-4aee-a815-7fa9c61b6c92 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:52.926894 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 288/579] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jun 23 10:39:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:52.927681 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbe359-50af-4aee-a815-7fa9c61b6c92 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:52.941143 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192942f2-8d60-4dcc-8338-f0a51e606bc2 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:52.958202 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:52.975007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5686a-16ee-44ac-9263-6de987a574b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:52.975736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5686a-16ee-44ac-9263-6de987a574b6 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:52.976015 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5686a-16ee-44ac-9263-6de987a574b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:52.976285 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5686a-16ee-44ac-9263-6de987a574b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:52.986723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5686a-16ee-44ac-9263-6de987a574b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:52.994367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-6cb5686a-16ee-44ac-9263-6de987a574b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:52.994367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:52.994367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:52.994367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:52.994367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:52.994367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:52.994367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:52.994367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:52.994367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:52.994367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:52.994367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:52.994367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:52.994367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:52.994367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:52.994367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:52.994367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:52.995548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:52.995548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:52.995548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:52.995548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:52.995548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:52.995548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:52.995548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:52.995548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:52.995548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:52.995548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:52.995548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:52.995548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:52.995548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:52.995548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:52.995548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:52.995548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:52.996558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:52.996558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:52.996558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:52.996558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:52.996558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:52.996558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:52.996558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:52.996558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:52.996558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:52.996558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:52.996558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:52.996558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:52.996558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 292/580] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:39:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:52.996558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5686a-16ee-44ac-9263-6de987a574b6 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:53.031304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbe359-50af-4aee-a815-7fa9c61b6c92 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:53.065054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32ee23-5dc1-4541-b3a3-283b90e61480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:53.065710 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32ee23-5dc1-4541-b3a3-283b90e61480 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:53.065989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32ee23-5dc1-4541-b3a3-283b90e61480 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:53.066261 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32ee23-5dc1-4541-b3a3-283b90e61480 None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:53.067036 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32ee23-5dc1-4541-b3a3-283b90e61480 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:53.067346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32ee23-5dc1-4541-b3a3-283b90e61480 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:53.068785 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32ee23-5dc1-4541-b3a3-283b90e61480 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:53.078851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:53.080010 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 289/581] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:39:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:53.080912 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32ee23-5dc1-4541-b3a3-283b90e61480 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:53.102332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5686a-16ee-44ac-9263-6de987a574b6 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:53.137416 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb1807-eb30-4530-b0c1-a0c65e8b5883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:53.138086 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb1807-eb30-4530-b0c1-a0c65e8b5883 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:53.138604 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb1807-eb30-4530-b0c1-a0c65e8b5883 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:53.139064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb1807-eb30-4530-b0c1-a0c65e8b5883 None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:53.139918 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb1807-eb30-4530-b0c1-a0c65e8b5883 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:53.140239 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb1807-eb30-4530-b0c1-a0c65e8b5883 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:53.141714 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb1807-eb30-4530-b0c1-a0c65e8b5883 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:53.154393 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 293/582] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:39:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:53.155587 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb1807-eb30-4530-b0c1-a0c65e8b5883 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:53.169385 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:53.178257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32ee23-5dc1-4541-b3a3-283b90e61480 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:53.210513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0fd22-c9f4-4387-82fb-fd91d5b4d1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:53.211173 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0fd22-c9f4-4387-82fb-fd91d5b4d1f9 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:53.211460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0fd22-c9f4-4387-82fb-fd91d5b4d1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:53.211738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0fd22-c9f4-4387-82fb-fd91d5b4d1f9 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:53.212451 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0fd22-c9f4-4387-82fb-fd91d5b4d1f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:53.212786 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0fd22-c9f4-4387-82fb-fd91d5b4d1f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:53.214157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0fd22-c9f4-4387-82fb-fd91d5b4d1f9 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:53.226334 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 290/583] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:53.227057 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0fd22-c9f4-4387-82fb-fd91d5b4d1f9 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:53.255480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb1807-eb30-4530-b0c1-a0c65e8b5883 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:53.288386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b0a97-4ec8-4ee3-84be-007cba78ee94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:53.289221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b0a97-4ec8-4ee3-84be-007cba78ee94 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:53.289505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b0a97-4ec8-4ee3-84be-007cba78ee94 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:53.289788 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b0a97-4ec8-4ee3-84be-007cba78ee94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:53.299167 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:53.301245 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b0a97-4ec8-4ee3-84be-007cba78ee94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:53.302702 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b0a97-4ec8-4ee3-84be-007cba78ee94 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:53.320404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-f32b0a97-4ec8-4ee3-84be-007cba78ee94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:53.320404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:53.320404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:53.320404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:53.320404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:53.320404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:53.320404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:53.320404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:53.320404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:53.320404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:53.320404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:53.320404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:53.320404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:53.320404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:53.320404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:53.321499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:53.321499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:53.321499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:53.321499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:53.321499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:53.321499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:53.321499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:53.321499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:53.321499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:53.321499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:53.321499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:53.321499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:53.321499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:53.321499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:53.321499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:53.321499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:53.321499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:53.322567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:53.322567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:53.322567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:53.322567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:53.322567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 294/584] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:53.322998 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b0a97-4ec8-4ee3-84be-007cba78ee94 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:53.330693 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0fd22-c9f4-4387-82fb-fd91d5b4d1f9 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:53.364312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bd1d9-a953-4d99-aaf0-290baa94f3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:53.365008 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bd1d9-a953-4d99-aaf0-290baa94f3c9 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:53.365292 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bd1d9-a953-4d99-aaf0-290baa94f3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:53.365570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bd1d9-a953-4d99-aaf0-290baa94f3c9 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:53.366312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253bd1d9-a953-4d99-aaf0-290baa94f3c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:53.366643 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253bd1d9-a953-4d99-aaf0-290baa94f3c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:53.368026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253bd1d9-a953-4d99-aaf0-290baa94f3c9 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:53.378184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 291/585] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:39:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:53.379390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bd1d9-a953-4d99-aaf0-290baa94f3c9 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:53.394858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:53.422589 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b0a97-4ec8-4ee3-84be-007cba78ee94 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:53.455788 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885302c8-3a87-4d67-bf86-7973a5f2e8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:53.456694 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885302c8-3a87-4d67-bf86-7973a5f2e8bd None admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:53.456979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885302c8-3a87-4d67-bf86-7973a5f2e8bd None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:53.457254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885302c8-3a87-4d67-bf86-7973a5f2e8bd None admin] PATH_INFO: `/v3/projects/d7a9c82a62044db884e547da9a523927/users/39840f048d254831bdb963b38520f706/roles/3522dd96085d47688d7a42ed133484a9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:53.472483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885302c8-3a87-4d67-bf86-7973a5f2e8bd None admin] RBAC: Authorizing `identity:create_grant(project_id=d7a9c82a62044db884e547da9a523927, user_id=39840f048d254831bdb963b38520f706, role_id=3522dd96085d47688d7a42ed133484a9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:53.473968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885302c8-3a87-4d67-bf86-7973a5f2e8bd None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:53.477021 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bd1d9-a953-4d99-aaf0-290baa94f3c9 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:53.510516 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96e5f5-aecd-4e07-ae9f-330f1f2cb0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:53.511181 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96e5f5-aecd-4e07-ae9f-330f1f2cb0db None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:53.511463 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96e5f5-aecd-4e07-ae9f-330f1f2cb0db None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:53.511739 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96e5f5-aecd-4e07-ae9f-330f1f2cb0db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:53.512556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96e5f5-aecd-4e07-ae9f-330f1f2cb0db None admin] RBAC: Adding query filter params (role.id=3522dd96085d47688d7a42ed133484a9, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=4a54fa1c326f41e88688404a56b75c30) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:53.512894 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96e5f5-aecd-4e07-ae9f-330f1f2cb0db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:53.515011 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96e5f5-aecd-4e07-ae9f-330f1f2cb0db None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:53.520243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 292/586] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:53 2022] GET /identity/v3/role_assignments?user.id=4a54fa1c326f41e88688404a56b75c30&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=3522dd96085d47688d7a42ed133484a9 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:53.521035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96e5f5-aecd-4e07-ae9f-330f1f2cb0db None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:53.552829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 295/587] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:39:53 2022] PUT /identity/v3/projects/d7a9c82a62044db884e547da9a523927/users/39840f048d254831bdb963b38520f706/roles/3522dd96085d47688d7a42ed133484a9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:39:53.565764 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885302c8-3a87-4d67-bf86-7973a5f2e8bd None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:53.628660 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:53.642226 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:53.655515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96e5f5-aecd-4e07-ae9f-330f1f2cb0db None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:53.744996 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885302c8-3a87-4d67-bf86-7973a5f2e8bd None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:53.748775 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81646e5e-bca5-4a7b-8154-1688e9f75db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:53.750218 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81646e5e-bca5-4a7b-8154-1688e9f75db2 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:53.750616 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81646e5e-bca5-4a7b-8154-1688e9f75db2 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:53.750994 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81646e5e-bca5-4a7b-8154-1688e9f75db2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:53.760957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81646e5e-bca5-4a7b-8154-1688e9f75db2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:53.762416 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81646e5e-bca5-4a7b-8154-1688e9f75db2 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:53.778939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-81646e5e-bca5-4a7b-8154-1688e9f75db2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 10:39:53.778939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:53.778939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:53.778939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:53.778939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:53.778939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:53.778939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:53.778939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:53.778939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:53.778939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:53.778939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:53.778939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:53.778939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:39:53.778939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:39:53.778939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:39:53.778939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:39:53.780299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:53.780299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:53.780299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:39:53.780299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:53.780299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:39:53.780299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:53.780299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:53.780299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:53.780299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:53.780299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:53.780299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:53.780299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:53.780299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:53.780299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:53.780299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:53.780299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:53.780299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:53.780299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:53.781324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:53.781324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:53.781324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:39:53.781324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:39:53.781324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:39:53.781324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:39:53.781324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:39:53.781324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:39:53.781324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 10:39:53.781324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:53.781324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 293/588] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:39:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:53.781324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81646e5e-bca5-4a7b-8154-1688e9f75db2 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:53.790837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37c4ac-fbad-4c56-a8b7-3fb4c2673530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:53.791613 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37c4ac-fbad-4c56-a8b7-3fb4c2673530 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:53.791973 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37c4ac-fbad-4c56-a8b7-3fb4c2673530 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:53.792322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37c4ac-fbad-4c56-a8b7-3fb4c2673530 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:53.793238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37c4ac-fbad-4c56-a8b7-3fb4c2673530 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:53.793621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37c4ac-fbad-4c56-a8b7-3fb4c2673530 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:53.795871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37c4ac-fbad-4c56-a8b7-3fb4c2673530 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:53.807868 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 296/589] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:53.808830 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37c4ac-fbad-4c56-a8b7-3fb4c2673530 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:53.918777 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37c4ac-fbad-4c56-a8b7-3fb4c2673530 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:53.920943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:53.923485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81646e5e-bca5-4a7b-8154-1688e9f75db2 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:53.957537 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0a7fc-57b3-42eb-8f76-ee0f575b3a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:53.958101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0a7fc-57b3-42eb-8f76-ee0f575b3a90 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:53.958460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0a7fc-57b3-42eb-8f76-ee0f575b3a90 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:53.958789 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0a7fc-57b3-42eb-8f76-ee0f575b3a90 None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:53.959754 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0a7fc-57b3-42eb-8f76-ee0f575b3a90 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:53.960105 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0a7fc-57b3-42eb-8f76-ee0f575b3a90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:53.961645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0a7fc-57b3-42eb-8f76-ee0f575b3a90 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:53.963774 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ff83d-c17f-4d01-81cd-fbbb62b65240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:53.964961 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ff83d-c17f-4d01-81cd-fbbb62b65240 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:53.965452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ff83d-c17f-4d01-81cd-fbbb62b65240 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:53.965923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ff83d-c17f-4d01-81cd-fbbb62b65240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:53.973441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:53.978586 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ff83d-c17f-4d01-81cd-fbbb62b65240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:53.980296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ff83d-c17f-4d01-81cd-fbbb62b65240 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:53.981074 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 297/590] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Jun 23 10:39:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:53.981722 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0a7fc-57b3-42eb-8f76-ee0f575b3a90 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:54.000504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-060ff83d-c17f-4d01-81cd-fbbb62b65240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:54.000504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:54.000504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:54.000504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:54.000504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:54.000504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:54.000504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:54.000504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:54.000504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:54.000504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:54.000504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:54.000504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:54.000504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:54.000504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:54.000504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:54.001491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:54.001491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:54.001491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:54.001491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:54.001491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:54.001491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:54.001491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:54.001491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:54.001491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:54.001491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:54.001491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:54.001491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:54.001491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:54.001491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:54.001491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:54.001491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:54.001491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:54.002361 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:54.002361 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:54.002361 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:54.002361 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:54.009261 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 294/591] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:54.010479 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ff83d-c17f-4d01-81cd-fbbb62b65240 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:54.091571 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0a7fc-57b3-42eb-8f76-ee0f575b3a90 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:54.119542 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ff83d-c17f-4d01-81cd-fbbb62b65240 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:54.127410 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73374a6-4572-4c38-b18e-5f1f7b5f66cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:54.128210 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73374a6-4572-4c38-b18e-5f1f7b5f66cd None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:54.128922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73374a6-4572-4c38-b18e-5f1f7b5f66cd None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:54.128922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73374a6-4572-4c38-b18e-5f1f7b5f66cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:54.136628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73374a6-4572-4c38-b18e-5f1f7b5f66cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:54.137975 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73374a6-4572-4c38-b18e-5f1f7b5f66cd None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:54.153370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-d73374a6-4572-4c38-b18e-5f1f7b5f66cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:54.153370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:54.153370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:54.153370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:54.153370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:54.153370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:54.153370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:54.153370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:54.153370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:54.153370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:54.153370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:54.153370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:54.153370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:39:54.153370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:39:54.153370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:39:54.154328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:39:54.154328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:54.154328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:54.154328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:54.154328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:54.154328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:54.154328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:54.154328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:54.154328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:54.154328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:54.154328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:54.154328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:54.154328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:54.154328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:54.154328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:54.154328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:54.154328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:54.155985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:39:54.155985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:39:54.155985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:39:54.155985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:39:54.155985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:39:54.155985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:39:54.155985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:54.155985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:54.155985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 298/592] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:54.155985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73374a6-4572-4c38-b18e-5f1f7b5f66cd None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:54.162004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c93084-409e-4e28-8539-4580c23f265c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:54.163078 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c93084-409e-4e28-8539-4580c23f265c None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:54.163580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c93084-409e-4e28-8539-4580c23f265c None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:54.164052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c93084-409e-4e28-8539-4580c23f265c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:54.177489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c93084-409e-4e28-8539-4580c23f265c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:54.178849 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:54.180189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c93084-409e-4e28-8539-4580c23f265c None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:54.198832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-c3c93084-409e-4e28-8539-4580c23f265c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:54.198832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:54.198832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:54.198832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:54.198832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:54.198832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:54.198832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:54.198832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:54.198832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:54.198832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:54.198832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:54.198832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:54.198832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:54.198832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:54.198832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:54.199751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:54.199751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:54.199751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:54.199751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:54.199751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:54.199751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:54.199751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:54.199751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:54.199751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:54.199751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:54.199751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:54.199751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:54.199751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:54.199751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:54.199751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:54.199751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:54.199751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:54.200627 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:54.200627 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:54.200627 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:54.200627 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:54.203858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 295/593] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:54.205172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c93084-409e-4e28-8539-4580c23f265c None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:54.252871 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:54.266543 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73374a6-4572-4c38-b18e-5f1f7b5f66cd None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:54.306027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a61ef-d58d-4195-873c-683e18833a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:54.306938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a61ef-d58d-4195-873c-683e18833a34 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:54.307398 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a61ef-d58d-4195-873c-683e18833a34 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:54.307827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a61ef-d58d-4195-873c-683e18833a34 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:54.308845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a61ef-d58d-4195-873c-683e18833a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:54.309302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a61ef-d58d-4195-873c-683e18833a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:54.311139 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a61ef-d58d-4195-873c-683e18833a34 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:54.315542 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c93084-409e-4e28-8539-4580c23f265c None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:54.323954 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 299/594] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:54.324983 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a61ef-d58d-4195-873c-683e18833a34 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:54.357819 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af52c16-b7cf-4c73-8b09-8713e38eed5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:54.358635 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af52c16-b7cf-4c73-8b09-8713e38eed5e None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:54.359019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af52c16-b7cf-4c73-8b09-8713e38eed5e None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:54.359531 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af52c16-b7cf-4c73-8b09-8713e38eed5e None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:54.360603 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af52c16-b7cf-4c73-8b09-8713e38eed5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:54.360889 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af52c16-b7cf-4c73-8b09-8713e38eed5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:54.362460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af52c16-b7cf-4c73-8b09-8713e38eed5e None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:54.380938 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 296/595] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:54.380938 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af52c16-b7cf-4c73-8b09-8713e38eed5e None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:54.419916 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:54.440916 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a61ef-d58d-4195-873c-683e18833a34 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:54.478234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff345f1-5fb8-4610-b52d-960b91def955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:54.479122 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff345f1-5fb8-4610-b52d-960b91def955 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:54.479558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff345f1-5fb8-4610-b52d-960b91def955 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:54.479979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff345f1-5fb8-4610-b52d-960b91def955 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:54.481114 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff345f1-5fb8-4610-b52d-960b91def955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:54.481662 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff345f1-5fb8-4610-b52d-960b91def955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:54.483283 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff345f1-5fb8-4610-b52d-960b91def955 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:54.484309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af52c16-b7cf-4c73-8b09-8713e38eed5e None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:54.485955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:54.497355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 300/596] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:54.498533 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff345f1-5fb8-4610-b52d-960b91def955 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:54.522053 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe26197-7497-481e-a44a-60a2dac952c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:54.522798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe26197-7497-481e-a44a-60a2dac952c0 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:54.523115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe26197-7497-481e-a44a-60a2dac952c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:54.523390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe26197-7497-481e-a44a-60a2dac952c0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:54.532211 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe26197-7497-481e-a44a-60a2dac952c0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:54.533796 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe26197-7497-481e-a44a-60a2dac952c0 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:54.549861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-abe26197-7497-481e-a44a-60a2dac952c0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:39:54.549861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:54.549861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:54.549861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:54.549861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:54.549861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:54.549861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:54.549861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:54.549861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:54.549861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:54.549861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:54.549861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:54.549861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:39:54.549861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:39:54.549861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:39:54.549861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:39:54.550834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:54.550834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:54.550834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:39:54.550834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:54.550834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:39:54.550834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:54.550834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:54.550834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:54.550834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:54.550834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:54.550834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:54.550834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:54.550834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:54.550834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:54.550834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:54.550834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:54.550834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:54.550834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:54.551769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:54.551769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:54.551769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:39:54.551769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:39:54.551769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:39:54.551769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:39:54.551769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:39:54.551769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:39:54.551769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:39:54.551769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:54.555404 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 297/597] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:54.556373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe26197-7497-481e-a44a-60a2dac952c0 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:54.611503 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff345f1-5fb8-4610-b52d-960b91def955 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:54.652062 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17307a34-56b8-41bc-ae7f-87d7ea1a03f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:54.653369 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17307a34-56b8-41bc-ae7f-87d7ea1a03f0 None admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:54.654960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17307a34-56b8-41bc-ae7f-87d7ea1a03f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:54.655472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17307a34-56b8-41bc-ae7f-87d7ea1a03f0 None admin] PATH_INFO: `/v3/projects/d7a9c82a62044db884e547da9a523927/users/06498e12426947908d5217e2c948519d/roles/3522dd96085d47688d7a42ed133484a9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:54.664374 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe26197-7497-481e-a44a-60a2dac952c0 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:54.669794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:54.675635 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17307a34-56b8-41bc-ae7f-87d7ea1a03f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7a9c82a62044db884e547da9a523927, user_id=06498e12426947908d5217e2c948519d, role_id=3522dd96085d47688d7a42ed133484a9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:54.681371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17307a34-56b8-41bc-ae7f-87d7ea1a03f0 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:54.703912 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32546826-4ac7-41e9-bbc1-269b2ebb4f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:54.704740 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32546826-4ac7-41e9-bbc1-269b2ebb4f66 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:54.705026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32546826-4ac7-41e9-bbc1-269b2ebb4f66 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:54.705300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32546826-4ac7-41e9-bbc1-269b2ebb4f66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:54.712511 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32546826-4ac7-41e9-bbc1-269b2ebb4f66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:54.713979 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32546826-4ac7-41e9-bbc1-269b2ebb4f66 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:54.727907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-32546826-4ac7-41e9-bbc1-269b2ebb4f66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:54.727907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:54.727907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:54.727907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:54.727907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:54.727907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:54.727907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:54.727907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:54.727907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:54.727907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:54.727907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:54.727907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:54.727907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:39:54.727907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:39:54.727907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:39:54.734937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:39:54.734937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:54.734937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:54.734937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:54.734937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:54.734937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:54.734937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:54.734937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:54.734937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:54.734937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:54.734937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:54.734937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:54.734937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:54.734937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:54.734937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:54.734937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:54.734937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:54.735790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:39:54.735790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:39:54.735790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:39:54.735790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:39:54.735790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:39:54.735790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:39:54.735790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:54.735790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:54.735790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 298/598] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:54.735790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32546826-4ac7-41e9-bbc1-269b2ebb4f66 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:54.757996 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:54.761709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 301/599] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:39:54 2022] PUT /identity/v3/projects/d7a9c82a62044db884e547da9a523927/users/06498e12426947908d5217e2c948519d/roles/3522dd96085d47688d7a42ed133484a9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:39:54.764119 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17307a34-56b8-41bc-ae7f-87d7ea1a03f0 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:54.860721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32546826-4ac7-41e9-bbc1-269b2ebb4f66 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:54.916256 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17307a34-56b8-41bc-ae7f-87d7ea1a03f0 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:54.926387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad18c99-1647-4feb-b09b-a9f525384815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:54.927076 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad18c99-1647-4feb-b09b-a9f525384815 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:54.927365 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad18c99-1647-4feb-b09b-a9f525384815 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:54.927643 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad18c99-1647-4feb-b09b-a9f525384815 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:54.928500 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad18c99-1647-4feb-b09b-a9f525384815 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:54.928840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad18c99-1647-4feb-b09b-a9f525384815 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:54.930285 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad18c99-1647-4feb-b09b-a9f525384815 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:54.964103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 299/600] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jun 23 10:39:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:54.969999 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad18c99-1647-4feb-b09b-a9f525384815 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:54.998583 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8e203-3343-4263-ae22-72e5856edb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:54.999360 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8e203-3343-4263-ae22-72e5856edb88 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:54.999873 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8e203-3343-4263-ae22-72e5856edb88 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:55.001465 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8e203-3343-4263-ae22-72e5856edb88 None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:55.002350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8e203-3343-4263-ae22-72e5856edb88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:55.003486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8e203-3343-4263-ae22-72e5856edb88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:55.005301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8e203-3343-4263-ae22-72e5856edb88 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:55.024089 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 302/601] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:55.030315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8e203-3343-4263-ae22-72e5856edb88 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:55.084526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:55.091273 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:55.116399 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad18c99-1647-4feb-b09b-a9f525384815 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:55.138009 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8e203-3343-4263-ae22-72e5856edb88 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:55.163089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de8da0-392f-4660-8923-11437fd41d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:55.164713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de8da0-392f-4660-8923-11437fd41d1b None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:55.165146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de8da0-392f-4660-8923-11437fd41d1b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:55.165570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de8da0-392f-4660-8923-11437fd41d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:55.175566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963a597-a953-484b-9955-0a4160025f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:55.176596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963a597-a953-484b-9955-0a4160025f7c None admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:55.176976 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963a597-a953-484b-9955-0a4160025f7c None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:55.177329 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963a597-a953-484b-9955-0a4160025f7c None admin] PATH_INFO: `/v3/projects/d7a9c82a62044db884e547da9a523927/users/0348261a78984c62aced60af2768688e/roles/3522dd96085d47688d7a42ed133484a9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:55.179978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de8da0-392f-4660-8923-11437fd41d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:55.182511 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de8da0-392f-4660-8923-11437fd41d1b None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:55.197222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963a597-a953-484b-9955-0a4160025f7c None admin] RBAC: Authorizing `identity:create_grant(project_id=d7a9c82a62044db884e547da9a523927, user_id=0348261a78984c62aced60af2768688e, role_id=3522dd96085d47688d7a42ed133484a9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:55.198769 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963a597-a953-484b-9955-0a4160025f7c None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:55.203604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-39de8da0-392f-4660-8923-11437fd41d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:55.203604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:55.203604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:55.203604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:55.203604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:55.203604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:55.203604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:55.203604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:55.203604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:55.203604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:55.203604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:55.203604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:55.203604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:55.203604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:55.203604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:55.204462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:55.204462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:55.204462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:55.204462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:55.204462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:55.204462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:55.204462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:55.204462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:55.204462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:55.204462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:55.204462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:55.204462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:55.204462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:55.204462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:55.204462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:55.204462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:55.204462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:55.205357 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:55.205357 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:55.205357 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:55.205357 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:55.207204 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 300/602] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:55.212465 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de8da0-392f-4660-8923-11437fd41d1b None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:55.277996 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 303/603] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:39:55 2022] PUT /identity/v3/projects/d7a9c82a62044db884e547da9a523927/users/0348261a78984c62aced60af2768688e/roles/3522dd96085d47688d7a42ed133484a9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:39:55.330255 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de8da0-392f-4660-8923-11437fd41d1b None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:55.363202 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:55.369732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14c055-5808-4c31-994d-2fd013050c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:55.370667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14c055-5808-4c31-994d-2fd013050c5b None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:55.371095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14c055-5808-4c31-994d-2fd013050c5b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:55.371594 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14c055-5808-4c31-994d-2fd013050c5b None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:55.372481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14c055-5808-4c31-994d-2fd013050c5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:55.373742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14c055-5808-4c31-994d-2fd013050c5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:55.375474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14c055-5808-4c31-994d-2fd013050c5b None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:55.389748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 301/604] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:55.396087 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963a597-a953-484b-9955-0a4160025f7c None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:55.542012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:55.546511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963a597-a953-484b-9955-0a4160025f7c None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:55.594813 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75dfcad-7cc5-4c89-9664-7e1d5b91e8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:55.595620 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dfcad-7cc5-4c89-9664-7e1d5b91e8f1 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:55.595909 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dfcad-7cc5-4c89-9664-7e1d5b91e8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:55.596188 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dfcad-7cc5-4c89-9664-7e1d5b91e8f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:55.616186 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75dfcad-7cc5-4c89-9664-7e1d5b91e8f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:55.618117 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75dfcad-7cc5-4c89-9664-7e1d5b91e8f1 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:55.635046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-a75dfcad-7cc5-4c89-9664-7e1d5b91e8f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:55.635046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:55.635046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:55.635046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:55.635046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:55.635046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:55.635046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:55.635046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:55.635046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:55.635046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:55.635046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:55.635046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:55.635046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:39:55.635046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:39:55.635046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:39:55.635938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:39:55.635938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:55.635938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:55.635938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:55.635938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:55.635938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:55.635938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:55.635938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:55.635938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:55.635938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:55.635938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:55.635938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:55.635938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:55.635938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:55.635938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:55.635938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:55.635938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:55.636845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:39:55.636845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:39:55.636845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:39:55.636845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:39:55.636845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:39:55.636845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:39:55.636845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:55.636845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:55.639443 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 304/605] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:55.646735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14c055-5808-4c31-994d-2fd013050c5b None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:55.745139 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3aad2-6491-49fd-99e4-96043f3b688a None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:55.745940 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3aad2-6491-49fd-99e4-96043f3b688a None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:55.746437 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3aad2-6491-49fd-99e4-96043f3b688a None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:55.748040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 305/606] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:55.753636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e0e5d-4ad1-48af-874c-e1fae389cdcc None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:55.754415 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e0e5d-4ad1-48af-874c-e1fae389cdcc None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:55.754704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e0e5d-4ad1-48af-874c-e1fae389cdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:55.766127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14c055-5808-4c31-994d-2fd013050c5b None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:55.800577 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-db6e0e5d-4ad1-48af-874c-e1fae389cdcc None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:55.801814 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-db6e0e5d-4ad1-48af-874c-e1fae389cdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:55.806051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d37636-9e0a-4bc6-a60b-d66750e7812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:55.806990 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d37636-9e0a-4bc6-a60b-d66750e7812c None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:55.807484 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d37636-9e0a-4bc6-a60b-d66750e7812c None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:55.807964 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d37636-9e0a-4bc6-a60b-d66750e7812c None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:55.808997 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d37636-9e0a-4bc6-a60b-d66750e7812c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:55.810477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d37636-9e0a-4bc6-a60b-d66750e7812c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:55.812154 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d37636-9e0a-4bc6-a60b-d66750e7812c None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:55.827695 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 302/607] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:39:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:55.833800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d37636-9e0a-4bc6-a60b-d66750e7812c None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:55.947930 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 306/608] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:39:55.953034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:55.967243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed4c61-a518-4a7b-b318-c834dbaccef4 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:55.967935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed4c61-a518-4a7b-b318-c834dbaccef4 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:55.968425 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed4c61-a518-4a7b-b318-c834dbaccef4 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:55.970589 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 307/609] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:55.978195 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8159e1-2d57-4041-b113-5888d67e7841 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:55.978490 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8159e1-2d57-4041-b113-5888d67e7841 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:55.978775 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8159e1-2d57-4041-b113-5888d67e7841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:56.001147 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-3c8159e1-2d57-4041-b113-5888d67e7841 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:56.002893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-3c8159e1-2d57-4041-b113-5888d67e7841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:56.019581 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d37636-9e0a-4bc6-a60b-d66750e7812c None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:56.055338 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477ba87-8449-4006-9da7-df118ae63ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:56.056238 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477ba87-8449-4006-9da7-df118ae63ab0 None admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:56.056522 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477ba87-8449-4006-9da7-df118ae63ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:56.056844 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477ba87-8449-4006-9da7-df118ae63ab0 None admin] PATH_INFO: `/v3/projects/d7a9c82a62044db884e547da9a523927/users/d804e11eb85e4050adaecfbaaa6e5a12/roles/3522dd96085d47688d7a42ed133484a9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:56.071653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477ba87-8449-4006-9da7-df118ae63ab0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7a9c82a62044db884e547da9a523927, user_id=d804e11eb85e4050adaecfbaaa6e5a12, role_id=3522dd96085d47688d7a42ed133484a9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:56.073341 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477ba87-8449-4006-9da7-df118ae63ab0 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:56.081642 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 308/610] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:56.082561 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8159e1-2d57-4041-b113-5888d67e7841 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:56.109902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:56.172458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 303/611] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:39:55 2022] PUT /identity/v3/projects/d7a9c82a62044db884e547da9a523927/users/d804e11eb85e4050adaecfbaaa6e5a12/roles/3522dd96085d47688d7a42ed133484a9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:39:56.173797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477ba87-8449-4006-9da7-df118ae63ab0 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:56.221792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8159e1-2d57-4041-b113-5888d67e7841 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:56.300438 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bac5d9-9dd3-40cf-a88b-653990268b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:56.301280 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bac5d9-9dd3-40cf-a88b-653990268b87 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:56.301568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bac5d9-9dd3-40cf-a88b-653990268b87 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:56.301845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bac5d9-9dd3-40cf-a88b-653990268b87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:56.327961 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bac5d9-9dd3-40cf-a88b-653990268b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:56.336232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-07bac5d9-9dd3-40cf-a88b-653990268b87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:56.336232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:56.336232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:56.336232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:56.336232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:56.336232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:56.336232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:56.336232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:56.336232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:56.336232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:56.336232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:56.336232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:56.336232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:56.336232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:56.336232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:56.336232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:56.337200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:56.337200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:56.337200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:56.337200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:56.337200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:56.337200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:56.337200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:56.337200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:56.337200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:56.337200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:56.337200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:56.337200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:56.337200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:56.337200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:56.337200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:56.337200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:56.338027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:56.338027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:56.338027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:56.338027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:56.338027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:56.338027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:56.338027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:56.338027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:56.338027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:56.338027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:56.338027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:56.338027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:56.341329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477ba87-8449-4006-9da7-df118ae63ab0 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:56.343650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 309/612] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:39:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:56.343907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:56.349434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bac5d9-9dd3-40cf-a88b-653990268b87 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:56.415647 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01124071-c4e8-4965-a482-ded0af1ef87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:56.416938 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01124071-c4e8-4965-a482-ded0af1ef87f None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:56.417423 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01124071-c4e8-4965-a482-ded0af1ef87f None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:56.417929 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01124071-c4e8-4965-a482-ded0af1ef87f None admin] PATH_INFO: `/v3/roles/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:56.430906 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01124071-c4e8-4965-a482-ded0af1ef87f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:56.440503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-01124071-c4e8-4965-a482-ded0af1ef87f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:56.440503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:56.440503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:56.440503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:56.440503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:56.440503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:56.440503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:56.440503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:56.440503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:56.440503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:56.440503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:56.440503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:56.440503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:56.440503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:56.440503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:56.440503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:56.441499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:56.441499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:56.441499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:56.441499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:56.441499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:56.441499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:56.441499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:56.441499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:56.441499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:56.441499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:56.441499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:56.441499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:56.441499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:56.441499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:56.441499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:56.441499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:56.442318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:56.442318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:56.442318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:56.442318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:56.442318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:56.442318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:56.442318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:56.442318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:56.442318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:56.442318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:56.442318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:56.442318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:56.442318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 304/613] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:39:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:56.449578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01124071-c4e8-4965-a482-ded0af1ef87f None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:56.457751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:56.480616 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bac5d9-9dd3-40cf-a88b-653990268b87 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:56.520707 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b161d-1003-406f-aa8c-396a1662925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:56.521818 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b161d-1003-406f-aa8c-396a1662925b None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:56.522340 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b161d-1003-406f-aa8c-396a1662925b None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:56.522810 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b161d-1003-406f-aa8c-396a1662925b None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:56.523929 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b161d-1003-406f-aa8c-396a1662925b None admin] RBAC: Adding query filter params (name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:56.524482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b161d-1003-406f-aa8c-396a1662925b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:56.526178 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b161d-1003-406f-aa8c-396a1662925b None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:56.538876 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 310/614] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:39:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:56.545111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b161d-1003-406f-aa8c-396a1662925b None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:56.571034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01124071-c4e8-4965-a482-ded0af1ef87f None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:56.607478 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caa3e1-07b9-4868-b9f7-1a11b4736020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:56.608493 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caa3e1-07b9-4868-b9f7-1a11b4736020 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:56.609007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caa3e1-07b9-4868-b9f7-1a11b4736020 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:56.609429 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caa3e1-07b9-4868-b9f7-1a11b4736020 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:56.610327 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73caa3e1-07b9-4868-b9f7-1a11b4736020 None admin] RBAC: Adding query filter params (name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:56.610815 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73caa3e1-07b9-4868-b9f7-1a11b4736020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:56.612343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73caa3e1-07b9-4868-b9f7-1a11b4736020 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:56.622594 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 305/615] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:39:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:56.630591 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caa3e1-07b9-4868-b9f7-1a11b4736020 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:56.658599 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:56.736885 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caa3e1-07b9-4868-b9f7-1a11b4736020 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:56.774250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b161d-1003-406f-aa8c-396a1662925b None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:56.804187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da49ab4-8515-47f7-8caf-3ee2a37cdd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:56.808686 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da49ab4-8515-47f7-8caf-3ee2a37cdd29 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:56.808686 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da49ab4-8515-47f7-8caf-3ee2a37cdd29 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:56.808686 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da49ab4-8515-47f7-8caf-3ee2a37cdd29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:56.827906 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da49ab4-8515-47f7-8caf-3ee2a37cdd29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:56.829408 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da49ab4-8515-47f7-8caf-3ee2a37cdd29 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:56.837873 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76474718-3d8f-4bf2-b20c-2d20c9c860df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:56.838679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76474718-3d8f-4bf2-b20c-2d20c9c860df None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:56.838967 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76474718-3d8f-4bf2-b20c-2d20c9c860df None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:56.839247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76474718-3d8f-4bf2-b20c-2d20c9c860df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:56.861009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-7da49ab4-8515-47f7-8caf-3ee2a37cdd29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:56.861009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:56.861009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:56.861009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:56.861009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:56.861009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:56.861009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:56.861009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:56.861009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:56.861009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:56.861009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:56.861009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:56.861009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:56.861009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:56.861009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:56.861936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:56.861936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:56.861936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:56.861936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:56.861936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:56.861936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:56.861936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:56.861936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:56.861936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:56.861936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:56.861936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:56.861936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:56.861936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:56.861936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:56.861936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:56.861936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:56.861936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:56.862842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:56.862842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:56.862842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:56.862842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:56.863586 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76474718-3d8f-4bf2-b20c-2d20c9c860df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:56.864691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76474718-3d8f-4bf2-b20c-2d20c9c860df None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:56.872362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 306/616] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:56.872973 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:56.873340 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da49ab4-8515-47f7-8caf-3ee2a37cdd29 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:56.887971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-76474718-3d8f-4bf2-b20c-2d20c9c860df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:56.887971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:56.887971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:56.887971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:56.887971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:56.887971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:56.887971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:56.887971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:56.887971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:56.887971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:56.887971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:56.887971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:56.887971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:56.887971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:56.887971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:56.889557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:56.889557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:56.889557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:56.889557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:56.889557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:56.889557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:56.889557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:56.889557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:56.889557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:56.889557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:56.889557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:56.889557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:56.889557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:56.889557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:56.889557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:56.889557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:56.889557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:56.890429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:56.890429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:56.890429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:56.890429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:56.898415 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 311/617] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:56.905228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76474718-3d8f-4bf2-b20c-2d20c9c860df None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:56.985405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:57.006900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da49ab4-8515-47f7-8caf-3ee2a37cdd29 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:57.041883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0625a3-229b-4dd5-a4a9-95633e373326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:57.042560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0625a3-229b-4dd5-a4a9-95633e373326 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:57.042847 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0625a3-229b-4dd5-a4a9-95633e373326 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:57.043135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0625a3-229b-4dd5-a4a9-95633e373326 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:57.043861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0625a3-229b-4dd5-a4a9-95633e373326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:57.044173 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0625a3-229b-4dd5-a4a9-95633e373326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:57.045943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0625a3-229b-4dd5-a4a9-95633e373326 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:57.047487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76474718-3d8f-4bf2-b20c-2d20c9c860df None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:57.058405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 307/618] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:57.064290 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0625a3-229b-4dd5-a4a9-95633e373326 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:57.093083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360dd66e-6c56-444e-ad23-a642f8d200cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:57.094348 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360dd66e-6c56-444e-ad23-a642f8d200cd None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:57.094897 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360dd66e-6c56-444e-ad23-a642f8d200cd None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:57.095384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360dd66e-6c56-444e-ad23-a642f8d200cd None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:57.096350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360dd66e-6c56-444e-ad23-a642f8d200cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:57.096889 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360dd66e-6c56-444e-ad23-a642f8d200cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:57.098519 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360dd66e-6c56-444e-ad23-a642f8d200cd None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:57.111366 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 312/619] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:57.116170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360dd66e-6c56-444e-ad23-a642f8d200cd None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:57.221005 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:57.262192 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0625a3-229b-4dd5-a4a9-95633e373326 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:57.288492 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360dd66e-6c56-444e-ad23-a642f8d200cd None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:57.327654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc17998-6c78-4809-b80f-f4ae814516bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:57.328452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc17998-6c78-4809-b80f-f4ae814516bd None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:57.328752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc17998-6c78-4809-b80f-f4ae814516bd None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:57.329024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc17998-6c78-4809-b80f-f4ae814516bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:57.333904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:57.339740 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc17998-6c78-4809-b80f-f4ae814516bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:57.341229 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc17998-6c78-4809-b80f-f4ae814516bd None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:57.346961 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bb4c5-934f-4f6e-adba-308fb9d124ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:57.347927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bb4c5-934f-4f6e-adba-308fb9d124ce None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:57.348147 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bb4c5-934f-4f6e-adba-308fb9d124ce None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:57.348434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bb4c5-934f-4f6e-adba-308fb9d124ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:57.356112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bb4c5-934f-4f6e-adba-308fb9d124ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:57.357630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-7cc17998-6c78-4809-b80f-f4ae814516bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:39:57.357630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:57.357630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:57.357630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:57.357630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:57.357630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:57.357630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:57.357630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:57.357630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:57.357630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:57.357630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:57.357630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:57.357630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:39:57.357630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:39:57.357630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:39:57.357630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:39:57.358625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:57.358625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:57.358625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:39:57.358625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:57.358625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:39:57.358625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:57.358625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:57.358625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:57.358625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:57.358625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:57.358625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:57.358625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:57.358625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:57.358625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:57.358625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:57.358625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:57.358625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:57.358625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:57.359557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:57.359557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:57.359557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:39:57.359557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:39:57.359557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:39:57.359557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:39:57.359557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:39:57.359557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:39:57.359557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:39:57.359557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:57.360081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bb4c5-934f-4f6e-adba-308fb9d124ce None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:57.360152 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 308/620] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jun 23 10:39:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:39:57.364673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a02a60-f39e-48ac-a377-0d3e66c10a38 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:57.364673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a02a60-f39e-48ac-a377-0d3e66c10a38 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:57.364673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a02a60-f39e-48ac-a377-0d3e66c10a38 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:57.364673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 309/621] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:57.364673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a02a60-f39e-48ac-a377-0d3e66c10a38 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:57.379048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-a94bb4c5-934f-4f6e-adba-308fb9d124ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:39:57.379048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:57.379048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:57.379048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:57.379048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:57.379048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:57.379048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:57.379048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:57.379048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:57.379048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:57.379048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:57.379048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:57.379048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:39:57.379048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:39:57.379048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:39:57.379048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:39:57.381452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:57.381452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:57.381452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:39:57.381452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:57.381452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:39:57.381452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:57.381452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:57.381452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:57.381452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:57.381452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:57.381452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:57.381452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:57.381452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:57.381452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:57.381452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:57.381452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:57.381452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:57.381452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:57.383766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:57.383766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:57.383766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:39:57.383766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:39:57.383766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:39:57.383766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:39:57.383766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:39:57.383766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:39:57.383766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:39:57.383766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:57.383766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 313/622] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:39:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:57.383766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cc92d-cc9b-435d-bd2d-c9fd32a8d730 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:57.383766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cc92d-cc9b-435d-bd2d-c9fd32a8d730 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:57.385390 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cc92d-cc9b-435d-bd2d-c9fd32a8d730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:57.407121 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-597cc92d-cc9b-435d-bd2d-c9fd32a8d730 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:57.408436 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-597cc92d-cc9b-435d-bd2d-c9fd32a8d730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:57.495278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 314/623] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:57.496566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cc92d-cc9b-435d-bd2d-c9fd32a8d730 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:57.500443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a02a60-f39e-48ac-a377-0d3e66c10a38 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:57.545489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdaf95-c2cf-4a9e-a06c-86823715a1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:57.546241 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdaf95-c2cf-4a9e-a06c-86823715a1aa None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:57.546629 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdaf95-c2cf-4a9e-a06c-86823715a1aa None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:57.547104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdaf95-c2cf-4a9e-a06c-86823715a1aa None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:57.548221 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdaf95-c2cf-4a9e-a06c-86823715a1aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:57.548716 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdaf95-c2cf-4a9e-a06c-86823715a1aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:57.550308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdaf95-c2cf-4a9e-a06c-86823715a1aa None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:57.561173 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:57.571555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 310/624] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jun 23 10:39:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:57.573548 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdaf95-c2cf-4a9e-a06c-86823715a1aa None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:57.636264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:57.640138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cc92d-cc9b-435d-bd2d-c9fd32a8d730 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:57.678418 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2db4a-5c84-4fd0-badf-ba72dd5cf9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:57.679381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2db4a-5c84-4fd0-badf-ba72dd5cf9c9 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:57.679920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2db4a-5c84-4fd0-badf-ba72dd5cf9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:57.680350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2db4a-5c84-4fd0-badf-ba72dd5cf9c9 None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:57.681482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2db4a-5c84-4fd0-badf-ba72dd5cf9c9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:57.681949 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2db4a-5c84-4fd0-badf-ba72dd5cf9c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:57.683213 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdaf95-c2cf-4a9e-a06c-86823715a1aa None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:57.683723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2db4a-5c84-4fd0-badf-ba72dd5cf9c9 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:57.709989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 315/625] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jun 23 10:39:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:57.711226 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2db4a-5c84-4fd0-badf-ba72dd5cf9c9 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:57.720063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682f9f1-7b56-494b-b88a-a8c482aa87cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:57.720892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682f9f1-7b56-494b-b88a-a8c482aa87cb None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:57.721176 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682f9f1-7b56-494b-b88a-a8c482aa87cb None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:57.721451 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682f9f1-7b56-494b-b88a-a8c482aa87cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:57.731883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682f9f1-7b56-494b-b88a-a8c482aa87cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:57.740339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-a682f9f1-7b56-494b-b88a-a8c482aa87cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:57.740339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:57.740339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:57.740339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:57.740339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:57.740339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:57.740339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:57.740339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:57.740339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:57.740339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:57.740339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:57.740339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:57.740339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:57.740339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:57.740339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:57.740339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:57.741515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:57.741515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:57.741515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:57.741515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:57.741515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:57.741515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:57.741515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:57.741515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:57.741515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:57.741515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:57.741515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:57.741515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:57.741515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:57.741515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:57.741515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:57.741515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:57.742540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:57.742540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:57.742540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:57.742540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:57.742540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:57.742540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:57.742540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:57.742540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:57.742540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:57.742540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:57.742540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:57.742540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:57.742540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 311/626] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:39:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:57.743242 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682f9f1-7b56-494b-b88a-a8c482aa87cb None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:57.827851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2db4a-5c84-4fd0-badf-ba72dd5cf9c9 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:57.829728 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:57.845391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682f9f1-7b56-494b-b88a-a8c482aa87cb None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:57.860981 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:57.864622 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a365b1-807e-42c9-9aaf-a0b576556a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:57.865296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a365b1-807e-42c9-9aaf-a0b576556a1c None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:57.865581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a365b1-807e-42c9-9aaf-a0b576556a1c None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:57.865857 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a365b1-807e-42c9-9aaf-a0b576556a1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:57.881935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7780f-8f7a-4c8d-9813-4ae6f047c39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:57.883055 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7780f-8f7a-4c8d-9813-4ae6f047c39d None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:57.883465 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7780f-8f7a-4c8d-9813-4ae6f047c39d None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:57.883753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7780f-8f7a-4c8d-9813-4ae6f047c39d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:57.894300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7780f-8f7a-4c8d-9813-4ae6f047c39d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:57.896248 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7780f-8f7a-4c8d-9813-4ae6f047c39d None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:57.914827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-2bc7780f-8f7a-4c8d-9813-4ae6f047c39d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:57.914827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:57.914827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:57.914827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:57.914827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:57.914827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:57.914827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:57.914827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:57.914827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:57.914827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:57.914827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:57.914827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:57.914827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:57.914827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:57.914827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:57.915908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:57.915908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:57.915908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:57.915908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:57.915908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:57.915908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:57.915908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:57.915908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:57.915908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:57.915908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:57.915908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:57.915908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:57.915908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:57.915908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:57.915908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:57.915908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:57.915908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:57.917257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:57.917257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:57.917257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:57.917257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:57.917257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 312/627] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:57.917637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7780f-8f7a-4c8d-9813-4ae6f047c39d None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:57.943285 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a365b1-807e-42c9-9aaf-a0b576556a1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:57.945215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a365b1-807e-42c9-9aaf-a0b576556a1c None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:58.031480 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7780f-8f7a-4c8d-9813-4ae6f047c39d None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:58.050443 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 316/628] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:39:58.051829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f83ea-6173-44af-a0e8-cb80c1fc246e None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:58.052189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f83ea-6173-44af-a0e8-cb80c1fc246e None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:58.052534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f83ea-6173-44af-a0e8-cb80c1fc246e None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:58.056885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 317/629] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:58.056885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f83ea-6173-44af-a0e8-cb80c1fc246e None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:58.059794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:58.073877 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ade88-efda-4abf-ac88-19bf700ab34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:58.074557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ade88-efda-4abf-ac88-19bf700ab34f None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:58.074846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ade88-efda-4abf-ac88-19bf700ab34f None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:58.075124 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ade88-efda-4abf-ac88-19bf700ab34f None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:58.076402 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ade88-efda-4abf-ac88-19bf700ab34f None admin] RBAC: Adding query filter params (name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:58.077043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ade88-efda-4abf-ac88-19bf700ab34f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:58.078598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ade88-efda-4abf-ac88-19bf700ab34f None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:58.087016 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 313/630] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:39:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:58.087834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ade88-efda-4abf-ac88-19bf700ab34f None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:58.121121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:58.168817 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f83ea-6173-44af-a0e8-cb80c1fc246e None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:58.199309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ade88-efda-4abf-ac88-19bf700ab34f None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:58.204931 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b433a0-5f5e-4c6c-b380-d8f7fc941854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:58.205591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b433a0-5f5e-4c6c-b380-d8f7fc941854 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:58.205875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b433a0-5f5e-4c6c-b380-d8f7fc941854 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:58.206151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b433a0-5f5e-4c6c-b380-d8f7fc941854 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:58.206867 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b433a0-5f5e-4c6c-b380-d8f7fc941854 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:58.207491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b433a0-5f5e-4c6c-b380-d8f7fc941854 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:58.208542 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b433a0-5f5e-4c6c-b380-d8f7fc941854 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:58.226366 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 318/631] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:58.226366 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f05ce3-2a8a-4144-b6ef-612f7ffc0ad3 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:58.226366 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f05ce3-2a8a-4144-b6ef-612f7ffc0ad3 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:58.226366 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f05ce3-2a8a-4144-b6ef-612f7ffc0ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:58.235796 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66798d04-edac-4443-a677-0c158fe9f8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:58.236752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66798d04-edac-4443-a677-0c158fe9f8ec None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:58.237148 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66798d04-edac-4443-a677-0c158fe9f8ec None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:58.237528 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66798d04-edac-4443-a677-0c158fe9f8ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:58.243664 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-06f05ce3-2a8a-4144-b6ef-612f7ffc0ad3 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:58.245060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-06f05ce3-2a8a-4144-b6ef-612f7ffc0ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:58.249948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66798d04-edac-4443-a677-0c158fe9f8ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:58.251420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66798d04-edac-4443-a677-0c158fe9f8ec None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:58.270541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-66798d04-edac-4443-a677-0c158fe9f8ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:58.270541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:58.270541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:58.270541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:58.270541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:58.270541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:58.270541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:58.270541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:58.270541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:58.270541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:58.270541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:58.270541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:58.270541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:58.270541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:58.270541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:58.271655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:58.271655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:58.271655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:58.271655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:58.271655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:58.271655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:58.271655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:58.271655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:58.271655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:58.271655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:58.271655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:58.271655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:58.271655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:58.271655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:58.271655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:58.271655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:58.271655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:58.272756 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:58.272756 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:58.272756 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:58.272756 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:58.276248 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 314/632] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:58.277024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66798d04-edac-4443-a677-0c158fe9f8ec None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:58.310841 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:58.320653 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 319/633] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:58.321467 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f05ce3-2a8a-4144-b6ef-612f7ffc0ad3 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:58.375110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:58.397057 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66798d04-edac-4443-a677-0c158fe9f8ec None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:58.433912 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1487f6f-4e61-4a23-90a5-dfdbc08cab75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:58.434606 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f05ce3-2a8a-4144-b6ef-612f7ffc0ad3 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:58.434867 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1487f6f-4e61-4a23-90a5-dfdbc08cab75 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:58.435736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1487f6f-4e61-4a23-90a5-dfdbc08cab75 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:58.436303 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1487f6f-4e61-4a23-90a5-dfdbc08cab75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:58.447942 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1487f6f-4e61-4a23-90a5-dfdbc08cab75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:58.449777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1487f6f-4e61-4a23-90a5-dfdbc08cab75 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:58.469221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a575d5-5392-407d-92e6-16c4b008428a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:58.469797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-e1487f6f-4e61-4a23-90a5-dfdbc08cab75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:58.469797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:58.469797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:58.469797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:58.469797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:58.469797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:58.469797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:58.469797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:58.469797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:58.469797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:58.469797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:58.469797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:58.469797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:58.469797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:58.469797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:58.470832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:58.470832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:58.470832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:58.470832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:58.470832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:58.470832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:58.470832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:58.470832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:58.470832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:58.470832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:58.470832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:58.470832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:58.470832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:58.470832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:58.470832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:58.470832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:58.470832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:58.471889 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:58.471889 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:58.471889 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:58.471889 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:58.472152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a575d5-5392-407d-92e6-16c4b008428a None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:58.472152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a575d5-5392-407d-92e6-16c4b008428a None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:58.472152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a575d5-5392-407d-92e6-16c4b008428a None admin] PATH_INFO: `/v3/projects/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:58.476612 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 315/634] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:58.477219 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1487f6f-4e61-4a23-90a5-dfdbc08cab75 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:58.478181 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a575d5-5392-407d-92e6-16c4b008428a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:58.479739 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a575d5-5392-407d-92e6-16c4b008428a None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:58.493951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-b9a575d5-5392-407d-92e6-16c4b008428a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:58.493951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:58.493951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:58.493951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:58.493951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:58.493951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:58.493951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:58.493951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:58.493951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:58.493951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:58.493951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:58.493951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:58.493951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:39:58.493951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:39:58.493951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:39:58.495042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:39:58.495042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:58.495042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:58.495042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:58.495042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:58.495042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:58.495042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:58.495042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:58.495042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:58.495042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:58.495042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:58.495042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:58.495042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:58.495042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:58.495042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:58.495042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:58.495042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:58.496003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:39:58.496003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:39:58.496003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:39:58.496003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:39:58.496003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:39:58.496003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:39:58.496003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:58.496003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:58.496003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 320/635] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:58.496506 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a575d5-5392-407d-92e6-16c4b008428a None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:58.554534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:58.587913 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1487f6f-4e61-4a23-90a5-dfdbc08cab75 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:58.605122 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a575d5-5392-407d-92e6-16c4b008428a None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:58.624376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:58.635530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3879a9e-0378-431a-8f54-dc1af239e551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:58.635530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3879a9e-0378-431a-8f54-dc1af239e551 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:58.635530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3879a9e-0378-431a-8f54-dc1af239e551 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:58.635530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3879a9e-0378-431a-8f54-dc1af239e551 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:58.635895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3879a9e-0378-431a-8f54-dc1af239e551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:58.635895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3879a9e-0378-431a-8f54-dc1af239e551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:58.635895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3879a9e-0378-431a-8f54-dc1af239e551 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:58.640183 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cd8e0-c848-4b7d-8a67-80d4dd3780d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:58.640999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cd8e0-c848-4b7d-8a67-80d4dd3780d6 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:58.641292 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cd8e0-c848-4b7d-8a67-80d4dd3780d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:58.641565 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cd8e0-c848-4b7d-8a67-80d4dd3780d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:58.646284 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 316/636] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:58.647223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3879a9e-0378-431a-8f54-dc1af239e551 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:58.652120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6cd8e0-c848-4b7d-8a67-80d4dd3780d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:58.660059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-0b6cd8e0-c848-4b7d-8a67-80d4dd3780d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:58.660059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:58.660059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:58.660059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:58.660059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:58.660059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:58.660059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:58.660059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:58.660059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:58.660059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:58.660059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:58.660059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:58.660059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:58.660059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:58.660059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:58.660059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:58.661215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:58.661215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:58.661215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:58.661215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:58.661215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:58.661215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:58.661215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:58.661215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:58.661215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:58.661215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:58.661215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:58.661215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:58.661215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:58.661215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:58.661215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:58.661215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:58.662331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:58.662331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:58.662331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:58.662331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:58.662331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:58.662331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:58.662331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:58.662331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:58.662331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:58.662331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:58.662331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:58.662331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:58.662331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 321/637] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:39:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:58.662331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cd8e0-c848-4b7d-8a67-80d4dd3780d6 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:58.748274 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3879a9e-0378-431a-8f54-dc1af239e551 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:58.762902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cd8e0-c848-4b7d-8a67-80d4dd3780d6 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:58.776079 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:58.781790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd62df4-4785-4194-a45d-54063fd60214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:58.782460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd62df4-4785-4194-a45d-54063fd60214 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:58.782750 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd62df4-4785-4194-a45d-54063fd60214 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:58.783077 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd62df4-4785-4194-a45d-54063fd60214 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:58.783912 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd62df4-4785-4194-a45d-54063fd60214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:58.784228 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd62df4-4785-4194-a45d-54063fd60214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:58.785636 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd62df4-4785-4194-a45d-54063fd60214 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:58.796894 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169052e-07f7-4fdf-b57e-1d574f3b2bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:58.797441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 317/638] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:58.797563 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169052e-07f7-4fdf-b57e-1d574f3b2bba None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:58.797823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169052e-07f7-4fdf-b57e-1d574f3b2bba None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:58.798100 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169052e-07f7-4fdf-b57e-1d574f3b2bba None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:58.798703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a563555-ebfa-4670-b747-26a5542406ac None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:58.798964 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169052e-07f7-4fdf-b57e-1d574f3b2bba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:58.799069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a563555-ebfa-4670-b747-26a5542406ac None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:58.799269 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a563555-ebfa-4670-b747-26a5542406ac None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:58.799363 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169052e-07f7-4fdf-b57e-1d574f3b2bba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:58.800629 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 318/639] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:39:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:58.800780 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169052e-07f7-4fdf-b57e-1d574f3b2bba None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:58.801208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a563555-ebfa-4670-b747-26a5542406ac None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:58.818621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 322/640] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:39:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:58.818621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169052e-07f7-4fdf-b57e-1d574f3b2bba None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:58.854562 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:58.901917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a563555-ebfa-4670-b747-26a5542406ac None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:58.911972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169052e-07f7-4fdf-b57e-1d574f3b2bba None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:58.934676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456ce8f-3ed0-4ed6-854b-22c276fa89de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:58.936052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456ce8f-3ed0-4ed6-854b-22c276fa89de None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:58.936339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456ce8f-3ed0-4ed6-854b-22c276fa89de None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:58.936622 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456ce8f-3ed0-4ed6-854b-22c276fa89de None admin] PATH_INFO: `/v3/projects/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:58.943273 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456ce8f-3ed0-4ed6-854b-22c276fa89de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:58.944761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456ce8f-3ed0-4ed6-854b-22c276fa89de None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:58.945081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8ea24-399e-4e18-9f1e-962ac876b33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:58.945823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8ea24-399e-4e18-9f1e-962ac876b33b None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:58.946108 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8ea24-399e-4e18-9f1e-962ac876b33b None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:58.946384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8ea24-399e-4e18-9f1e-962ac876b33b None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:58.947125 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8ea24-399e-4e18-9f1e-962ac876b33b None admin] RBAC: Adding query filter params (name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:58.947436 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8ea24-399e-4e18-9f1e-962ac876b33b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:58.948804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8ea24-399e-4e18-9f1e-962ac876b33b None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:58.956592 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 323/641] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:39:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:58.957391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8ea24-399e-4e18-9f1e-962ac876b33b None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:58.958861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-2456ce8f-3ed0-4ed6-854b-22c276fa89de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:58.958861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:58.958861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:58.958861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:58.958861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:58.958861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:58.958861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:58.958861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:58.958861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:58.958861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:58.958861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:58.958861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:58.958861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:39:58.958861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:39:58.958861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:39:58.959753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:39:58.959753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:58.959753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:58.959753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:58.959753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:58.959753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:58.959753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:58.959753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:58.959753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:58.959753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:58.959753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:58.959753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:58.959753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:58.959753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:58.959753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:58.959753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:58.959753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:58.960711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:39:58.960711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:39:58.960711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:39:58.960711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:39:58.960711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:39:58.960711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:39:58.960711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:39:58.960711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:39:58.960711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 319/642] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:39:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:58.961388 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9789fb6-0a84-4ebe-91ed-c1f46bb26863 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:58.961675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9789fb6-0a84-4ebe-91ed-c1f46bb26863 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:58.961966 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9789fb6-0a84-4ebe-91ed-c1f46bb26863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:58.978819 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-f9789fb6-0a84-4ebe-91ed-c1f46bb26863 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:58.980029 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f9789fb6-0a84-4ebe-91ed-c1f46bb26863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:58.992943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:59.046192 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 320/643] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:39:59.046990 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9789fb6-0a84-4ebe-91ed-c1f46bb26863 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:59.062507 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8ea24-399e-4e18-9f1e-962ac876b33b None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:59.090564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:59.098283 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92b99c-af6f-4989-961a-52bc790e85f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:59.099084 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92b99c-af6f-4989-961a-52bc790e85f6 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:59.099371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92b99c-af6f-4989-961a-52bc790e85f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:59.104044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92b99c-af6f-4989-961a-52bc790e85f6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:59.106678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92b99c-af6f-4989-961a-52bc790e85f6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:59.108909 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92b99c-af6f-4989-961a-52bc790e85f6 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:59.123645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-3c92b99c-af6f-4989-961a-52bc790e85f6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 10:39:59.123645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:59.123645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:59.123645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:59.123645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:59.123645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:59.123645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:59.123645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:59.123645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:59.123645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:59.123645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:59.123645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:59.123645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:39:59.123645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:39:59.123645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:39:59.123645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:39:59.124581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:59.124581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:59.124581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:39:59.124581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:59.124581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:39:59.124581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:39:59.124581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:59.124581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:59.124581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:59.124581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:59.124581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:59.124581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:59.124581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:59.124581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:59.124581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:59.124581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:59.124581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:59.124581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:59.125700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:59.125700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:59.125700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:39:59.125700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:39:59.125700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:39:59.125700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:39:59.125700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:39:59.125700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:39:59.125700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 10:39:59.125700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:59.125700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 324/644] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:59.125700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92b99c-af6f-4989-961a-52bc790e85f6 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:59.149283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9789fb6-0a84-4ebe-91ed-c1f46bb26863 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:59.183424 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab18c5-ad55-4219-8742-370d90c66502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:59.184251 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab18c5-ad55-4219-8742-370d90c66502 None admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:59.184540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab18c5-ad55-4219-8742-370d90c66502 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:59.184859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab18c5-ad55-4219-8742-370d90c66502 None admin] PATH_INFO: `/v3/projects/d7a9c82a62044db884e547da9a523927/users/4a54fa1c326f41e88688404a56b75c30/roles/3522dd96085d47688d7a42ed133484a9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:59.199029 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab18c5-ad55-4219-8742-370d90c66502 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7a9c82a62044db884e547da9a523927, user_id=4a54fa1c326f41e88688404a56b75c30, role_id=3522dd96085d47688d7a42ed133484a9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:59.200490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab18c5-ad55-4219-8742-370d90c66502 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:59.215858 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:59.223087 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92b99c-af6f-4989-961a-52bc790e85f6 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:59.257538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e3987-b3c8-4c93-a8bc-d7b9c942f786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:59.258324 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e3987-b3c8-4c93-a8bc-d7b9c942f786 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:59.258653 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e3987-b3c8-4c93-a8bc-d7b9c942f786 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:59.258931 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e3987-b3c8-4c93-a8bc-d7b9c942f786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:59.269670 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e3987-b3c8-4c93-a8bc-d7b9c942f786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:59.271376 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e3987-b3c8-4c93-a8bc-d7b9c942f786 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:59.271481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 321/645] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:39:59 2022] PUT /identity/v3/projects/d7a9c82a62044db884e547da9a523927/users/4a54fa1c326f41e88688404a56b75c30/roles/3522dd96085d47688d7a42ed133484a9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:39:59.271985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab18c5-ad55-4219-8742-370d90c66502 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:59.290924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-6f6e3987-b3c8-4c93-a8bc-d7b9c942f786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:59.290924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:59.290924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:59.290924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:59.290924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:59.290924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:59.290924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:59.290924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:59.290924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:59.290924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:59.290924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:59.290924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:59.290924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:39:59.290924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:39:59.290924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:39:59.292036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:39:59.292036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:59.292036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:59.292036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:59.292036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:59.292036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:59.292036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:59.292036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:59.292036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:59.292036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:59.292036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:59.292036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:59.292036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:59.292036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:59.292036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:59.292036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:59.292036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:59.293168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:39:59.293168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:39:59.293168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:39:59.293168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:59.296833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 325/646] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:59.301109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e3987-b3c8-4c93-a8bc-d7b9c942f786 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:59.381340 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:59.391320 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab18c5-ad55-4219-8742-370d90c66502 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:59.430351 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebc754-56ee-4d0e-94ae-7f26ce7913f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:59.431032 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebc754-56ee-4d0e-94ae-7f26ce7913f6 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:59.431319 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebc754-56ee-4d0e-94ae-7f26ce7913f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:59.432534 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebc754-56ee-4d0e-94ae-7f26ce7913f6 None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:59.432534 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebc754-56ee-4d0e-94ae-7f26ce7913f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:59.432817 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebc754-56ee-4d0e-94ae-7f26ce7913f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:59.434286 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebc754-56ee-4d0e-94ae-7f26ce7913f6 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:59.437395 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e3987-b3c8-4c93-a8bc-d7b9c942f786 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:59.447656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 322/647] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:39:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:59.448582 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebc754-56ee-4d0e-94ae-7f26ce7913f6 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:59.478643 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075453c-b052-4836-9f3a-a99a04b8355e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:59.479602 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075453c-b052-4836-9f3a-a99a04b8355e None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:59.479890 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075453c-b052-4836-9f3a-a99a04b8355e None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:59.480490 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075453c-b052-4836-9f3a-a99a04b8355e None admin] PATH_INFO: `/v3/roles/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:59.492536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075453c-b052-4836-9f3a-a99a04b8355e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:59.501152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-6075453c-b052-4836-9f3a-a99a04b8355e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:59.501152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:59.501152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:59.501152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:59.501152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:59.501152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:59.501152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:59.501152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:59.501152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:59.501152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:59.501152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:59.501152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:59.501152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:59.501152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:59.501152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:59.501152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:59.502278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:59.502278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:59.502278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:59.502278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:59.502278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:59.502278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:59.502278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:59.502278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:59.502278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:59.502278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:59.502278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:59.502278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:59.502278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:59.502278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:59.502278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:59.502278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:59.503271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:59.503271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:59.503271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:59.503271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:59.503271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:59.503271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:59.503271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:59.503271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:59.503271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:59.503271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:59.503271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:39:59.503271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:39:59.508813 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 326/648] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:39:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:59.508813 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075453c-b052-4836-9f3a-a99a04b8355e None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:59.517175 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:59.564386 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebc754-56ee-4d0e-94ae-7f26ce7913f6 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:59.599545 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0443a0-5b60-4121-9ff7-e6bd80187017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:59.600232 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0443a0-5b60-4121-9ff7-e6bd80187017 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:59.600518 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0443a0-5b60-4121-9ff7-e6bd80187017 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:59.600833 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0443a0-5b60-4121-9ff7-e6bd80187017 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:59.601677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0443a0-5b60-4121-9ff7-e6bd80187017 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:59.601986 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0443a0-5b60-4121-9ff7-e6bd80187017 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:59.603429 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0443a0-5b60-4121-9ff7-e6bd80187017 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:59.622401 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075453c-b052-4836-9f3a-a99a04b8355e None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:59.625264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 323/649] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jun 23 10:39:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:59.626325 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0443a0-5b60-4121-9ff7-e6bd80187017 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:59.641368 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:59.663583 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b71ea-512d-434f-a986-a59c158ae382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:59.664339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b71ea-512d-434f-a986-a59c158ae382 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:59.664629 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b71ea-512d-434f-a986-a59c158ae382 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:59.664942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b71ea-512d-434f-a986-a59c158ae382 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:59.665674 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b71ea-512d-434f-a986-a59c158ae382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:59.665994 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b71ea-512d-434f-a986-a59c158ae382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:59.667386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b71ea-512d-434f-a986-a59c158ae382 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:59.680823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 327/650] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:59.681669 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b71ea-512d-434f-a986-a59c158ae382 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:59.734756 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0443a0-5b60-4121-9ff7-e6bd80187017 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:59.754138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:59.775366 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e00c9-e8ca-4130-b936-4590099482e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:59.776038 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e00c9-e8ca-4130-b936-4590099482e4 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:59.776322 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e00c9-e8ca-4130-b936-4590099482e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:59.776601 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e00c9-e8ca-4130-b936-4590099482e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:59.777463 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e00c9-e8ca-4130-b936-4590099482e4 None admin] RBAC: Adding query filter params (role.id=3522dd96085d47688d7a42ed133484a9, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=39840f048d254831bdb963b38520f706) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:59.777777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e00c9-e8ca-4130-b936-4590099482e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:59.779396 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e00c9-e8ca-4130-b936-4590099482e4 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:59.785931 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 324/651] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:59 2022] GET /identity/v3/role_assignments?user.id=39840f048d254831bdb963b38520f706&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=3522dd96085d47688d7a42ed133484a9 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:59.786740 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e00c9-e8ca-4130-b936-4590099482e4 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:59.803381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b71ea-512d-434f-a986-a59c158ae382 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:59.848949 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5ffe1-04f7-4e2c-921e-05fec91ed2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:59.849919 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5ffe1-04f7-4e2c-921e-05fec91ed2f5 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:59.850360 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5ffe1-04f7-4e2c-921e-05fec91ed2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:59.850889 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5ffe1-04f7-4e2c-921e-05fec91ed2f5 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:59.851870 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5ffe1-04f7-4e2c-921e-05fec91ed2f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:59.852340 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5ffe1-04f7-4e2c-921e-05fec91ed2f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:59.854072 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5ffe1-04f7-4e2c-921e-05fec91ed2f5 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:59.865048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 328/652] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:39:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:59.866264 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5ffe1-04f7-4e2c-921e-05fec91ed2f5 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:59.890408 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:59.918455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e00c9-e8ca-4130-b936-4590099482e4 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:59.958733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59139b25-4110-43e9-83c8-4da93a5f0812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:59.959675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59139b25-4110-43e9-83c8-4da93a5f0812 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:59.959961 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59139b25-4110-43e9-83c8-4da93a5f0812 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:59.960246 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59139b25-4110-43e9-83c8-4da93a5f0812 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:00.002954 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5ffe1-04f7-4e2c-921e-05fec91ed2f5 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:00.033253 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:00.045355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb4f52-d4e3-4f87-b62e-bd270ccdeed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:00.047115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb4f52-d4e3-4f87-b62e-bd270ccdeed5 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:00.047365 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb4f52-d4e3-4f87-b62e-bd270ccdeed5 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:00.047653 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb4f52-d4e3-4f87-b62e-bd270ccdeed5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:00.050462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59139b25-4110-43e9-83c8-4da93a5f0812 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:00.052401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59139b25-4110-43e9-83c8-4da93a5f0812 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:00.059144 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb4f52-d4e3-4f87-b62e-bd270ccdeed5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:00.061769 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb4f52-d4e3-4f87-b62e-bd270ccdeed5 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:00.081190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-6ebb4f52-d4e3-4f87-b62e-bd270ccdeed5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 10:40:00.081190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:00.081190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:00.081190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:00.081190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:00.081190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:00.081190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:00.081190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:00.081190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:00.081190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:00.081190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:00.081190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:00.081190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:00.081190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:00.081190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:00.081190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:00.082760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:00.082760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:00.082760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:00.082760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:00.082760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:00.082760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:00.082760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:00.082760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:00.082760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:00.082760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:00.082760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:00.082760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:00.082760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:00.082760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:00.082760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:00.082760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:00.082760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:00.082760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:00.083943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:00.083943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:00.083943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:00.083943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:00.083943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:00.083943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:00.083943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:00.083943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:00.083943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 10:40:00.083943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:00.083943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 329/653] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:39:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:00.083943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb4f52-d4e3-4f87-b62e-bd270ccdeed5 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:00.151712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:00.187243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 325/654] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:40:00.189006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59139b25-4110-43e9-83c8-4da93a5f0812 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:00.213298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb4f52-d4e3-4f87-b62e-bd270ccdeed5 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:00.253173 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c481ce-9bf2-416e-8a79-7f0ffd022246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:00.255055 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c481ce-9bf2-416e-8a79-7f0ffd022246 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:00.255518 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c481ce-9bf2-416e-8a79-7f0ffd022246 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:00.255936 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c481ce-9bf2-416e-8a79-7f0ffd022246 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:00.271692 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c481ce-9bf2-416e-8a79-7f0ffd022246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:00.274140 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c481ce-9bf2-416e-8a79-7f0ffd022246 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:00.298020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-d3c481ce-9bf2-416e-8a79-7f0ffd022246 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:00.298020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:00.298020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:00.298020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:00.298020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:00.298020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:00.298020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:00.298020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:00.298020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:00.298020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:00.298020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:00.298020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:00.298020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:00.298020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:00.298020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:00.299151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:00.299151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:00.299151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:00.299151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:00.299151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:00.299151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:00.299151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:00.299151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:00.299151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:00.299151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:00.299151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:00.299151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:00.299151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:00.299151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:00.299151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:00.299151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:00.299151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:00.300235 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:00.300235 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:00.300235 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:00.300235 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:00.306824 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 330/655] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:00.306824 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c481ce-9bf2-416e-8a79-7f0ffd022246 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:00.323369 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59139b25-4110-43e9-83c8-4da93a5f0812 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:00.360024 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:00.361988 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43681b5e-266b-463e-9911-fb5806867f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:00.362918 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43681b5e-266b-463e-9911-fb5806867f60 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:00.363164 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43681b5e-266b-463e-9911-fb5806867f60 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:00.363539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43681b5e-266b-463e-9911-fb5806867f60 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:00.364478 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43681b5e-266b-463e-9911-fb5806867f60 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:00.364917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43681b5e-266b-463e-9911-fb5806867f60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:00.366441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43681b5e-266b-463e-9911-fb5806867f60 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:00.391203 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 326/656] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Jun 23 10:40:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:00.392309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43681b5e-266b-463e-9911-fb5806867f60 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:00.433046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c481ce-9bf2-416e-8a79-7f0ffd022246 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:00.449959 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:00.481581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee215485-4a6d-494c-9d25-563a2b2736a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:00.483542 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee215485-4a6d-494c-9d25-563a2b2736a9 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:00.483989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee215485-4a6d-494c-9d25-563a2b2736a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:00.484419 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee215485-4a6d-494c-9d25-563a2b2736a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:00.499791 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee215485-4a6d-494c-9d25-563a2b2736a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:00.501746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee215485-4a6d-494c-9d25-563a2b2736a9 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:00.519774 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43681b5e-266b-463e-9911-fb5806867f60 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:00.526733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-ee215485-4a6d-494c-9d25-563a2b2736a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:00.526733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:00.526733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:00.526733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:00.526733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:00.526733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:00.526733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:00.526733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:00.526733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:00.526733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:00.526733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:00.526733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:00.526733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:00.526733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:00.526733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:00.527795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:00.527795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:00.527795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:00.527795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:00.527795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:00.527795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:00.527795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:00.527795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:00.527795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:00.527795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:00.527795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:00.527795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:00.527795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:00.527795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:00.527795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:00.527795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:00.527795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:00.528921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:00.528921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:00.528921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:00.528921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:00.532479 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 331/657] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:00.533628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee215485-4a6d-494c-9d25-563a2b2736a9 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:00.569806 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db1f74-181b-4480-ba5d-aa5c25d2bf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:00.570471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db1f74-181b-4480-ba5d-aa5c25d2bf5a None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:00.570753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db1f74-181b-4480-ba5d-aa5c25d2bf5a None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:00.571025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db1f74-181b-4480-ba5d-aa5c25d2bf5a None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:00.571737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db1f74-181b-4480-ba5d-aa5c25d2bf5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:00.572043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db1f74-181b-4480-ba5d-aa5c25d2bf5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:00.573527 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db1f74-181b-4480-ba5d-aa5c25d2bf5a None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:00.591143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 327/658] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:00.591143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db1f74-181b-4480-ba5d-aa5c25d2bf5a None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:00.666692 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:00.675992 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee215485-4a6d-494c-9d25-563a2b2736a9 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:00.712120 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:00.713321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af67d1-b371-45af-83db-9167afd03295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:00.713822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af67d1-b371-45af-83db-9167afd03295 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:00.714203 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af67d1-b371-45af-83db-9167afd03295 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:00.714578 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af67d1-b371-45af-83db-9167afd03295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:00.724306 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db1f74-181b-4480-ba5d-aa5c25d2bf5a None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:00.772526 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6d16a-6aa5-450a-9b9e-cece63908601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:00.773693 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6d16a-6aa5-450a-9b9e-cece63908601 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:00.774531 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6d16a-6aa5-450a-9b9e-cece63908601 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:00.775215 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6d16a-6aa5-450a-9b9e-cece63908601 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:00.776092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6d16a-6aa5-450a-9b9e-cece63908601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:00.776819 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6d16a-6aa5-450a-9b9e-cece63908601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:00.779096 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6d16a-6aa5-450a-9b9e-cece63908601 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:00.788982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af67d1-b371-45af-83db-9167afd03295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:00.791458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af67d1-b371-45af-83db-9167afd03295 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:00.793551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 328/659] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:00.795293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6d16a-6aa5-450a-9b9e-cece63908601 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:00.908164 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6d16a-6aa5-450a-9b9e-cece63908601 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:00.920817 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:00.934147 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 332/660] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:40:00.935937 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af67d1-b371-45af-83db-9167afd03295 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:00.949879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17454d-c356-44b0-b0b4-c4dd92278801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:00.951591 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17454d-c356-44b0-b0b4-c4dd92278801 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:00.951971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17454d-c356-44b0-b0b4-c4dd92278801 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:00.952344 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17454d-c356-44b0-b0b4-c4dd92278801 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:00.964169 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17454d-c356-44b0-b0b4-c4dd92278801 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:00.965980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17454d-c356-44b0-b0b4-c4dd92278801 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:00.986244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-2f17454d-c356-44b0-b0b4-c4dd92278801 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:40:00.986244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:00.986244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:00.986244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:00.986244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:00.986244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:00.986244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:00.986244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:00.986244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:00.986244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:00.986244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:00.986244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:00.986244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:00.986244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:00.986244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:00.986244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:00.987509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:00.987509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:00.987509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:00.987509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:00.987509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:00.987509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:00.987509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:00.987509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:00.987509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:00.987509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:00.987509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:00.987509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:00.987509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:00.987509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:00.987509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:00.987509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:00.987509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:00.987509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:00.988800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:00.988800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:00.988800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:00.988800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:00.988800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:00.988800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:00.988800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:00.988800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:00.988800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:40:00.988800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:00.988800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 329/661] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:40:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:00.988800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17454d-c356-44b0-b0b4-c4dd92278801 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:01.009044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:01.065555 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af67d1-b371-45af-83db-9167afd03295 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:01.101943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e84bf-29f4-462e-814e-b0b67673e35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:01.102759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e84bf-29f4-462e-814e-b0b67673e35b None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:01.103045 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e84bf-29f4-462e-814e-b0b67673e35b None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:01.103326 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e84bf-29f4-462e-814e-b0b67673e35b None admin] PATH_INFO: `/v3/projects/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:01.111456 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e84bf-29f4-462e-814e-b0b67673e35b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:01.113039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e84bf-29f4-462e-814e-b0b67673e35b None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:01.118054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17454d-c356-44b0-b0b4-c4dd92278801 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:01.128434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-879e84bf-29f4-462e-814e-b0b67673e35b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:01.128434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:01.128434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:01.128434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:01.128434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:01.128434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:01.128434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:01.128434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:01.128434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:01.128434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:01.128434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:01.128434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:01.128434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:01.128434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:01.128434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:01.129752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:01.129752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:01.129752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:01.129752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:01.129752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:01.129752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:01.129752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:01.129752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:01.129752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:01.129752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:01.129752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:01.129752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:01.129752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:01.129752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:01.129752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:01.129752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:01.129752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:01.130625 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:01.130625 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:01.130625 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:01.130625 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:01.130625 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:01.130625 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:01.130625 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:01.130625 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:01.135991 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 333/662] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:01.135991 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e84bf-29f4-462e-814e-b0b67673e35b None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:01.159370 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316eb0d-6e55-4eac-a383-c8f1fd8c733e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:01.160614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316eb0d-6e55-4eac-a383-c8f1fd8c733e None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:01.161210 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316eb0d-6e55-4eac-a383-c8f1fd8c733e None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:01.161494 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316eb0d-6e55-4eac-a383-c8f1fd8c733e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:01.175295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316eb0d-6e55-4eac-a383-c8f1fd8c733e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:01.176967 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316eb0d-6e55-4eac-a383-c8f1fd8c733e None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:01.200713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-f316eb0d-6e55-4eac-a383-c8f1fd8c733e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:01.200713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:01.200713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:01.200713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:01.200713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:01.200713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:01.200713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:01.200713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:01.200713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:01.200713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:01.200713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:01.200713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:01.200713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:01.200713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:01.200713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:01.203362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:01.203362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:01.203362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:01.203362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:01.203362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:01.203362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:01.203362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:01.203362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:01.203362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:01.203362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:01.203362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:01.203362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:01.203362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:01.203362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:01.203362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:01.203362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:01.203362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:01.205227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:01.205227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:01.205227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:01.205227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:01.205227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 330/663] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:01.205227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316eb0d-6e55-4eac-a383-c8f1fd8c733e None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:01.259675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e84bf-29f4-462e-814e-b0b67673e35b None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:01.300752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:01.303216 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:01.307936 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977157e9-563e-44e4-ac95-43e3764d39a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:01.309283 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977157e9-563e-44e4-ac95-43e3764d39a6 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:01.309719 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977157e9-563e-44e4-ac95-43e3764d39a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:01.314440 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977157e9-563e-44e4-ac95-43e3764d39a6 None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:01.314440 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977157e9-563e-44e4-ac95-43e3764d39a6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:01.314440 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977157e9-563e-44e4-ac95-43e3764d39a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:01.314740 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316eb0d-6e55-4eac-a383-c8f1fd8c733e None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:01.314837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977157e9-563e-44e4-ac95-43e3764d39a6 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:01.334893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 334/664] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jun 23 10:40:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:01.335659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977157e9-563e-44e4-ac95-43e3764d39a6 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:01.349955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cde4d-80a8-4de2-8714-c05b35286d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:01.350770 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cde4d-80a8-4de2-8714-c05b35286d2d None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:01.351172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cde4d-80a8-4de2-8714-c05b35286d2d None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:01.351536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cde4d-80a8-4de2-8714-c05b35286d2d None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:01.352457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cde4d-80a8-4de2-8714-c05b35286d2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:01.352885 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cde4d-80a8-4de2-8714-c05b35286d2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:01.354602 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cde4d-80a8-4de2-8714-c05b35286d2d None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:01.373774 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 331/665] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:01.374900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cde4d-80a8-4de2-8714-c05b35286d2d None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:01.444929 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977157e9-563e-44e4-ac95-43e3764d39a6 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:01.457658 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:01.482648 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35913e-99e3-484a-98f0-416c888b44bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:01.483081 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cde4d-80a8-4de2-8714-c05b35286d2d None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:01.483384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35913e-99e3-484a-98f0-416c888b44bd None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:01.483652 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35913e-99e3-484a-98f0-416c888b44bd None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:01.483935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35913e-99e3-484a-98f0-416c888b44bd None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:01.485258 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35913e-99e3-484a-98f0-416c888b44bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:01.485584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35913e-99e3-484a-98f0-416c888b44bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:01.486974 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35913e-99e3-484a-98f0-416c888b44bd None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:01.500763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 335/666] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:01.501742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35913e-99e3-484a-98f0-416c888b44bd None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:01.514330 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:01.526563 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b5a9b-7ae2-4015-9e82-77d983c06e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:01.528290 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b5a9b-7ae2-4015-9e82-77d983c06e08 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:01.528290 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b5a9b-7ae2-4015-9e82-77d983c06e08 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:01.528290 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b5a9b-7ae2-4015-9e82-77d983c06e08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:01.605765 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b5a9b-7ae2-4015-9e82-77d983c06e08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:01.607350 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b5a9b-7ae2-4015-9e82-77d983c06e08 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:01.623652 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35913e-99e3-484a-98f0-416c888b44bd None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:01.670788 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336df0c0-eb97-4ffe-a520-9f754ef62ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:01.671877 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336df0c0-eb97-4ffe-a520-9f754ef62ccc None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:01.672317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336df0c0-eb97-4ffe-a520-9f754ef62ccc None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:01.672607 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336df0c0-eb97-4ffe-a520-9f754ef62ccc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:01.673479 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336df0c0-eb97-4ffe-a520-9f754ef62ccc None admin] RBAC: Adding query filter params (role.id=3522dd96085d47688d7a42ed133484a9, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=06498e12426947908d5217e2c948519d) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:01.673899 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336df0c0-eb97-4ffe-a520-9f754ef62ccc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:01.675475 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336df0c0-eb97-4ffe-a520-9f754ef62ccc None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:01.682822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 336/667] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:01 2022] GET /identity/v3/role_assignments?user.id=06498e12426947908d5217e2c948519d&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=3522dd96085d47688d7a42ed133484a9 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:01.683818 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e971b86-bb38-4383-a6b8-85e2914fed96 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:01.684110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e971b86-bb38-4383-a6b8-85e2914fed96 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:01.684392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e971b86-bb38-4383-a6b8-85e2914fed96 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:01.690867 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 337/668] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:01.691846 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e971b86-bb38-4383-a6b8-85e2914fed96 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:01.730671 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 332/669] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:40:01.732582 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eeb9b-a651-4216-82eb-020bbe781968 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:01.733175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eeb9b-a651-4216-82eb-020bbe781968 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:01.733734 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eeb9b-a651-4216-82eb-020bbe781968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:01.738618 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:01.758753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-6d6eeb9b-a651-4216-82eb-020bbe781968 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:01.760658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-6d6eeb9b-a651-4216-82eb-020bbe781968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:01.788286 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:01.825027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e971b86-bb38-4383-a6b8-85e2914fed96 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:01.868811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 333/670] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:40:01.869681 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6eeb9b-a651-4216-82eb-020bbe781968 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:01.872901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98554cf9-d60b-43b6-9c67-1aac76b67802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:01.875513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98554cf9-d60b-43b6-9c67-1aac76b67802 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:01.875810 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98554cf9-d60b-43b6-9c67-1aac76b67802 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:01.876096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98554cf9-d60b-43b6-9c67-1aac76b67802 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:01.885204 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98554cf9-d60b-43b6-9c67-1aac76b67802 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:01.886952 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98554cf9-d60b-43b6-9c67-1aac76b67802 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:01.902374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-98554cf9-d60b-43b6-9c67-1aac76b67802 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:01.902374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:01.902374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:01.902374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:01.902374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:01.902374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:01.902374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:01.902374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:01.902374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:01.902374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:01.902374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:01.902374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:01.902374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:01.902374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:01.902374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:01.903317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:01.903317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:01.903317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:01.903317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:01.903317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:01.903317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:01.903317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:01.903317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:01.903317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:01.903317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:01.903317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:01.903317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:01.903317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:01.903317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:01.903317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:01.903317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:01.903317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:01.904300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:01.904300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:01.904300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:01.904300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:01.904300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:01.904300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:01.904300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:01.904300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:01.904300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 338/671] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:01.905716 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98554cf9-d60b-43b6-9c67-1aac76b67802 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:02.014808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6eeb9b-a651-4216-82eb-020bbe781968 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:02.029104 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98554cf9-d60b-43b6-9c67-1aac76b67802 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:02.036975 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:02.059167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53981539-48f4-448e-8cd7-7be88d26dd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:02.059974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53981539-48f4-448e-8cd7-7be88d26dd02 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:02.060935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53981539-48f4-448e-8cd7-7be88d26dd02 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:02.061231 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53981539-48f4-448e-8cd7-7be88d26dd02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:02.066067 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc589bbe-3d49-46b6-bc77-26a410999b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:02.067116 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc589bbe-3d49-46b6-bc77-26a410999b89 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:02.067623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc589bbe-3d49-46b6-bc77-26a410999b89 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:02.068726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc589bbe-3d49-46b6-bc77-26a410999b89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:02.071767 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53981539-48f4-448e-8cd7-7be88d26dd02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:02.073287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53981539-48f4-448e-8cd7-7be88d26dd02 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:02.079378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc589bbe-3d49-46b6-bc77-26a410999b89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:02.087211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-fc589bbe-3d49-46b6-bc77-26a410999b89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:40:02.087211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:02.087211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:02.087211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:02.087211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:02.087211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:02.087211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:02.087211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:02.087211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:02.087211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:02.087211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:02.087211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:02.087211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:02.087211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:02.087211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:02.087211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:02.089476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:02.089476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:02.089476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:02.089476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:02.089476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:02.089476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:02.089476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:02.089476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:02.089476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:02.089476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:02.089476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:02.089476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:02.089476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:02.089476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:02.089476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:02.089476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:02.091554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:02.091554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:02.091554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:02.091554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:02.091554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:02.091554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:02.091554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:02.091554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:02.091554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:02.091554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:02.091554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:40:02.091554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:02.093434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-53981539-48f4-448e-8cd7-7be88d26dd02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:02.093434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:02.093434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:02.093434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:02.093434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:02.093434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:02.093434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:02.093434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:02.093434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:02.093434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:02.093434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:02.093434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:02.093434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:02.093434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:02.093434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:02.095452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:02.095452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:02.095452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:02.095452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:02.095452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:02.095452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:02.095452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:02.095452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:02.095452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:02.095452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:02.095452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:02.095452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:02.095452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:02.095452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:02.095452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:02.095452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:02.095452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:02.097933 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:02.097933 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:02.097933 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:02.097933 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:02.098457 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 339/672] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:40:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:02.098457 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc589bbe-3d49-46b6-bc77-26a410999b89 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:02.099597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 334/673] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:02.099597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150c9ed-9e16-44ba-9a89-f4eddc9a3573 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:02.099597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150c9ed-9e16-44ba-9a89-f4eddc9a3573 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:02.099597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150c9ed-9e16-44ba-9a89-f4eddc9a3573 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:02.104672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 335/674] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:02.104672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150c9ed-9e16-44ba-9a89-f4eddc9a3573 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:02.114468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:02.203431 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc589bbe-3d49-46b6-bc77-26a410999b89 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:02.212766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150c9ed-9e16-44ba-9a89-f4eddc9a3573 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:02.239312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6abf5-38b1-4c70-b76a-4b0e383e8dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:02.240036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6abf5-38b1-4c70-b76a-4b0e383e8dd8 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:02.240325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6abf5-38b1-4c70-b76a-4b0e383e8dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:02.240600 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6abf5-38b1-4c70-b76a-4b0e383e8dd8 None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:02.241440 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6abf5-38b1-4c70-b76a-4b0e383e8dd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:02.241746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6abf5-38b1-4c70-b76a-4b0e383e8dd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:02.243167 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6abf5-38b1-4c70-b76a-4b0e383e8dd8 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:02.252024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92728934-bf48-4ae0-a40a-83a7ea88e18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:02.253044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92728934-bf48-4ae0-a40a-83a7ea88e18e None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:02.253545 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92728934-bf48-4ae0-a40a-83a7ea88e18e None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:02.253999 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92728934-bf48-4ae0-a40a-83a7ea88e18e None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:02.255193 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92728934-bf48-4ae0-a40a-83a7ea88e18e None admin] RBAC: Adding query filter params (name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:02.255700 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92728934-bf48-4ae0-a40a-83a7ea88e18e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:02.256108 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 340/675] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:02.256931 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6abf5-38b1-4c70-b76a-4b0e383e8dd8 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:02.257723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92728934-bf48-4ae0-a40a-83a7ea88e18e None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:02.268313 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 336/676] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:40:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:02.269612 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30372d-3140-441b-93d3-1e0297fdd517 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:02.269908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30372d-3140-441b-93d3-1e0297fdd517 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:02.270192 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30372d-3140-441b-93d3-1e0297fdd517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:02.281774 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:02.292354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-8e30372d-3140-441b-93d3-1e0297fdd517 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:02.292354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8e30372d-3140-441b-93d3-1e0297fdd517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:02.360003 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:02.365508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 337/677] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:40:02.366324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30372d-3140-441b-93d3-1e0297fdd517 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:02.384862 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6abf5-38b1-4c70-b76a-4b0e383e8dd8 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:02.425763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828571d-9f0f-4494-949d-a806affabf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:02.426589 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828571d-9f0f-4494-949d-a806affabf52 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:02.427202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828571d-9f0f-4494-949d-a806affabf52 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:02.427495 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828571d-9f0f-4494-949d-a806affabf52 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:02.428398 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828571d-9f0f-4494-949d-a806affabf52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:02.428738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828571d-9f0f-4494-949d-a806affabf52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:02.430122 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828571d-9f0f-4494-949d-a806affabf52 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:02.441706 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 341/678] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:02.442519 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828571d-9f0f-4494-949d-a806affabf52 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:02.472757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30372d-3140-441b-93d3-1e0297fdd517 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:02.510665 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f9b9f-7f0f-4c40-9cae-b77cba68c3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:02.511328 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f9b9f-7f0f-4c40-9cae-b77cba68c3da None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:02.511617 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f9b9f-7f0f-4c40-9cae-b77cba68c3da None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:02.511899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f9b9f-7f0f-4c40-9cae-b77cba68c3da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:02.512761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f9b9f-7f0f-4c40-9cae-b77cba68c3da None admin] RBAC: Adding query filter params (role.id=3522dd96085d47688d7a42ed133484a9, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=0348261a78984c62aced60af2768688e) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:02.513076 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f9b9f-7f0f-4c40-9cae-b77cba68c3da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:02.515287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f9b9f-7f0f-4c40-9cae-b77cba68c3da None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:02.521727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 338/679] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:02 2022] GET /identity/v3/role_assignments?user.id=0348261a78984c62aced60af2768688e&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=3522dd96085d47688d7a42ed133484a9 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:02.524569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:02.529845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f9b9f-7f0f-4c40-9cae-b77cba68c3da None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:02.554478 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828571d-9f0f-4494-949d-a806affabf52 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:02.605705 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4659252-1928-4372-bd5a-934c41210459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:02.606938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4659252-1928-4372-bd5a-934c41210459 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:02.607751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4659252-1928-4372-bd5a-934c41210459 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:02.609160 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4659252-1928-4372-bd5a-934c41210459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:02.623546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:02.627355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4659252-1928-4372-bd5a-934c41210459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:02.630174 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4659252-1928-4372-bd5a-934c41210459 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:02.656249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-b4659252-1928-4372-bd5a-934c41210459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:02.656249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:02.656249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:02.656249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:02.656249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:02.656249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:02.656249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:02.656249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:02.656249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:02.656249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:02.656249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:02.656249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:02.656249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:02.656249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:02.656249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:02.657221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:02.657221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:02.657221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:02.657221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:02.657221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:02.657221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:02.657221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:02.657221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:02.657221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:02.657221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:02.657221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:02.657221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:02.657221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:02.657221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:02.657221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:02.657221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:02.657221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:02.658094 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:02.658094 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:02.658094 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:02.658094 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:02.661112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 342/680] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:02.662561 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4659252-1928-4372-bd5a-934c41210459 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:02.671899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f9b9f-7f0f-4c40-9cae-b77cba68c3da None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:02.718288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72c8cf-a6e4-41a1-ba8d-6e0d098fabca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:02.719141 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72c8cf-a6e4-41a1-ba8d-6e0d098fabca None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:02.719429 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72c8cf-a6e4-41a1-ba8d-6e0d098fabca None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:02.719855 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72c8cf-a6e4-41a1-ba8d-6e0d098fabca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:02.738916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72c8cf-a6e4-41a1-ba8d-6e0d098fabca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:02.749824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-cb72c8cf-a6e4-41a1-ba8d-6e0d098fabca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:02.749824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:02.749824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:02.749824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:02.749824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:02.749824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:02.749824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:02.749824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:02.749824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:02.749824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:02.749824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:02.749824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:02.749824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:02.749824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:02.749824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:02.749824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:02.750760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:02.750760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:02.750760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:02.750760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:02.750760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:02.750760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:02.750760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:02.750760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:02.750760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:02.750760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:02.750760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:02.750760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:02.750760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:02.750760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:02.750760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:02.750760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:02.751598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:02.751598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:02.751598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:02.751598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:02.751598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:02.751598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:02.751598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:02.751598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:02.751598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:02.751598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:02.751598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:02.751598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:02.754995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 339/681] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:40:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:02.756031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72c8cf-a6e4-41a1-ba8d-6e0d098fabca None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:02.782474 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4659252-1928-4372-bd5a-934c41210459 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:02.822039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:02.837187 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4a71c-137b-4115-a49f-27afb716143b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:02.837991 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4a71c-137b-4115-a49f-27afb716143b None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:02.838280 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4a71c-137b-4115-a49f-27afb716143b None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:02.838587 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4a71c-137b-4115-a49f-27afb716143b None admin] PATH_INFO: `/v3/projects/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:02.848183 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4a71c-137b-4115-a49f-27afb716143b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:02.851023 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4a71c-137b-4115-a49f-27afb716143b None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:02.872012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-20b4a71c-137b-4115-a49f-27afb716143b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:02.872012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:02.872012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:02.872012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:02.872012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:02.872012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:02.872012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:02.872012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:02.872012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:02.872012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:02.872012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:02.872012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:02.872012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:02.872012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:02.872012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:02.874071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:02.874071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:02.874071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:02.874071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:02.874071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:02.874071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:02.874071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:02.874071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:02.874071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:02.874071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:02.874071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:02.874071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:02.874071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:02.874071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:02.874071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:02.874071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:02.874071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:02.874955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:02.874955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:02.874955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:02.874955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:02.874955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:02.874955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:02.874955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:02.874955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:02.874955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 343/682] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:02.875440 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4a71c-137b-4115-a49f-27afb716143b None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:02.887431 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72c8cf-a6e4-41a1-ba8d-6e0d098fabca None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:02.918831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:02.937304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e10b5-bc39-46ac-8266-e7b80ae4a0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:02.939072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e10b5-bc39-46ac-8266-e7b80ae4a0b0 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:02.939512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e10b5-bc39-46ac-8266-e7b80ae4a0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:02.939967 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e10b5-bc39-46ac-8266-e7b80ae4a0b0 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:02.941568 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e10b5-bc39-46ac-8266-e7b80ae4a0b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:02.942455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e10b5-bc39-46ac-8266-e7b80ae4a0b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:02.944720 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e10b5-bc39-46ac-8266-e7b80ae4a0b0 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:02.969187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 340/683] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:02.970939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e10b5-bc39-46ac-8266-e7b80ae4a0b0 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:02.990693 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4a71c-137b-4115-a49f-27afb716143b None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:03.028683 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef7110-ab93-42ee-80f9-66093a233ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:03.030679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef7110-ab93-42ee-80f9-66093a233ce7 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:03.031575 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef7110-ab93-42ee-80f9-66093a233ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:03.032345 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef7110-ab93-42ee-80f9-66093a233ce7 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:03.033361 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef7110-ab93-42ee-80f9-66093a233ce7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:03.034098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef7110-ab93-42ee-80f9-66093a233ce7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:03.036474 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef7110-ab93-42ee-80f9-66093a233ce7 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:03.052691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 344/684] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:40:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:03.052691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef7110-ab93-42ee-80f9-66093a233ce7 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:03.103330 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e10b5-bc39-46ac-8266-e7b80ae4a0b0 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:03.109928 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:03.145110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ec610-e5c4-4615-85ed-befc3528134f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:03.146680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ec610-e5c4-4615-85ed-befc3528134f None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:03.147154 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ec610-e5c4-4615-85ed-befc3528134f None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:03.148422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ec610-e5c4-4615-85ed-befc3528134f None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:03.149441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ec610-e5c4-4615-85ed-befc3528134f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:03.149911 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ec610-e5c4-4615-85ed-befc3528134f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:03.152063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ec610-e5c4-4615-85ed-befc3528134f None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:03.167831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 341/685] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:03.168873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ec610-e5c4-4615-85ed-befc3528134f None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:03.176673 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef7110-ab93-42ee-80f9-66093a233ce7 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:03.216123 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5756a-7661-4e3a-8e26-1f3829b3aa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:03.218438 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5756a-7661-4e3a-8e26-1f3829b3aa8b None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:03.218864 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5756a-7661-4e3a-8e26-1f3829b3aa8b None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:03.219280 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5756a-7661-4e3a-8e26-1f3829b3aa8b None admin] PATH_INFO: `/v3/users/swift` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:03.219734 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:03.228973 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5756a-7661-4e3a-8e26-1f3829b3aa8b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:03.230601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5756a-7661-4e3a-8e26-1f3829b3aa8b None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:03.246371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-fce5756a-7661-4e3a-8e26-1f3829b3aa8b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:40:03.246371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:03.246371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:03.246371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:03.246371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:03.246371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:03.246371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:03.246371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:03.246371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:03.246371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:03.246371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:03.246371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:03.246371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:03.246371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:03.246371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:03.246371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:03.247343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:03.247343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:03.247343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:03.247343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:03.247343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:03.247343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:03.247343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:03.247343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:03.247343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:03.247343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:03.247343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:03.247343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:03.247343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:03.247343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:03.247343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:03.247343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:03.247343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:03.247343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:03.248496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:03.248496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:03.248496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:03.248496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:03.248496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:03.248496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:03.248496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:03.248496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:03.248496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:40:03.248496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:03.250774 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 345/686] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:40:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:03.251858 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5756a-7661-4e3a-8e26-1f3829b3aa8b None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:03.287531 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ec610-e5c4-4615-85ed-befc3528134f None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:03.329896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b5b5a-55fe-49a5-8226-371765db0972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:03.331246 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b5b5a-55fe-49a5-8226-371765db0972 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:03.331874 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b5b5a-55fe-49a5-8226-371765db0972 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:03.332303 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b5b5a-55fe-49a5-8226-371765db0972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:03.349901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b5b5a-55fe-49a5-8226-371765db0972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:03.351952 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b5b5a-55fe-49a5-8226-371765db0972 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:03.373673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-a83b5b5a-55fe-49a5-8226-371765db0972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:03.373673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:03.373673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:03.373673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:03.373673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:03.373673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:03.373673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:03.373673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:03.373673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:03.373673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:03.373673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:03.373673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:03.373673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:03.373673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:03.373673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:03.374766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:03.374766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:03.374766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:03.374766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:03.374766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:03.374766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:03.374766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:03.374766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:03.374766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:03.374766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:03.374766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:03.374766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:03.374766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:03.374766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:03.374766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:03.374766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:03.374766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:03.375819 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:03.375819 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:03.375819 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:03.375819 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:03.378262 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 342/687] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:03.379513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b5b5a-55fe-49a5-8226-371765db0972 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:03.384872 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5756a-7661-4e3a-8e26-1f3829b3aa8b None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:03.398174 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:03.431300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079197a5-35f5-49a1-8b94-cddba8351052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:03.432537 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079197a5-35f5-49a1-8b94-cddba8351052 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:03.433033 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079197a5-35f5-49a1-8b94-cddba8351052 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:03.433655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079197a5-35f5-49a1-8b94-cddba8351052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:03.435082 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079197a5-35f5-49a1-8b94-cddba8351052 None admin] RBAC: Adding query filter params (role.id=3522dd96085d47688d7a42ed133484a9, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=d804e11eb85e4050adaecfbaaa6e5a12) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:03.435850 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079197a5-35f5-49a1-8b94-cddba8351052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:03.437697 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079197a5-35f5-49a1-8b94-cddba8351052 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:03.452663 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 346/688] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:03 2022] GET /identity/v3/role_assignments?user.id=d804e11eb85e4050adaecfbaaa6e5a12&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=3522dd96085d47688d7a42ed133484a9 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:03.452663 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079197a5-35f5-49a1-8b94-cddba8351052 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:03.527200 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:03.546356 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b5b5a-55fe-49a5-8226-371765db0972 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:03.609234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb278ed-c022-4106-b926-cc9e1504da80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:03.610764 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb278ed-c022-4106-b926-cc9e1504da80 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:03.610764 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb278ed-c022-4106-b926-cc9e1504da80 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:03.610929 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb278ed-c022-4106-b926-cc9e1504da80 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:03.611742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb278ed-c022-4106-b926-cc9e1504da80 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:03.612056 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb278ed-c022-4106-b926-cc9e1504da80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:03.613576 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb278ed-c022-4106-b926-cc9e1504da80 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:03.658192 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079197a5-35f5-49a1-8b94-cddba8351052 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:03.664565 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 343/689] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jun 23 10:40:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:03.672892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb278ed-c022-4106-b926-cc9e1504da80 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:03.698388 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7be8cd-a994-434a-8a1e-810c75fedd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:03.699073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7be8cd-a994-434a-8a1e-810c75fedd98 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:03.699359 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7be8cd-a994-434a-8a1e-810c75fedd98 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:03.699636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7be8cd-a994-434a-8a1e-810c75fedd98 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:03.701262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7be8cd-a994-434a-8a1e-810c75fedd98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:03.701644 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7be8cd-a994-434a-8a1e-810c75fedd98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:03.703920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7be8cd-a994-434a-8a1e-810c75fedd98 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:03.720380 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 347/690] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:03.725929 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7be8cd-a994-434a-8a1e-810c75fedd98 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:03.760581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:03.838190 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb278ed-c022-4106-b926-cc9e1504da80 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:03.856968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7be8cd-a994-434a-8a1e-810c75fedd98 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:03.894781 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85102e75-80f7-461c-8d6d-d1fb91cfed34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:03.895446 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85102e75-80f7-461c-8d6d-d1fb91cfed34 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:03.895734 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85102e75-80f7-461c-8d6d-d1fb91cfed34 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:03.896010 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85102e75-80f7-461c-8d6d-d1fb91cfed34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:03.925312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:03.945360 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475db3a-28b4-4dad-99ed-2ae230dcc050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:03.946173 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475db3a-28b4-4dad-99ed-2ae230dcc050 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:03.946460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475db3a-28b4-4dad-99ed-2ae230dcc050 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:03.946738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475db3a-28b4-4dad-99ed-2ae230dcc050 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:03.958448 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475db3a-28b4-4dad-99ed-2ae230dcc050 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:03.959902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475db3a-28b4-4dad-99ed-2ae230dcc050 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:03.975638 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85102e75-80f7-461c-8d6d-d1fb91cfed34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:03.977144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85102e75-80f7-461c-8d6d-d1fb91cfed34 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:03.978386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-0475db3a-28b4-4dad-99ed-2ae230dcc050 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:40:03.978386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:03.978386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:03.978386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:03.978386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:03.978386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:03.978386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:03.978386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:03.978386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:03.978386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:03.978386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:03.978386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:03.978386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:03.978386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:03.978386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:03.978386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:03.979334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:03.979334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:03.979334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:03.979334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:03.979334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:03.979334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:03.979334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:03.979334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:03.979334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:03.979334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:03.979334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:03.979334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:03.979334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:03.979334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:03.979334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:03.979334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:03.979334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:03.979334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:03.980250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:03.980250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:03.980250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:03.980250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:03.980250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:03.980250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:03.980250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:03.980250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:03.980250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:40:03.980250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:03.981277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 348/691] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jun 23 10:40:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:03.991880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611b8e4-ddbb-47d9-bbfe-9562b4c091b6 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:03.992685 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611b8e4-ddbb-47d9-bbfe-9562b4c091b6 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:03.993090 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611b8e4-ddbb-47d9-bbfe-9562b4c091b6 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:03.995421 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 349/692] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:03.996136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611b8e4-ddbb-47d9-bbfe-9562b4c091b6 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:04.095230 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 344/693] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:40:04.096678 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb338a7-e802-4cf0-8d81-829dc579476b None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:04.097295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb338a7-e802-4cf0-8d81-829dc579476b None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:04.097440 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb338a7-e802-4cf0-8d81-829dc579476b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:04.108503 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:04.118364 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611b8e4-ddbb-47d9-bbfe-9562b4c091b6 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:04.120304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-5bb338a7-e802-4cf0-8d81-829dc579476b None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:04.120978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-5bb338a7-e802-4cf0-8d81-829dc579476b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:04.157828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c7091-dfc5-4b69-bae0-c65c492b4ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:04.159009 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c7091-dfc5-4b69-bae0-c65c492b4ec6 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:04.159536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c7091-dfc5-4b69-bae0-c65c492b4ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:04.160023 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c7091-dfc5-4b69-bae0-c65c492b4ec6 None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:04.161107 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c7091-dfc5-4b69-bae0-c65c492b4ec6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:04.161716 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c7091-dfc5-4b69-bae0-c65c492b4ec6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:04.163395 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c7091-dfc5-4b69-bae0-c65c492b4ec6 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:04.180881 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:04.185681 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 350/694] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jun 23 10:40:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:04.186754 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c7091-dfc5-4b69-bae0-c65c492b4ec6 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:04.207143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 345/695] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:40:04.208345 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb338a7-e802-4cf0-8d81-829dc579476b None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:04.329091 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c7091-dfc5-4b69-bae0-c65c492b4ec6 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:04.335037 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb338a7-e802-4cf0-8d81-829dc579476b None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:04.365703 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f0284-3ea0-4b83-b30f-4205f6b10ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:04.366483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f0284-3ea0-4b83-b30f-4205f6b10ad9 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:04.366772 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f0284-3ea0-4b83-b30f-4205f6b10ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:04.367103 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f0284-3ea0-4b83-b30f-4205f6b10ad9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:04.375937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83330d-72da-4f1f-82d3-62ce49bd6862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:04.376930 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83330d-72da-4f1f-82d3-62ce49bd6862 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:04.377529 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83330d-72da-4f1f-82d3-62ce49bd6862 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:04.378082 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83330d-72da-4f1f-82d3-62ce49bd6862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:04.379654 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f0284-3ea0-4b83-b30f-4205f6b10ad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:04.381156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f0284-3ea0-4b83-b30f-4205f6b10ad9 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:04.404935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-c82f0284-3ea0-4b83-b30f-4205f6b10ad9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:04.404935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:04.404935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:04.404935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:04.404935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:04.404935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:04.404935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:04.404935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:04.404935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:04.404935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:04.404935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:04.404935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:04.404935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:04.404935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:04.404935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:04.405962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:04.405962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:04.405962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:04.405962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:04.405962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:04.405962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:04.405962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:04.405962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:04.405962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:04.405962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:04.405962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:04.405962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:04.405962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:04.405962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:04.405962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:04.405962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:04.405962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:04.406946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:04.406946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:04.406946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:04.406946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:04.406946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 351/696] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:04.407678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f0284-3ea0-4b83-b30f-4205f6b10ad9 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:04.410886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:04.437552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:04.459494 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83330d-72da-4f1f-82d3-62ce49bd6862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:04.461485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83330d-72da-4f1f-82d3-62ce49bd6862 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:04.539951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f0284-3ea0-4b83-b30f-4205f6b10ad9 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:04.572171 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 346/697] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:40:04.573474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83330d-72da-4f1f-82d3-62ce49bd6862 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:04.580890 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093c60d-0f78-406d-8651-9d6a97d990d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:04.581695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093c60d-0f78-406d-8651-9d6a97d990d6 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:04.581978 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093c60d-0f78-406d-8651-9d6a97d990d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:04.582253 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093c60d-0f78-406d-8651-9d6a97d990d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:04.597354 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093c60d-0f78-406d-8651-9d6a97d990d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:04.598823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093c60d-0f78-406d-8651-9d6a97d990d6 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:04.621879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-8093c60d-0f78-406d-8651-9d6a97d990d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:04.621879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:04.621879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:04.621879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:04.621879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:04.621879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:04.621879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:04.621879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:04.621879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:04.621879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:04.621879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:04.621879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:04.621879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:04.621879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:04.621879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:04.622874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:04.622874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:04.622874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:04.622874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:04.622874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:04.622874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:04.622874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:04.622874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:04.622874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:04.622874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:04.622874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:04.622874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:04.622874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:04.622874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:04.622874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:04.622874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:04.622874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:04.623892 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:04.623892 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:04.623892 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:04.623892 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:04.623892 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 352/698] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:04.624185 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093c60d-0f78-406d-8651-9d6a97d990d6 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:04.678241 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:04.687972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:04.698059 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83330d-72da-4f1f-82d3-62ce49bd6862 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:04.734860 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093c60d-0f78-406d-8651-9d6a97d990d6 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:04.737673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7a131-2213-4445-b7c9-8465198689ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:04.742148 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7a131-2213-4445-b7c9-8465198689ed None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:04.742148 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7a131-2213-4445-b7c9-8465198689ed None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:04.742148 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7a131-2213-4445-b7c9-8465198689ed None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:04.742148 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7a131-2213-4445-b7c9-8465198689ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:04.742148 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7a131-2213-4445-b7c9-8465198689ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:04.742148 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7a131-2213-4445-b7c9-8465198689ed None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:04.755450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 347/699] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:04.756545 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7a131-2213-4445-b7c9-8465198689ed None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:04.772280 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06cf06-fbc7-41ef-8fbe-2b7c3823727a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:04.773259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06cf06-fbc7-41ef-8fbe-2b7c3823727a None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:04.773548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06cf06-fbc7-41ef-8fbe-2b7c3823727a None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:04.774205 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06cf06-fbc7-41ef-8fbe-2b7c3823727a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:04.787812 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06cf06-fbc7-41ef-8fbe-2b7c3823727a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:04.790046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06cf06-fbc7-41ef-8fbe-2b7c3823727a None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:04.810778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-8a06cf06-fbc7-41ef-8fbe-2b7c3823727a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:04.810778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:04.810778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:04.810778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:04.810778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:04.810778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:04.810778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:04.810778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:04.810778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:04.810778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:04.810778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:04.810778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:04.810778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:04.810778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:04.810778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:04.811680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:04.811680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:04.811680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:04.811680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:04.811680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:04.811680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:04.811680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:04.811680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:04.811680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:04.811680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:04.811680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:04.811680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:04.811680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:04.811680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:04.811680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:04.811680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:04.811680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:04.812557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:04.812557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:04.812557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:04.812557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:04.812557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 353/700] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:04.813380 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d310de-d0ea-4448-80e0-d65a767f2cb3 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:04.813562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d310de-d0ea-4448-80e0-d65a767f2cb3 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:04.813816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d310de-d0ea-4448-80e0-d65a767f2cb3 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:04.816754 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 354/701] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:04.816754 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d310de-d0ea-4448-80e0-d65a767f2cb3 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:04.877946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7a131-2213-4445-b7c9-8465198689ed None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:04.912944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b3754-f805-43bf-9c24-80e5a0eaa35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:04.913641 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b3754-f805-43bf-9c24-80e5a0eaa35c None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:04.913928 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b3754-f805-43bf-9c24-80e5a0eaa35c None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:04.914203 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b3754-f805-43bf-9c24-80e5a0eaa35c None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:04.914927 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b3754-f805-43bf-9c24-80e5a0eaa35c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:04.915559 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b3754-f805-43bf-9c24-80e5a0eaa35c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:04.916602 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b3754-f805-43bf-9c24-80e5a0eaa35c None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:04.929033 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d310de-d0ea-4448-80e0-d65a767f2cb3 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:04.933902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 348/702] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:04.933902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b3754-f805-43bf-9c24-80e5a0eaa35c None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:04.936803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:04.937798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:04.963802 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5dc05b-ad58-474f-b2aa-b69b00f7fd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:04.964811 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5dc05b-ad58-474f-b2aa-b69b00f7fd74 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:04.965402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5dc05b-ad58-474f-b2aa-b69b00f7fd74 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:04.965826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5dc05b-ad58-474f-b2aa-b69b00f7fd74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:04.972941 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5dc05b-ad58-474f-b2aa-b69b00f7fd74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:04.974389 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5dc05b-ad58-474f-b2aa-b69b00f7fd74 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:04.988696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-1e5dc05b-ad58-474f-b2aa-b69b00f7fd74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:04.988696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:04.988696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:04.988696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:04.988696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:04.988696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:04.988696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:04.988696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:04.988696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:04.988696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:04.988696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:04.988696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:04.988696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:04.988696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:04.988696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:04.989599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:04.989599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:04.989599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:04.989599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:04.989599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:04.989599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:04.989599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:04.989599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:04.989599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:04.989599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:04.989599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:04.989599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:04.989599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:04.989599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:04.989599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:04.989599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:04.989599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:04.990496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:04.990496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:04.990496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:04.990496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:04.990496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:04.990496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:04.990496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:04.990496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:04.994609 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 355/703] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:04.995858 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99405ef-94ff-4025-aa3e-c65cd42070cf None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:04.996156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99405ef-94ff-4025-aa3e-c65cd42070cf None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:04.996441 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99405ef-94ff-4025-aa3e-c65cd42070cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:05.013581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-d99405ef-94ff-4025-aa3e-c65cd42070cf None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:05.014759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d99405ef-94ff-4025-aa3e-c65cd42070cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:05.042289 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b3754-f805-43bf-9c24-80e5a0eaa35c None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:05.079307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bb782-13ed-4e25-9548-5660019372ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:05.079962 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bb782-13ed-4e25-9548-5660019372ce None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:05.080255 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bb782-13ed-4e25-9548-5660019372ce None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:05.080522 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bb782-13ed-4e25-9548-5660019372ce None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:05.081271 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bb782-13ed-4e25-9548-5660019372ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:05.081578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bb782-13ed-4e25-9548-5660019372ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:05.082948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bb782-13ed-4e25-9548-5660019372ce None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:05.085588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 356/704] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:40:05.086401 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99405ef-94ff-4025-aa3e-c65cd42070cf None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:05.107794 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 349/705] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:05.109533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bb782-13ed-4e25-9548-5660019372ce None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:05.175830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:05.190557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:05.195802 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99405ef-94ff-4025-aa3e-c65cd42070cf None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:05.216619 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bb782-13ed-4e25-9548-5660019372ce None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:05.232265 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc66b6-441b-4daa-ae84-ab2c3ccf3521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:05.233124 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc66b6-441b-4daa-ae84-ab2c3ccf3521 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:05.233406 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc66b6-441b-4daa-ae84-ab2c3ccf3521 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:05.233719 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc66b6-441b-4daa-ae84-ab2c3ccf3521 None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:05.234446 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc66b6-441b-4daa-ae84-ab2c3ccf3521 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:05.235895 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc66b6-441b-4daa-ae84-ab2c3ccf3521 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:05.253260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697829f9-bd26-4c51-9042-cfd6e1b9f677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:05.254357 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697829f9-bd26-4c51-9042-cfd6e1b9f677 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:05.254610 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697829f9-bd26-4c51-9042-cfd6e1b9f677 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:05.254862 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697829f9-bd26-4c51-9042-cfd6e1b9f677 None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:05.255643 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697829f9-bd26-4c51-9042-cfd6e1b9f677 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:05.255959 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697829f9-bd26-4c51-9042-cfd6e1b9f677 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:05.257413 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697829f9-bd26-4c51-9042-cfd6e1b9f677 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:05.270023 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 350/706] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:05.270841 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697829f9-bd26-4c51-9042-cfd6e1b9f677 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:05.312535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 357/707] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 23 10:40:05 2022] POST /identity/v3/users => generated 254 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:40:05.313487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc66b6-441b-4daa-ae84-ab2c3ccf3521 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:05.394339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697829f9-bd26-4c51-9042-cfd6e1b9f677 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:05.423666 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:05.438162 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281736e-4b0d-47be-a351-614f9662c19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:05.438961 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281736e-4b0d-47be-a351-614f9662c19d None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:05.439253 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281736e-4b0d-47be-a351-614f9662c19d None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:05.439536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281736e-4b0d-47be-a351-614f9662c19d None admin] PATH_INFO: `/v3/services/network` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:05.440386 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281736e-4b0d-47be-a351-614f9662c19d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:05.441924 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281736e-4b0d-47be-a351-614f9662c19d None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:05.459063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc66b6-441b-4daa-ae84-ab2c3ccf3521 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:05.461697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-c281736e-4b0d-47be-a351-614f9662c19d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:40:05.461697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:05.461697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:05.461697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:05.461697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:05.461697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:05.461697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:05.461697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:05.461697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:40:05.461697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:05.461697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:05.461697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:05.461697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:05.461697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:05.461697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:05.461697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:05.461697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:05.462738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:05.462738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:05.462738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:05.462738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:05.462738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:05.462738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:05.462738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:05.462738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:05.462738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:05.462738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:05.462738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:05.462738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:05.462738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:05.462738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:05.462738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:05.462738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:05.463569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:05.463569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:05.463569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:05.463569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:05.463569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:05.463569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:05.463569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:05.463569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:05.463569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:05.463569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:05.463569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:05.463569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:05.463569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:40:05.463569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:05.463569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 351/708] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:05 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:05.464345 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281736e-4b0d-47be-a351-614f9662c19d None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:05.511069 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30995eaf-5908-4fb6-9dd6-dae066208982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:05.513382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995eaf-5908-4fb6-9dd6-dae066208982 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:05.517014 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995eaf-5908-4fb6-9dd6-dae066208982 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:05.517315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995eaf-5908-4fb6-9dd6-dae066208982 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:05.524617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30995eaf-5908-4fb6-9dd6-dae066208982 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:05.526124 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30995eaf-5908-4fb6-9dd6-dae066208982 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:05.541322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-30995eaf-5908-4fb6-9dd6-dae066208982 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:05.541322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:05.541322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:05.541322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:05.541322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:05.541322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:05.541322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:05.541322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:05.541322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:05.541322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:05.541322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:05.541322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:05.541322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:05.541322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:05.541322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:05.542266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:05.542266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:05.542266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:05.542266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:05.542266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:05.542266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:05.542266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:05.542266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:05.542266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:05.542266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:05.542266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:05.542266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:05.542266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:05.542266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:05.542266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:05.542266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:05.542266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:05.543138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:05.543138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:05.543138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:05.543138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:05.543138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:05.543138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:05.543138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:05.543138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:05.543138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 358/709] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:05.543617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30995eaf-5908-4fb6-9dd6-dae066208982 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:05.562647 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:05.600465 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281736e-4b0d-47be-a351-614f9662c19d None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:05.640306 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a8071-1cbf-4cb7-9ccb-b7da5b5b97da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:05.641030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a8071-1cbf-4cb7-9ccb-b7da5b5b97da None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:05.641325 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a8071-1cbf-4cb7-9ccb-b7da5b5b97da None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:05.641622 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a8071-1cbf-4cb7-9ccb-b7da5b5b97da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:05.642472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a8071-1cbf-4cb7-9ccb-b7da5b5b97da None admin] RBAC: Adding query filter params (role.id=3522dd96085d47688d7a42ed133484a9, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=4a54fa1c326f41e88688404a56b75c30) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:05.642799 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a8071-1cbf-4cb7-9ccb-b7da5b5b97da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:05.644430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a8071-1cbf-4cb7-9ccb-b7da5b5b97da None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:05.651068 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 352/710] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:05 2022] GET /identity/v3/role_assignments?user.id=4a54fa1c326f41e88688404a56b75c30&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=3522dd96085d47688d7a42ed133484a9 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:05.651897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a8071-1cbf-4cb7-9ccb-b7da5b5b97da None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:05.685267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30995eaf-5908-4fb6-9dd6-dae066208982 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:05.713227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:05.756972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e80580-5b04-46d5-b736-305e6b7e3c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:05.759169 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e80580-5b04-46d5-b736-305e6b7e3c43 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:05.759703 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e80580-5b04-46d5-b736-305e6b7e3c43 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:05.760289 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e80580-5b04-46d5-b736-305e6b7e3c43 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:05.761371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e80580-5b04-46d5-b736-305e6b7e3c43 None admin] RBAC: Adding query filter params (name=network) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:05.761924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e80580-5b04-46d5-b736-305e6b7e3c43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:05.771258 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e80580-5b04-46d5-b736-305e6b7e3c43 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:05.771470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a8071-1cbf-4cb7-9ccb-b7da5b5b97da None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:05.779322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 359/711] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 23 10:40:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:05.784760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e80580-5b04-46d5-b736-305e6b7e3c43 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:05.803040 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88342b9e-f769-4ec1-94ad-788f541853da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:05.804867 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88342b9e-f769-4ec1-94ad-788f541853da None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:05.804867 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88342b9e-f769-4ec1-94ad-788f541853da None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:05.804867 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88342b9e-f769-4ec1-94ad-788f541853da None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:05.805206 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88342b9e-f769-4ec1-94ad-788f541853da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:05.805479 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88342b9e-f769-4ec1-94ad-788f541853da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:05.807957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88342b9e-f769-4ec1-94ad-788f541853da None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:05.820597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 353/712] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:05.822023 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59400f0-4e76-4fcb-9a2c-ebda6e0ec04c None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:05.822322 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59400f0-4e76-4fcb-9a2c-ebda6e0ec04c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:05.822607 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59400f0-4e76-4fcb-9a2c-ebda6e0ec04c None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:05.829572 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 354/713] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:05.830527 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59400f0-4e76-4fcb-9a2c-ebda6e0ec04c None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:05.905231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:05.935797 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e80580-5b04-46d5-b736-305e6b7e3c43 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:05.957942 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59400f0-4e76-4fcb-9a2c-ebda6e0ec04c None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:05.970032 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:05.982609 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043f661-a800-4fc5-a0a7-765373913f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:05.983537 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f661-a800-4fc5-a0a7-765373913f80 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:05.983642 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f661-a800-4fc5-a0a7-765373913f80 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:05.983936 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f661-a800-4fc5-a0a7-765373913f80 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:05.985631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043f661-a800-4fc5-a0a7-765373913f80 None admin] RBAC: Adding query filter params (type=network) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:05.985949 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043f661-a800-4fc5-a0a7-765373913f80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:05.987329 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043f661-a800-4fc5-a0a7-765373913f80 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:05.994515 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 360/714] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 23 10:40:05 2022] GET /identity/v3/services?type=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:05.995917 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6544d9-b508-4f99-9d81-dc229adef0a1 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:05.996211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6544d9-b508-4f99-9d81-dc229adef0a1 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:05.996489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6544d9-b508-4f99-9d81-dc229adef0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:06.004541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de2836-793b-45a3-acfd-71e0c917d02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:06.005283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de2836-793b-45a3-acfd-71e0c917d02f None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:06.006268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de2836-793b-45a3-acfd-71e0c917d02f None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:06.006549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de2836-793b-45a3-acfd-71e0c917d02f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:06.007414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de2836-793b-45a3-acfd-71e0c917d02f None admin] RBAC: Adding query filter params (role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=39840f048d254831bdb963b38520f706) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:06.007731 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de2836-793b-45a3-acfd-71e0c917d02f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:06.009406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de2836-793b-45a3-acfd-71e0c917d02f None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:06.016686 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 355/715] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:05 2022] GET /identity/v3/role_assignments?user.id=39840f048d254831bdb963b38520f706&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:06.018037 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-2d6544d9-b508-4f99-9d81-dc229adef0a1 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:06.019280 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-2d6544d9-b508-4f99-9d81-dc229adef0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:06.103382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 361/716] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:40:06.127315 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de2836-793b-45a3-acfd-71e0c917d02f None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:06.272039 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de2836-793b-45a3-acfd-71e0c917d02f None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:06.314692 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b976995-8780-4937-800e-bf587b5caf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:06.315512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b976995-8780-4937-800e-bf587b5caf6b None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:06.315791 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b976995-8780-4937-800e-bf587b5caf6b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:06.316061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b976995-8780-4937-800e-bf587b5caf6b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:06.316741 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b976995-8780-4937-800e-bf587b5caf6b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:06.318124 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b976995-8780-4937-800e-bf587b5caf6b None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:06.331969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-4b976995-8780-4937-800e-bf587b5caf6b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:40:06.331969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:06.331969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:06.331969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:06.331969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:06.331969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:06.331969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:06.331969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:06.331969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:40:06.331969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:06.331969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:06.331969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:06.331969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:06.331969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:06.331969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:06.331969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:06.332955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:06.332955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:06.332955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:06.332955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:06.332955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:06.332955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:06.332955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:06.332955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:06.332955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:06.332955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:06.332955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:06.332955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:06.332955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:06.332955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:06.332955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:06.332955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:06.333780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:06.333780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:06.333780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:06.333780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:06.333780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:06.333780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:06.333780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:06.333780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:06.333780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:06.333780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:06.333780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:06.333780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:06.333780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:06.333780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:40:06.333780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:06.333780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 356/717] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Jun 23 10:40:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:06.342524 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6544d9-b508-4f99-9d81-dc229adef0a1 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:06.430048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:06.462257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6544d9-b508-4f99-9d81-dc229adef0a1 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:06.508181 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eddcc3-1518-432c-b70f-5f38ba812001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:06.508883 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eddcc3-1518-432c-b70f-5f38ba812001 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:06.509175 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eddcc3-1518-432c-b70f-5f38ba812001 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:06.509457 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eddcc3-1518-432c-b70f-5f38ba812001 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:06.510179 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eddcc3-1518-432c-b70f-5f38ba812001 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:06.510667 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eddcc3-1518-432c-b70f-5f38ba812001 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:06.512068 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eddcc3-1518-432c-b70f-5f38ba812001 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:06.518179 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 362/718] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jun 23 10:40:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:06.523727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b976995-8780-4937-800e-bf587b5caf6b None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:06.586690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:06.666165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b976995-8780-4937-800e-bf587b5caf6b None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:06.701910 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1df827-bb42-4f80-8dc6-35ffe88a128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:06.702583 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1df827-bb42-4f80-8dc6-35ffe88a128a None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:06.702866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1df827-bb42-4f80-8dc6-35ffe88a128a None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:06.703142 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1df827-bb42-4f80-8dc6-35ffe88a128a None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:06.703852 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1df827-bb42-4f80-8dc6-35ffe88a128a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:06.704158 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1df827-bb42-4f80-8dc6-35ffe88a128a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:06.705559 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1df827-bb42-4f80-8dc6-35ffe88a128a None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:06.711850 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 357/719] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jun 23 10:40:06 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:07.815824 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8b0d5-e575-488d-acf3-549e4d385801 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:07.816330 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8b0d5-e575-488d-acf3-549e4d385801 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:07.816439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8b0d5-e575-488d-acf3-549e4d385801 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:07.818069 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 363/720] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:07.823200 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9524cda-e9b6-46aa-9e9a-3a3fca1e38f8 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:07.823605 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9524cda-e9b6-46aa-9e9a-3a3fca1e38f8 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:07.823771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9524cda-e9b6-46aa-9e9a-3a3fca1e38f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:07.846496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-a9524cda-e9b6-46aa-9e9a-3a3fca1e38f8 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:07.847696 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a9524cda-e9b6-46aa-9e9a-3a3fca1e38f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:07.915946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 358/721] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:40:07.951771 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8b0d5-e575-488d-acf3-549e4d385801 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:08.073910 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8b0d5-e575-488d-acf3-549e4d385801 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:08.124010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22595c-ffdc-47d6-bbd7-921138172069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:08.124845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22595c-ffdc-47d6-bbd7-921138172069 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:08.125133 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22595c-ffdc-47d6-bbd7-921138172069 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:08.125415 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22595c-ffdc-47d6-bbd7-921138172069 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:08.127371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:08.137123 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22595c-ffdc-47d6-bbd7-921138172069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:08.163276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-ef22595c-ffdc-47d6-bbd7-921138172069 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:40:08.163276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:08.163276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:08.163276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:08.163276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:08.163276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:08.163276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:08.163276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:08.163276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:08.163276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:08.163276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:08.163276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:08.163276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:08.163276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:08.163276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:08.163276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:08.164200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:08.164200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:08.164200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:08.164200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:08.164200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:08.164200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:08.164200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:08.164200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:08.164200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:08.164200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:08.164200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:08.164200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:08.164200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:08.164200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:08.164200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:08.164200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:08.165077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:08.165077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:08.165077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:08.165077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:08.165077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:08.165077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:08.165077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:08.165077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:08.165077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:08.165077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:08.165077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:40:08.165077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:08.165077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 364/722] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:40:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:08.165761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9524cda-e9b6-46aa-9e9a-3a3fca1e38f8 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:08.203854 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:08.292463 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9524cda-e9b6-46aa-9e9a-3a3fca1e38f8 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:08.339657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47385b-60ae-44c9-a385-baa3cbc20903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:08.340370 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47385b-60ae-44c9-a385-baa3cbc20903 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:08.340674 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47385b-60ae-44c9-a385-baa3cbc20903 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:08.340956 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47385b-60ae-44c9-a385-baa3cbc20903 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:08.341717 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47385b-60ae-44c9-a385-baa3cbc20903 None admin] RBAC: Adding query filter params (name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:08.342024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47385b-60ae-44c9-a385-baa3cbc20903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:08.343390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47385b-60ae-44c9-a385-baa3cbc20903 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:08.351978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 359/723] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:40:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:08.357763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22595c-ffdc-47d6-bbd7-921138172069 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:08.389664 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25861fb-6bff-4797-a323-1619c0cd8104 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:08.389972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25861fb-6bff-4797-a323-1619c0cd8104 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:08.390228 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25861fb-6bff-4797-a323-1619c0cd8104 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:08.392041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 360/724] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:08.399089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9628c2-a7d5-48b8-9a2e-3dd173d3da11 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:08.400430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9628c2-a7d5-48b8-9a2e-3dd173d3da11 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:08.400999 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9628c2-a7d5-48b8-9a2e-3dd173d3da11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:08.420785 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-8c9628c2-a7d5-48b8-9a2e-3dd173d3da11 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:08.422587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8c9628c2-a7d5-48b8-9a2e-3dd173d3da11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:08.531549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 361/725] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:40:08.551684 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22595c-ffdc-47d6-bbd7-921138172069 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:08.577902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf02cd4-51b6-4d26-9488-306b781db1cf None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:08.578607 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf02cd4-51b6-4d26-9488-306b781db1cf None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:08.579089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf02cd4-51b6-4d26-9488-306b781db1cf None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:08.584617 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 362/726] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:40:08.585679 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf02cd4-51b6-4d26-9488-306b781db1cf None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:08.592608 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92415200-95c8-4365-b274-9b842f48ca4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:08.593458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92415200-95c8-4365-b274-9b842f48ca4b None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:08.593741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92415200-95c8-4365-b274-9b842f48ca4b None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:08.594014 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92415200-95c8-4365-b274-9b842f48ca4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:08.607890 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92415200-95c8-4365-b274-9b842f48ca4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:08.609445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92415200-95c8-4365-b274-9b842f48ca4b None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:08.618256 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:08.631259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-92415200-95c8-4365-b274-9b842f48ca4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:08.631259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:08.631259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:08.631259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:08.631259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:08.631259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:08.631259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:08.631259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:08.631259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:08.631259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:08.631259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:08.631259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:08.631259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:08.631259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:08.631259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:08.637001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:08.637001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:08.637001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:08.637001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:08.637001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:08.637001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:08.637001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:08.637001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:08.637001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:08.637001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:08.637001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:08.637001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:08.637001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:08.637001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:08.637001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:08.637001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:08.637001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:08.638569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:08.638569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:08.638569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:08.638569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:08.638569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 365/727] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:08.638569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd5e28-581c-4df9-a94e-47012c514bd6 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:08.638569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd5e28-581c-4df9-a94e-47012c514bd6 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:08.638569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd5e28-581c-4df9-a94e-47012c514bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:08.657269 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-1cdd5e28-581c-4df9-a94e-47012c514bd6 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:08.658685 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-1cdd5e28-581c-4df9-a94e-47012c514bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:08.704247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:08.712629 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf02cd4-51b6-4d26-9488-306b781db1cf None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:08.736900 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 366/728] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:40:08.738238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd5e28-581c-4df9-a94e-47012c514bd6 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:08.753617 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f151768-63c8-4aae-a910-e26b3ad243ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:08.754580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f151768-63c8-4aae-a910-e26b3ad243ee None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:08.754866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f151768-63c8-4aae-a910-e26b3ad243ee None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:08.755518 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f151768-63c8-4aae-a910-e26b3ad243ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:08.767589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f151768-63c8-4aae-a910-e26b3ad243ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:08.775101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-0f151768-63c8-4aae-a910-e26b3ad243ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:08.775101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:08.775101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:08.775101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:08.775101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:08.775101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:08.775101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:08.775101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:08.775101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:08.775101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:08.775101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:08.775101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:08.775101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:08.775101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:08.775101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:08.775101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:08.776031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:08.776031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:08.776031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:08.776031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:08.776031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:08.776031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:08.776031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:08.776031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:08.776031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:08.776031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:08.776031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:08.776031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:08.776031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:08.776031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:08.776031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:08.776031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:08.777187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:08.777187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:08.777187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:08.777187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:08.777187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:08.777187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:08.777187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:08.777187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:08.777187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:08.777187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:08.777187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:08.777187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:08.777187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 363/729] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:40:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:08.778878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05e4c2-2967-4c53-9530-18fb0e642b24 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:08.778878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05e4c2-2967-4c53-9530-18fb0e642b24 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:08.778878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05e4c2-2967-4c53-9530-18fb0e642b24 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:08.784003 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 364/730] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:08.784003 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05e4c2-2967-4c53-9530-18fb0e642b24 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:08.853853 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd5e28-581c-4df9-a94e-47012c514bd6 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:08.874043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:08.891120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e36064-19e1-49af-8c62-e289de5de49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:08.891666 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05e4c2-2967-4c53-9530-18fb0e642b24 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:08.891805 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e36064-19e1-49af-8c62-e289de5de49f None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:08.892069 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e36064-19e1-49af-8c62-e289de5de49f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:08.892350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e36064-19e1-49af-8c62-e289de5de49f None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:08.893147 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e36064-19e1-49af-8c62-e289de5de49f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:08.893425 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e36064-19e1-49af-8c62-e289de5de49f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:08.894787 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e36064-19e1-49af-8c62-e289de5de49f None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:08.911612 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 367/731] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:08.911612 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf91994-3409-4eed-8600-9d4bd6cbbd55 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:08.911612 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf91994-3409-4eed-8600-9d4bd6cbbd55 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:08.911612 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf91994-3409-4eed-8600-9d4bd6cbbd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:08.928027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-2cf91994-3409-4eed-8600-9d4bd6cbbd55 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:08.929253 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-2cf91994-3409-4eed-8600-9d4bd6cbbd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:08.931532 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83aae8-1825-4c6b-abef-677be891821a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:08.932331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83aae8-1825-4c6b-abef-677be891821a None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:08.932616 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83aae8-1825-4c6b-abef-677be891821a None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:08.932924 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83aae8-1825-4c6b-abef-677be891821a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:08.944946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83aae8-1825-4c6b-abef-677be891821a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:08.954904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-4e83aae8-1825-4c6b-abef-677be891821a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:08.954904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:08.954904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:08.954904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:08.954904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:08.954904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:08.954904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:08.954904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:08.954904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:08.954904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:08.954904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:08.954904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:08.954904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:08.954904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:08.954904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:08.954904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:08.955879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:08.955879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:08.955879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:08.955879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:08.955879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:08.955879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:08.955879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:08.955879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:08.955879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:08.955879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:08.955879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:08.955879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:08.955879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:08.955879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:08.955879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:08.955879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:08.956771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:08.956771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:08.956771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:08.956771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:08.956771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:08.956771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:08.956771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:08.956771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:08.956771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:08.956771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:08.956771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:08.956771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:08.956771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 365/732] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:40:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:08.957920 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83aae8-1825-4c6b-abef-677be891821a None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:08.965678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:09.005481 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 368/733] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:40:09.006676 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf91994-3409-4eed-8600-9d4bd6cbbd55 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:09.087139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83aae8-1825-4c6b-abef-677be891821a None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:09.116974 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf91994-3409-4eed-8600-9d4bd6cbbd55 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:09.126679 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd16cc-a852-4caf-a3f2-9f6e37b06781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:09.127975 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd16cc-a852-4caf-a3f2-9f6e37b06781 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:09.128728 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd16cc-a852-4caf-a3f2-9f6e37b06781 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:09.129224 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd16cc-a852-4caf-a3f2-9f6e37b06781 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:09.130449 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd16cc-a852-4caf-a3f2-9f6e37b06781 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:09.130833 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd16cc-a852-4caf-a3f2-9f6e37b06781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:09.132207 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd16cc-a852-4caf-a3f2-9f6e37b06781 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:09.146286 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 366/734] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:40:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:09.147090 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd16cc-a852-4caf-a3f2-9f6e37b06781 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:09.154505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175471e-16e9-4feb-98fc-440024efcae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:09.155320 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175471e-16e9-4feb-98fc-440024efcae9 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:09.155604 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175471e-16e9-4feb-98fc-440024efcae9 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:09.155880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175471e-16e9-4feb-98fc-440024efcae9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:09.157410 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:09.163205 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175471e-16e9-4feb-98fc-440024efcae9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:09.164672 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175471e-16e9-4feb-98fc-440024efcae9 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:09.180496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-8175471e-16e9-4feb-98fc-440024efcae9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:40:09.180496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:09.180496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:09.180496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:09.180496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:09.180496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:09.180496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:09.180496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:09.180496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:09.180496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:09.180496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:09.180496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:09.180496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:09.180496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:09.180496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:09.180496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:09.181626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:09.181626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:09.181626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:09.181626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:09.181626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:09.181626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:09.181626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:09.181626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:09.181626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:09.181626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:09.181626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:09.181626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:09.181626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:09.181626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:09.181626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:09.181626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:09.181626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:09.181626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:09.182760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:09.182760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:09.182760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:09.182760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:09.182760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:09.182760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:09.182760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:09.182760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:09.182760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:40:09.182760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:09.185271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 369/735] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 23 10:40:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:09.186173 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175471e-16e9-4feb-98fc-440024efcae9 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:09.216960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:09.253549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd16cc-a852-4caf-a3f2-9f6e37b06781 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:09.291537 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28659f9c-b673-4067-b591-24cdcfdb6e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:09.292216 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28659f9c-b673-4067-b591-24cdcfdb6e2c None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:09.292782 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28659f9c-b673-4067-b591-24cdcfdb6e2c None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:09.292782 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28659f9c-b673-4067-b591-24cdcfdb6e2c None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:09.294116 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28659f9c-b673-4067-b591-24cdcfdb6e2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:09.294551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28659f9c-b673-4067-b591-24cdcfdb6e2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:09.295796 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28659f9c-b673-4067-b591-24cdcfdb6e2c None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:09.296147 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175471e-16e9-4feb-98fc-440024efcae9 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:09.308407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 367/736] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:40:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:09.308407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28659f9c-b673-4067-b591-24cdcfdb6e2c None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:09.336549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43a154-5cdc-49db-80ec-19afc61f6624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:09.337456 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43a154-5cdc-49db-80ec-19afc61f6624 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:09.338026 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43a154-5cdc-49db-80ec-19afc61f6624 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:09.338314 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43a154-5cdc-49db-80ec-19afc61f6624 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:09.339187 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43a154-5cdc-49db-80ec-19afc61f6624 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:09.340667 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43a154-5cdc-49db-80ec-19afc61f6624 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:09.376978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:09.409155 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28659f9c-b673-4067-b591-24cdcfdb6e2c None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:09.442468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86380ded-7fc1-478f-8085-e3b260c78b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:09.443236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 370/737] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 23 10:40:09 2022] POST /identity/v3/services => generated 240 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:40:09.443348 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86380ded-7fc1-478f-8085-e3b260c78b5b None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:09.443566 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86380ded-7fc1-478f-8085-e3b260c78b5b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:09.443849 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86380ded-7fc1-478f-8085-e3b260c78b5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:09.444058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43a154-5cdc-49db-80ec-19afc61f6624 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:09.460515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86380ded-7fc1-478f-8085-e3b260c78b5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:09.462053 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86380ded-7fc1-478f-8085-e3b260c78b5b None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:09.482070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-86380ded-7fc1-478f-8085-e3b260c78b5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:09.482070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:09.482070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:09.482070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:09.482070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:09.482070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:09.482070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:09.482070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:09.482070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:09.482070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:09.482070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:09.482070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:09.482070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:09.482070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:09.482070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:09.483042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:09.483042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:09.483042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:09.483042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:09.483042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:09.483042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:09.483042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:09.483042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:09.483042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:09.483042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:09.483042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:09.483042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:09.483042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:09.483042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:09.483042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:09.483042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:09.483042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:09.483910 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:09.483910 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:09.483910 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:09.483910 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:09.483910 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 368/738] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:09.484180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86380ded-7fc1-478f-8085-e3b260c78b5b None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:09.562273 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:09.591770 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43a154-5cdc-49db-80ec-19afc61f6624 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:09.604070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86380ded-7fc1-478f-8085-e3b260c78b5b None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:09.630376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:09.635251 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46b54d-8180-4838-be57-33a08653af6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:09.635936 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46b54d-8180-4838-be57-33a08653af6c None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:09.636219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46b54d-8180-4838-be57-33a08653af6c None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:09.636492 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46b54d-8180-4838-be57-33a08653af6c None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:09.637449 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46b54d-8180-4838-be57-33a08653af6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:09.637762 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46b54d-8180-4838-be57-33a08653af6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:09.639359 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46b54d-8180-4838-be57-33a08653af6c None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:09.645261 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f09bd1-6294-4466-9cd9-ceda47909d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:09.646064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f09bd1-6294-4466-9cd9-ceda47909d5a None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:09.646354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f09bd1-6294-4466-9cd9-ceda47909d5a None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:09.646627 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f09bd1-6294-4466-9cd9-ceda47909d5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:09.657812 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f09bd1-6294-4466-9cd9-ceda47909d5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:09.659274 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f09bd1-6294-4466-9cd9-ceda47909d5a None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:09.676592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-d8f09bd1-6294-4466-9cd9-ceda47909d5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:09.676592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:09.676592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:09.676592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:09.676592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:09.676592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:09.676592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:09.676592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:09.676592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:09.676592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:09.676592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:09.676592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:09.676592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:09.676592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:09.676592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:09.677499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:09.677499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:09.677499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:09.677499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:09.677499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:09.677499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:09.677499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:09.677499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:09.677499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:09.677499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:09.677499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:09.677499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:09.677499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:09.677499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:09.677499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:09.677499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:09.677499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:09.678667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:09.678667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:09.678667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:09.678667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:09.678667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 369/739] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:09.679384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc812d5b-d19f-434d-b207-0b5a9dccc5d3 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:09.679609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc812d5b-d19f-434d-b207-0b5a9dccc5d3 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:09.679890 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc812d5b-d19f-434d-b207-0b5a9dccc5d3 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:09.681456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 370/740] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:09.681984 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc812d5b-d19f-434d-b207-0b5a9dccc5d3 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:09.695359 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 371/741] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jun 23 10:40:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:09.696200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46b54d-8180-4838-be57-33a08653af6c None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:09.793850 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc812d5b-d19f-434d-b207-0b5a9dccc5d3 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:09.806339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46b54d-8180-4838-be57-33a08653af6c None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:09.828898 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fff5d4-1fca-43e6-a91a-24cc48ed4236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:09.829576 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fff5d4-1fca-43e6-a91a-24cc48ed4236 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:09.829865 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fff5d4-1fca-43e6-a91a-24cc48ed4236 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:09.830205 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fff5d4-1fca-43e6-a91a-24cc48ed4236 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:09.830931 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fff5d4-1fca-43e6-a91a-24cc48ed4236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:09.831295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fff5d4-1fca-43e6-a91a-24cc48ed4236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:09.832707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fff5d4-1fca-43e6-a91a-24cc48ed4236 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:09.842843 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe4082-3818-4139-8ec5-9e74edeb2588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:09.843454 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe4082-3818-4139-8ec5-9e74edeb2588 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:09.843738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe4082-3818-4139-8ec5-9e74edeb2588 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:09.844023 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe4082-3818-4139-8ec5-9e74edeb2588 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:09.844788 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe4082-3818-4139-8ec5-9e74edeb2588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:09.845102 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe4082-3818-4139-8ec5-9e74edeb2588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:09.846513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe4082-3818-4139-8ec5-9e74edeb2588 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:09.851936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 371/742] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:09.853436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413ec31-7c9d-4eb5-92c0-b9117251d300 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:09.853907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413ec31-7c9d-4eb5-92c0-b9117251d300 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:09.854339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413ec31-7c9d-4eb5-92c0-b9117251d300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:09.855363 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:09.863657 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 372/743] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:09.863657 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe4082-3818-4139-8ec5-9e74edeb2588 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:09.875738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-e413ec31-7c9d-4eb5-92c0-b9117251d300 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:09.877034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e413ec31-7c9d-4eb5-92c0-b9117251d300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:09.904997 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:09.949218 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 372/744] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:09 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:40:09.950014 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413ec31-7c9d-4eb5-92c0-b9117251d300 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:09.975337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe4082-3818-4139-8ec5-9e74edeb2588 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:10.013117 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff70e99-08c5-465a-834a-667f9420d349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:10.014025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff70e99-08c5-465a-834a-667f9420d349 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:10.014312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff70e99-08c5-465a-834a-667f9420d349 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:10.014591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff70e99-08c5-465a-834a-667f9420d349 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:10.055942 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413ec31-7c9d-4eb5-92c0-b9117251d300 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:10.084885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:10.087406 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff70e99-08c5-465a-834a-667f9420d349 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:10.088902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff70e99-08c5-465a-834a-667f9420d349 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:10.092453 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e0153-75bd-4b07-93f6-556804af5ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:10.095564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e0153-75bd-4b07-93f6-556804af5ea7 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:10.095564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e0153-75bd-4b07-93f6-556804af5ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:10.095564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e0153-75bd-4b07-93f6-556804af5ea7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:10.102026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e0153-75bd-4b07-93f6-556804af5ea7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:10.103459 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e0153-75bd-4b07-93f6-556804af5ea7 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:10.117675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-5f4e0153-75bd-4b07-93f6-556804af5ea7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:40:10.117675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:10.117675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:10.117675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:10.117675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:10.117675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:10.117675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:10.117675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:10.117675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:10.117675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:10.117675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:10.117675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:10.117675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:10.117675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:10.117675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:10.117675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:10.118628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:10.118628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:10.118628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:10.118628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:10.118628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:10.118628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:10.118628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:10.118628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:10.118628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:10.118628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:10.118628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:10.118628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:10.118628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:10.118628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:10.118628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:10.118628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:10.118628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:10.118628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:10.119560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:10.119560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:10.119560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:10.119560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:10.119560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:10.119560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:10.119560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:10.119560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:10.119560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:40:10.119560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:10.119560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 373/745] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:40:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:10.120137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e0153-75bd-4b07-93f6-556804af5ea7 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:10.146811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:10.198219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 373/746] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:09 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:40:10.199299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff70e99-08c5-465a-834a-667f9420d349 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:10.230658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e0153-75bd-4b07-93f6-556804af5ea7 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:10.266115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cff22-b9da-4d8e-8962-5d34af7e319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:10.266909 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cff22-b9da-4d8e-8962-5d34af7e319f None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:10.267194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cff22-b9da-4d8e-8962-5d34af7e319f None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:10.267475 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cff22-b9da-4d8e-8962-5d34af7e319f None admin] PATH_INFO: `/v3/users/nova` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:10.275425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cff22-b9da-4d8e-8962-5d34af7e319f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:10.276899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cff22-b9da-4d8e-8962-5d34af7e319f None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:10.291908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-f18cff22-b9da-4d8e-8962-5d34af7e319f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:40:10.291908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:10.291908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:10.291908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:10.291908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:10.291908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:10.291908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:10.291908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:10.291908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:10.291908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:10.291908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:10.291908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:10.291908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:10.291908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:10.291908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:10.291908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:10.292916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:10.292916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:10.292916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:10.292916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:10.292916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:10.292916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:10.292916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:10.292916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:10.292916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:10.292916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:10.292916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:10.292916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:10.292916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:10.292916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:10.292916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:10.292916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:10.292916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:10.292916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:10.293992 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:10.293992 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:10.293992 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:10.293992 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:10.293992 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:10.293992 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:10.293992 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:10.293992 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:10.293992 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:40:10.293992 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:10.293992 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 374/747] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jun 23 10:40:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:10.293992 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cff22-b9da-4d8e-8962-5d34af7e319f None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:10.307839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:10.311606 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff70e99-08c5-465a-834a-667f9420d349 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:10.348133 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8780bca-8aed-4a56-a473-17865acf43d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:10.348746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8780bca-8aed-4a56-a473-17865acf43d5 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:10.349031 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8780bca-8aed-4a56-a473-17865acf43d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:10.349310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8780bca-8aed-4a56-a473-17865acf43d5 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:10.350029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8780bca-8aed-4a56-a473-17865acf43d5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:10.351381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8780bca-8aed-4a56-a473-17865acf43d5 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:10.381114 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:10.399064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cff22-b9da-4d8e-8962-5d34af7e319f None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:10.421113 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 374/748] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 23 10:40:10 2022] POST /identity/v3/services => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:40:10.422258 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8780bca-8aed-4a56-a473-17865acf43d5 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:10.458100 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd186f-5496-42e8-9249-a170729e763b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:10.459428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd186f-5496-42e8-9249-a170729e763b None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:10.460358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd186f-5496-42e8-9249-a170729e763b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:10.461187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd186f-5496-42e8-9249-a170729e763b None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:10.462298 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd186f-5496-42e8-9249-a170729e763b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:10.462793 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd186f-5496-42e8-9249-a170729e763b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:10.466034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd186f-5496-42e8-9249-a170729e763b None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:10.491972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 375/749] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jun 23 10:40:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:10.493277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd186f-5496-42e8-9249-a170729e763b None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:10.550808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8780bca-8aed-4a56-a473-17865acf43d5 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:10.594128 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501776f-c74d-4248-a533-f7d50a667c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:10.596000 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501776f-c74d-4248-a533-f7d50a667c9d None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:10.596000 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501776f-c74d-4248-a533-f7d50a667c9d None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:10.596000 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501776f-c74d-4248-a533-f7d50a667c9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:10.607464 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501776f-c74d-4248-a533-f7d50a667c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:10.609516 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501776f-c74d-4248-a533-f7d50a667c9d None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:10.618757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd186f-5496-42e8-9249-a170729e763b None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:10.630382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-7501776f-c74d-4248-a533-f7d50a667c9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:10.630382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:10.630382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:10.630382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:10.630382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:10.630382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:10.630382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:10.630382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:10.630382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:10.630382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:10.630382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:10.630382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:10.630382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:10.630382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:10.630382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:10.632381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:10.632381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:10.632381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:10.632381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:10.632381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:10.632381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:10.632381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:10.632381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:10.632381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:10.632381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:10.632381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:10.632381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:10.632381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:10.632381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:10.632381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:10.632381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:10.632381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:10.633421 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:10.633421 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:10.633421 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:10.633421 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:10.633421 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 375/750] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:10.637473 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501776f-c74d-4248-a533-f7d50a667c9d None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:10.657332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:10.668245 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5223cea-b665-4f13-962f-42e36872a8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:10.669264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5223cea-b665-4f13-962f-42e36872a8c6 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:10.669561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5223cea-b665-4f13-962f-42e36872a8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:10.669848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5223cea-b665-4f13-962f-42e36872a8c6 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:10.670716 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5223cea-b665-4f13-962f-42e36872a8c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:10.671038 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5223cea-b665-4f13-962f-42e36872a8c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:10.672487 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5223cea-b665-4f13-962f-42e36872a8c6 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:10.681411 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:10.694792 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 376/751] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jun 23 10:40:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:10.695643 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5223cea-b665-4f13-962f-42e36872a8c6 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:10.765227 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501776f-c74d-4248-a533-f7d50a667c9d None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:10.801067 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c407c-d3a7-4be1-b5da-09c67c9f30db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:10.801721 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c407c-d3a7-4be1-b5da-09c67c9f30db None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:10.802004 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c407c-d3a7-4be1-b5da-09c67c9f30db None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:10.802280 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c407c-d3a7-4be1-b5da-09c67c9f30db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:10.825348 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5223cea-b665-4f13-962f-42e36872a8c6 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:10.862009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428434c0-2877-41a1-b76c-5220baaf2d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:10.862645 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428434c0-2877-41a1-b76c-5220baaf2d74 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:10.862931 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428434c0-2877-41a1-b76c-5220baaf2d74 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:10.863205 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428434c0-2877-41a1-b76c-5220baaf2d74 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:10.863929 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428434c0-2877-41a1-b76c-5220baaf2d74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:10.864235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428434c0-2877-41a1-b76c-5220baaf2d74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:10.865630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428434c0-2877-41a1-b76c-5220baaf2d74 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:10.877490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 377/752] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:10.878563 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428434c0-2877-41a1-b76c-5220baaf2d74 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:10.888108 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c407c-d3a7-4be1-b5da-09c67c9f30db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:10.890239 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c407c-d3a7-4be1-b5da-09c67c9f30db None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:10.946660 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:10.950691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:11.006688 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428434c0-2877-41a1-b76c-5220baaf2d74 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:11.023753 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 376/753] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:40:11.024627 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c407c-d3a7-4be1-b5da-09c67c9f30db None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:11.050183 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fbdeb-6cd4-4a76-bc0c-ad5d606e98c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:11.051158 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fbdeb-6cd4-4a76-bc0c-ad5d606e98c1 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:11.051550 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fbdeb-6cd4-4a76-bc0c-ad5d606e98c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:11.051929 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fbdeb-6cd4-4a76-bc0c-ad5d606e98c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:11.063963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5fbdeb-6cd4-4a76-bc0c-ad5d606e98c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:11.065589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5fbdeb-6cd4-4a76-bc0c-ad5d606e98c1 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:11.087914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-8f5fbdeb-6cd4-4a76-bc0c-ad5d606e98c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:11.087914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:11.087914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:11.087914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:11.087914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:11.087914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:11.087914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:11.087914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:11.087914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:11.087914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:11.087914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:11.087914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:11.087914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:11.087914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:11.087914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:11.089917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:11.089917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:11.089917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:11.089917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:11.089917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:11.089917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:11.089917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:11.089917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:11.089917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:11.089917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:11.089917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:11.089917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:11.089917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:11.089917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:11.089917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:11.089917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:11.089917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:11.091349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:11.091349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:11.091349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:11.091349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:11.093596 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 378/754] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:11.093596 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fbdeb-6cd4-4a76-bc0c-ad5d606e98c1 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:11.161152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c407c-d3a7-4be1-b5da-09c67c9f30db None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:11.180581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:11.201570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fbdeb-6cd4-4a76-bc0c-ad5d606e98c1 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:11.209380 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d5635-e8e5-494b-91cc-ceadbbdc7860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:11.209957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:11.210559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d5635-e8e5-494b-91cc-ceadbbdc7860 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:11.210914 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d5635-e8e5-494b-91cc-ceadbbdc7860 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:11.211257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d5635-e8e5-494b-91cc-ceadbbdc7860 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:11.219244 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d5635-e8e5-494b-91cc-ceadbbdc7860 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:11.220834 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d5635-e8e5-494b-91cc-ceadbbdc7860 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:11.236982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-5b1d5635-e8e5-494b-91cc-ceadbbdc7860 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:11.236982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:11.236982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:11.236982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:11.236982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:11.236982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:11.236982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:11.236982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:11.236982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:11.236982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:11.236982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:11.236982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:11.236982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:11.236982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:11.236982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:11.247216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:11.247216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:11.247216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:11.247216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:11.247216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:11.247216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:11.247216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:11.247216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:11.247216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:11.247216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:11.247216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:11.247216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:11.247216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:11.247216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:11.247216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:11.247216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:11.247216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:11.248460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:11.248460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:11.248460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:11.248460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:11.248460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:11.248460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:11.248460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:11.248460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:11.249089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554f81e-b888-46c0-93eb-09e64107bab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:11.249089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554f81e-b888-46c0-93eb-09e64107bab5 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:11.249089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554f81e-b888-46c0-93eb-09e64107bab5 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:11.249089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554f81e-b888-46c0-93eb-09e64107bab5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:11.249405 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 377/755] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:11.249405 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d5635-e8e5-494b-91cc-ceadbbdc7860 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:11.256971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554f81e-b888-46c0-93eb-09e64107bab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:11.258927 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554f81e-b888-46c0-93eb-09e64107bab5 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:11.287153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-d554f81e-b888-46c0-93eb-09e64107bab5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:11.287153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:11.287153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:11.287153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:11.287153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:11.287153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:11.287153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:11.287153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:11.287153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:11.287153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:11.287153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:11.287153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:11.287153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:11.287153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:11.287153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:11.289297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:11.289297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:11.289297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:11.289297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:11.289297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:11.289297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:11.289297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:11.289297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:11.289297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:11.289297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:11.289297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:11.289297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:11.289297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:11.289297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:11.289297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:11.289297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:11.289297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:11.291391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:11.291391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:11.291391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:11.291391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:11.291391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 379/756] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:11.292741 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554f81e-b888-46c0-93eb-09e64107bab5 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:11.364036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d5635-e8e5-494b-91cc-ceadbbdc7860 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:11.400143 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff2f42-ce97-4861-bb70-9cc2feff66f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:11.401075 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff2f42-ce97-4861-bb70-9cc2feff66f2 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:11.401546 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff2f42-ce97-4861-bb70-9cc2feff66f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:11.401997 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff2f42-ce97-4861-bb70-9cc2feff66f2 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:11.402964 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff2f42-ce97-4861-bb70-9cc2feff66f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:11.403621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff2f42-ce97-4861-bb70-9cc2feff66f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:11.405196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff2f42-ce97-4861-bb70-9cc2feff66f2 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:11.418617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 378/757] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:11.419747 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff2f42-ce97-4861-bb70-9cc2feff66f2 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:11.427518 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554f81e-b888-46c0-93eb-09e64107bab5 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:11.453474 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:11.472418 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896ef2c-a80f-4ba7-b6cb-d2433d4807a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:11.473283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896ef2c-a80f-4ba7-b6cb-d2433d4807a7 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:11.473571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896ef2c-a80f-4ba7-b6cb-d2433d4807a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:11.473854 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896ef2c-a80f-4ba7-b6cb-d2433d4807a7 None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:11.475007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896ef2c-a80f-4ba7-b6cb-d2433d4807a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:11.475375 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896ef2c-a80f-4ba7-b6cb-d2433d4807a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:11.476907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896ef2c-a80f-4ba7-b6cb-d2433d4807a7 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:11.494181 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 380/758] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:11.496763 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896ef2c-a80f-4ba7-b6cb-d2433d4807a7 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:11.523624 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:11.536234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff2f42-ce97-4861-bb70-9cc2feff66f2 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:11.578689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058dc6b-1f17-450f-a58e-854422a326e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:11.579362 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058dc6b-1f17-450f-a58e-854422a326e9 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:11.579649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058dc6b-1f17-450f-a58e-854422a326e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:11.579927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058dc6b-1f17-450f-a58e-854422a326e9 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:11.580674 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058dc6b-1f17-450f-a58e-854422a326e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:11.580989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058dc6b-1f17-450f-a58e-854422a326e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:11.582485 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058dc6b-1f17-450f-a58e-854422a326e9 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:11.601826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 379/759] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:11.602725 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058dc6b-1f17-450f-a58e-854422a326e9 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:11.606956 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896ef2c-a80f-4ba7-b6cb-d2433d4807a7 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:11.650546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcce412-de59-404d-b041-99ecb2160c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:11.651663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcce412-de59-404d-b041-99ecb2160c8b None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:11.652161 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcce412-de59-404d-b041-99ecb2160c8b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:11.653233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcce412-de59-404d-b041-99ecb2160c8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:11.660703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcce412-de59-404d-b041-99ecb2160c8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:11.662387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcce412-de59-404d-b041-99ecb2160c8b None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:11.677498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-2fcce412-de59-404d-b041-99ecb2160c8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:11.677498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:11.677498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:11.677498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:11.677498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:11.677498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:11.677498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:11.677498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:11.677498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:11.677498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:11.677498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:11.677498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:11.677498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:11.677498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:11.677498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:11.678589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:11.678589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:11.678589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:11.678589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:11.678589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:11.678589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:11.678589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:11.678589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:11.678589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:11.678589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:11.678589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:11.678589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:11.678589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:11.678589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:11.678589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:11.678589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:11.678589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:11.679707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:11.679707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:11.679707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:11.679707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:11.679707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:11.679707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:11.679707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:11.679707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:11.685342 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 381/760] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:11.686621 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb214a-999c-4492-b00e-b265e6e001be None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:11.686916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb214a-999c-4492-b00e-b265e6e001be None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:11.687200 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb214a-999c-4492-b00e-b265e6e001be None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:11.692382 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 382/761] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:11.692382 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb214a-999c-4492-b00e-b265e6e001be None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:11.711276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:11.721007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058dc6b-1f17-450f-a58e-854422a326e9 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:11.757353 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465965c-e0a7-4a3e-90e4-53d122549ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:11.758013 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465965c-e0a7-4a3e-90e4-53d122549ded None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:11.758305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465965c-e0a7-4a3e-90e4-53d122549ded None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:11.758586 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465965c-e0a7-4a3e-90e4-53d122549ded None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:11.759424 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465965c-e0a7-4a3e-90e4-53d122549ded None admin] RBAC: Adding query filter params (role.id=3522dd96085d47688d7a42ed133484a9, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=1b03d940626a449dbe904f02f3d70854) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:11.759740 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465965c-e0a7-4a3e-90e4-53d122549ded None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:11.761209 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465965c-e0a7-4a3e-90e4-53d122549ded None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:11.767726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 380/762] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:11 2022] GET /identity/v3/role_assignments?user.id=1b03d940626a449dbe904f02f3d70854&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=3522dd96085d47688d7a42ed133484a9 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:11.768512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465965c-e0a7-4a3e-90e4-53d122549ded None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:11.795434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:11.822444 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb214a-999c-4492-b00e-b265e6e001be None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:11.863526 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b1b92-68c0-4e39-a4d9-b44a3d774d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:11.864341 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b1b92-68c0-4e39-a4d9-b44a3d774d93 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:11.864631 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b1b92-68c0-4e39-a4d9-b44a3d774d93 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:11.864938 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b1b92-68c0-4e39-a4d9-b44a3d774d93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:11.873351 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b1b92-68c0-4e39-a4d9-b44a3d774d93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:11.874898 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b1b92-68c0-4e39-a4d9-b44a3d774d93 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:11.892139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-ea5b1b92-68c0-4e39-a4d9-b44a3d774d93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:11.892139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:11.892139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:11.892139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:11.892139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:11.892139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:11.892139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:11.892139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:11.892139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:11.892139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:11.892139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:11.892139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:11.892139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:11.892139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:11.892139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:11.893570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:11.893570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:11.893570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:11.893570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:11.893570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:11.893570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:11.893570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:11.893570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:11.893570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:11.893570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:11.893570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:11.893570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:11.893570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:11.893570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:11.893570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:11.893570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:11.893570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:11.894428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:11.894428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:11.894428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:11.894428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:11.894428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:11.894428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:11.894428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:11.894428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:11.898230 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 383/763] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:11.899657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23e2d2-8636-4b41-838c-a944b1a5612b None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:11.899866 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465965c-e0a7-4a3e-90e4-53d122549ded None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:11.900291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23e2d2-8636-4b41-838c-a944b1a5612b None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:11.900409 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23e2d2-8636-4b41-838c-a944b1a5612b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:11.919238 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-8b23e2d2-8636-4b41-838c-a944b1a5612b None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:11.920479 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8b23e2d2-8636-4b41-838c-a944b1a5612b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:11.940660 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720738f-c3e6-4adb-9497-ac2fe14341a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:11.941663 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720738f-c3e6-4adb-9497-ac2fe14341a8 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:11.942098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720738f-c3e6-4adb-9497-ac2fe14341a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:11.942546 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720738f-c3e6-4adb-9497-ac2fe14341a8 None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:11.943517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720738f-c3e6-4adb-9497-ac2fe14341a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:11.944082 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720738f-c3e6-4adb-9497-ac2fe14341a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:11.945906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720738f-c3e6-4adb-9497-ac2fe14341a8 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:11.964570 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 381/764] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:11.965663 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720738f-c3e6-4adb-9497-ac2fe14341a8 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:11.989705 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:12.000061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 384/765] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:12.010552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23e2d2-8636-4b41-838c-a944b1a5612b None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:12.071370 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:12.099820 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720738f-c3e6-4adb-9497-ac2fe14341a8 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:12.111956 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23e2d2-8636-4b41-838c-a944b1a5612b None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:12.134926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdeb33b-76b2-4676-972e-b92104317e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:12.135632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeb33b-76b2-4676-972e-b92104317e8c None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:12.135918 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeb33b-76b2-4676-972e-b92104317e8c None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:12.136197 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeb33b-76b2-4676-972e-b92104317e8c None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:12.137666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdeb33b-76b2-4676-972e-b92104317e8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:12.137981 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdeb33b-76b2-4676-972e-b92104317e8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:12.139419 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdeb33b-76b2-4676-972e-b92104317e8c None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:12.156911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 382/766] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:12.157828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdeb33b-76b2-4676-972e-b92104317e8c None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:12.160275 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1574e3-8ccb-477d-885e-d93bc9a9f794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:12.162437 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1574e3-8ccb-477d-885e-d93bc9a9f794 None admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:12.162815 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1574e3-8ccb-477d-885e-d93bc9a9f794 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:12.163175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1574e3-8ccb-477d-885e-d93bc9a9f794 None admin] PATH_INFO: `/v3/projects/d7a9c82a62044db884e547da9a523927/users/39840f048d254831bdb963b38520f706/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:12.165346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1574e3-8ccb-477d-885e-d93bc9a9f794 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7a9c82a62044db884e547da9a523927, user_id=39840f048d254831bdb963b38520f706, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:12.166896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1574e3-8ccb-477d-885e-d93bc9a9f794 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:12.240738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:12.248625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 385/767] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:40:12 2022] PUT /identity/v3/projects/d7a9c82a62044db884e547da9a523927/users/39840f048d254831bdb963b38520f706/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:40:12.250727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1574e3-8ccb-477d-885e-d93bc9a9f794 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:12.292404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdeb33b-76b2-4676-972e-b92104317e8c None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:12.367218 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164f5a1-71d0-4613-a37e-b21a1735c79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:12.369335 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164f5a1-71d0-4613-a37e-b21a1735c79c None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:12.371188 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164f5a1-71d0-4613-a37e-b21a1735c79c None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:12.371859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164f5a1-71d0-4613-a37e-b21a1735c79c None admin] PATH_INFO: `/v3/services/network` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:12.372982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164f5a1-71d0-4613-a37e-b21a1735c79c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:12.375968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164f5a1-71d0-4613-a37e-b21a1735c79c None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:12.401901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-2164f5a1-71d0-4613-a37e-b21a1735c79c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:40:12.401901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:12.401901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:12.401901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:12.401901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:12.401901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:12.401901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:12.401901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:12.401901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:40:12.401901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:12.401901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:12.401901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:12.401901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:12.401901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:12.401901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:12.401901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:12.401901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:12.403831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:12.403831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:12.403831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:12.403831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:12.403831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:12.403831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:12.403831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:12.403831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:12.403831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:12.403831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:12.403831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:12.403831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:12.403831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:12.403831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:12.403831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:12.403831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:12.404700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:12.404700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:12.404700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:12.404700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:12.404700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:12.404700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:12.404700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:12.404700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:12.404700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:12.404700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:12.404700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:12.404700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:12.404700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:40:12.404700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:12.409205 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 383/768] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:12 2022] GET /identity/v3/services/network => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:12.414303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164f5a1-71d0-4613-a37e-b21a1735c79c None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:12.456850 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1574e3-8ccb-477d-885e-d93bc9a9f794 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:12.489700 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:12.506118 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09509380-e7c4-4693-ab4b-64d3996f1da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:12.507107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09509380-e7c4-4693-ab4b-64d3996f1da2 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:12.508121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09509380-e7c4-4693-ab4b-64d3996f1da2 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:12.508802 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09509380-e7c4-4693-ab4b-64d3996f1da2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:12.512108 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09509380-e7c4-4693-ab4b-64d3996f1da2 None admin] RBAC: Adding query filter params (role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=4a54fa1c326f41e88688404a56b75c30) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:12.512663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09509380-e7c4-4693-ab4b-64d3996f1da2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:12.514415 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09509380-e7c4-4693-ab4b-64d3996f1da2 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:12.524042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 386/769] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:12 2022] GET /identity/v3/role_assignments?user.id=4a54fa1c326f41e88688404a56b75c30&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:12.558154 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164f5a1-71d0-4613-a37e-b21a1735c79c None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:12.593969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee948b-6635-4d38-855d-e2017d2525fc None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:12.594657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee948b-6635-4d38-855d-e2017d2525fc None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:12.595135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee948b-6635-4d38-855d-e2017d2525fc None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:12.601391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 387/770] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:12.607968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cee637-562d-4c64-a297-94048505a60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:12.608704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cee637-562d-4c64-a297-94048505a60a None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:12.609003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cee637-562d-4c64-a297-94048505a60a None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:12.609287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cee637-562d-4c64-a297-94048505a60a None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:12.609866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6979c-8db4-4994-8d04-c05a211b4086 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:12.610047 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cee637-562d-4c64-a297-94048505a60a None admin] RBAC: Adding query filter params (name=network) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:12.610343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cee637-562d-4c64-a297-94048505a60a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:12.610779 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6979c-8db4-4994-8d04-c05a211b4086 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:12.611245 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6979c-8db4-4994-8d04-c05a211b4086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:12.612671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cee637-562d-4c64-a297-94048505a60a None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:12.626719 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 384/771] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 23 10:40:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:12.637715 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cee637-562d-4c64-a297-94048505a60a None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:12.645040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:12.653403 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-3fb6979c-8db4-4994-8d04-c05a211b4086 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:12.654658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-3fb6979c-8db4-4994-8d04-c05a211b4086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:12.773943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 388/772] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:40:12.798847 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cee637-562d-4c64-a297-94048505a60a None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:12.800129 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6979c-8db4-4994-8d04-c05a211b4086 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:12.838891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724f84d-c0c5-479e-ba41-33ff264232fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:12.839985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724f84d-c0c5-479e-ba41-33ff264232fb None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:12.840469 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724f84d-c0c5-479e-ba41-33ff264232fb None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:12.840986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724f84d-c0c5-479e-ba41-33ff264232fb None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:12.842316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724f84d-c0c5-479e-ba41-33ff264232fb None admin] RBAC: Adding query filter params (type=network) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:12.842881 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724f84d-c0c5-479e-ba41-33ff264232fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:12.845106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724f84d-c0c5-479e-ba41-33ff264232fb None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:12.851181 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 385/773] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 23 10:40:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:12.857175 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724f84d-c0c5-479e-ba41-33ff264232fb None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:12.929258 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:12.962692 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724f84d-c0c5-479e-ba41-33ff264232fb None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:12.992182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6979c-8db4-4994-8d04-c05a211b4086 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:13.009351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd0ea0-2186-418a-989c-26cc6968c261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:13.010038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd0ea0-2186-418a-989c-26cc6968c261 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:13.010332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd0ea0-2186-418a-989c-26cc6968c261 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:13.010622 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd0ea0-2186-418a-989c-26cc6968c261 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:13.011465 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd0ea0-2186-418a-989c-26cc6968c261 None admin] RBAC: Adding query filter params (interface=public, service_id=8de9c89d80e043ddbcd270fbd698d4d2, region_id=RegionOne) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:13.011789 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd0ea0-2186-418a-989c-26cc6968c261 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:13.013398 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd0ea0-2186-418a-989c-26cc6968c261 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:13.019102 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:13.030688 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 386/774] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jun 23 10:40:12 2022] GET /identity/v3/endpoints?service_id=8de9c89d80e043ddbcd270fbd698d4d2&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:13.033582 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687b078-9f79-40ec-8aaa-02477a5c7afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:13.034602 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687b078-9f79-40ec-8aaa-02477a5c7afa None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:13.040456 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd0ea0-2186-418a-989c-26cc6968c261 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:13.040564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687b078-9f79-40ec-8aaa-02477a5c7afa None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:13.040564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687b078-9f79-40ec-8aaa-02477a5c7afa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:13.040564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687b078-9f79-40ec-8aaa-02477a5c7afa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:13.042584 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687b078-9f79-40ec-8aaa-02477a5c7afa None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:13.073127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-f687b078-9f79-40ec-8aaa-02477a5c7afa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:40:13.073127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:13.073127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:13.073127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:13.073127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:13.073127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:13.073127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:13.073127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:13.073127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:40:13.073127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:13.073127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:13.073127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:13.073127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:13.073127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:13.073127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:13.073127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:13.074657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:13.074657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:13.074657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:13.074657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:13.074657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:13.074657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:13.074657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:13.074657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:13.074657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:13.074657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:13.074657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:13.074657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:13.074657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:13.074657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:13.074657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:13.074657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:13.075495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:13.075495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:13.075495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:13.075495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:13.075495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:13.075495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:13.075495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:13.075495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:13.075495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:13.075495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:13.075495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:13.075495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:13.075495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:13.075495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:40:13.075495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:13.078834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 389/775] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Jun 23 10:40:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:13.084899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687b078-9f79-40ec-8aaa-02477a5c7afa None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:13.188748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd0ea0-2186-418a-989c-26cc6968c261 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:13.220191 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:13.226083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e833-f39f-4f7a-8353-4afd9f7a97cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:13.226931 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e833-f39f-4f7a-8353-4afd9f7a97cf None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:13.232080 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e833-f39f-4f7a-8353-4afd9f7a97cf None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:13.232080 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e833-f39f-4f7a-8353-4afd9f7a97cf None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:13.232080 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5e833-f39f-4f7a-8353-4afd9f7a97cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:13.232080 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5e833-f39f-4f7a-8353-4afd9f7a97cf None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:13.236897 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 387/776] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jun 23 10:40:13 2022] GET /identity/v3/services => generated 772 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:13.290522 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687b078-9f79-40ec-8aaa-02477a5c7afa None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:13.344127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc369901-5a51-449c-b2e2-5dc768abfc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:13.344842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc369901-5a51-449c-b2e2-5dc768abfc41 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:13.345135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc369901-5a51-449c-b2e2-5dc768abfc41 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:13.345417 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc369901-5a51-449c-b2e2-5dc768abfc41 None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:13.346138 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc369901-5a51-449c-b2e2-5dc768abfc41 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:13.346449 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc369901-5a51-449c-b2e2-5dc768abfc41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:13.347837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc369901-5a51-449c-b2e2-5dc768abfc41 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:13.353120 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 390/777] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jun 23 10:40:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:13.360918 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e833-f39f-4f7a-8353-4afd9f7a97cf None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:13.519310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e833-f39f-4f7a-8353-4afd9f7a97cf None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:13.558691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed0238-f890-4f06-b249-7e68a5d95b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:13.559291 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed0238-f890-4f06-b249-7e68a5d95b17 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:13.559837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed0238-f890-4f06-b249-7e68a5d95b17 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:13.560119 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed0238-f890-4f06-b249-7e68a5d95b17 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:13.560895 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed0238-f890-4f06-b249-7e68a5d95b17 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:13.561210 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed0238-f890-4f06-b249-7e68a5d95b17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:13.562580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed0238-f890-4f06-b249-7e68a5d95b17 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:13.567820 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 388/778] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jun 23 10:40:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:13.573505 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc369901-5a51-449c-b2e2-5dc768abfc41 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:13.645017 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:13.680925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc369901-5a51-449c-b2e2-5dc768abfc41 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:13.718747 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe3e23-56c2-48ba-9069-1c49d6db2794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:13.719430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe3e23-56c2-48ba-9069-1c49d6db2794 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:13.719722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe3e23-56c2-48ba-9069-1c49d6db2794 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:13.720006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe3e23-56c2-48ba-9069-1c49d6db2794 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:13.720841 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe3e23-56c2-48ba-9069-1c49d6db2794 None admin] RBAC: Adding query filter params (interface=public, service_id=6b7ea3affcc7421b9061fdc398184d35, region_id=RegionOne) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:13.721163 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe3e23-56c2-48ba-9069-1c49d6db2794 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:13.722556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe3e23-56c2-48ba-9069-1c49d6db2794 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:13.731634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 391/779] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jun 23 10:40:13 2022] GET /identity/v3/endpoints?service_id=6b7ea3affcc7421b9061fdc398184d35&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:13.737199 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed0238-f890-4f06-b249-7e68a5d95b17 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:13.805388 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:13.844356 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed0238-f890-4f06-b249-7e68a5d95b17 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:13.880721 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8905a-0d78-4399-8857-1d20387cdc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:13.881420 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8905a-0d78-4399-8857-1d20387cdc3f None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:13.881710 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8905a-0d78-4399-8857-1d20387cdc3f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:13.881995 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8905a-0d78-4399-8857-1d20387cdc3f None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:13.882703 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8905a-0d78-4399-8857-1d20387cdc3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:13.884136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8905a-0d78-4399-8857-1d20387cdc3f None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:13.891277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 389/780] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jun 23 10:40:13 2022] GET /identity/v3/services => generated 772 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:14.260361 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fba973-7773-4694-8013-49bcad335442 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:14.261408 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fba973-7773-4694-8013-49bcad335442 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:14.261895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fba973-7773-4694-8013-49bcad335442 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:14.263735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 392/781] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:14.269370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabef60a-0b63-41a4-a6df-1c88f8a05696 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:14.270208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabef60a-0b63-41a4-a6df-1c88f8a05696 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:14.270693 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabef60a-0b63-41a4-a6df-1c88f8a05696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:14.289281 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-fabef60a-0b63-41a4-a6df-1c88f8a05696 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:14.290797 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-fabef60a-0b63-41a4-a6df-1c88f8a05696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:14.366939 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 390/782] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:14.392479 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fba973-7773-4694-8013-49bcad335442 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:14.521725 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fba973-7773-4694-8013-49bcad335442 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:14.541769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:14.566383 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08fcb9-5ca2-4ec7-91b2-352bafdffc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:14.567185 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08fcb9-5ca2-4ec7-91b2-352bafdffc12 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:14.567471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08fcb9-5ca2-4ec7-91b2-352bafdffc12 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:14.567748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08fcb9-5ca2-4ec7-91b2-352bafdffc12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:14.579548 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08fcb9-5ca2-4ec7-91b2-352bafdffc12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:14.588044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-0c08fcb9-5ca2-4ec7-91b2-352bafdffc12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:40:14.588044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:14.588044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:14.588044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:14.588044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:14.588044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:14.588044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:14.588044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:14.588044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:14.588044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:14.588044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:14.588044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:14.588044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:14.588044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:14.588044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:14.588044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:14.592157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:14.592157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:14.592157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:14.592157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:14.592157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:14.592157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:14.592157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:14.592157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:14.592157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:14.592157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:14.592157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:14.592157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:14.592157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:14.592157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:14.592157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:14.592157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:14.593047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:14.593047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:14.593047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:14.593047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:14.593047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:14.593047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:14.593047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:14.593047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:14.593047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:14.593047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:14.593047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:40:14.593047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:14.593047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 393/783] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:40:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:14.595979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabef60a-0b63-41a4-a6df-1c88f8a05696 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:14.695011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:14.745007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabef60a-0b63-41a4-a6df-1c88f8a05696 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:14.779922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a2f19-13d9-4059-a143-565a566ae4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:14.780517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a2f19-13d9-4059-a143-565a566ae4fd None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:14.780823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a2f19-13d9-4059-a143-565a566ae4fd None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:14.781101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a2f19-13d9-4059-a143-565a566ae4fd None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:14.781852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a2f19-13d9-4059-a143-565a566ae4fd None admin] RBAC: Adding query filter params (name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:14.782161 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a2f19-13d9-4059-a143-565a566ae4fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:14.783540 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a2f19-13d9-4059-a143-565a566ae4fd None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:14.792174 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 391/784] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:40:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:14.798007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08fcb9-5ca2-4ec7-91b2-352bafdffc12 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:14.900057 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0018d6-79ad-4061-9273-fd288eb34dee None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:14.900389 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0018d6-79ad-4061-9273-fd288eb34dee None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:14.900624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0018d6-79ad-4061-9273-fd288eb34dee None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:14.902616 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 392/785] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:14.914137 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0406c1d-db0f-4563-b0db-91a4f53e431e None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:14.914428 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0406c1d-db0f-4563-b0db-91a4f53e431e None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:14.914709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0406c1d-db0f-4563-b0db-91a4f53e431e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:14.932821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-e0406c1d-db0f-4563-b0db-91a4f53e431e None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:14.934744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e0406c1d-db0f-4563-b0db-91a4f53e431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:15.008914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08fcb9-5ca2-4ec7-91b2-352bafdffc12 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:15.050455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 393/786] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:40:15.063512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd9318-85f9-4170-a89d-7343b25afec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:15.064311 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd9318-85f9-4170-a89d-7343b25afec9 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:15.064592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd9318-85f9-4170-a89d-7343b25afec9 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:15.064884 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd9318-85f9-4170-a89d-7343b25afec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:15.075782 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd9318-85f9-4170-a89d-7343b25afec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:15.077280 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd9318-85f9-4170-a89d-7343b25afec9 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:15.080692 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0406c1d-db0f-4563-b0db-91a4f53e431e None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:15.100698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-b9dd9318-85f9-4170-a89d-7343b25afec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:15.100698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:15.100698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:15.100698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:15.100698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:15.100698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:15.100698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:15.100698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:15.100698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:15.100698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:15.100698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:15.100698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:15.100698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:15.100698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:15.100698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:15.101663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:15.101663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:15.101663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:15.101663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:15.101663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:15.101663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:15.101663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:15.101663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:15.101663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:15.101663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:15.101663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:15.101663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:15.101663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:15.101663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:15.101663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:15.101663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:15.101663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:15.102536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:15.102536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:15.102536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:15.102536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:15.102536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 394/787] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:15.104918 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c810527-536a-426b-95c8-67b1ea4337a0 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:15.105238 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c810527-536a-426b-95c8-67b1ea4337a0 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:15.105526 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c810527-536a-426b-95c8-67b1ea4337a0 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:15.106984 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 395/788] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:15.107568 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c810527-536a-426b-95c8-67b1ea4337a0 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:15.142185 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:15.232238 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c810527-536a-426b-95c8-67b1ea4337a0 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:15.257045 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:15.268668 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82856f-6e58-46b5-864f-d7cf7060955e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:15.269411 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82856f-6e58-46b5-864f-d7cf7060955e None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:15.269698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82856f-6e58-46b5-864f-d7cf7060955e None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:15.269976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82856f-6e58-46b5-864f-d7cf7060955e None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:15.270692 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82856f-6e58-46b5-864f-d7cf7060955e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:15.271001 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82856f-6e58-46b5-864f-d7cf7060955e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:15.272431 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82856f-6e58-46b5-864f-d7cf7060955e None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:15.285051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 396/789] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:15.286312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6e66-6651-42d9-a13c-259a1db995fc None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:15.286610 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6e66-6651-42d9-a13c-259a1db995fc None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:15.286880 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6e66-6651-42d9-a13c-259a1db995fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:15.308673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-e9bc6e66-6651-42d9-a13c-259a1db995fc None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:15.309978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e9bc6e66-6651-42d9-a13c-259a1db995fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:15.316596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0406c1d-db0f-4563-b0db-91a4f53e431e None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:15.352910 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f2b3c-4fd4-4cda-935b-450abfcf9151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:15.353880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f2b3c-4fd4-4cda-935b-450abfcf9151 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:15.354214 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f2b3c-4fd4-4cda-935b-450abfcf9151 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:15.354499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f2b3c-4fd4-4cda-935b-450abfcf9151 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:15.366553 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f2b3c-4fd4-4cda-935b-450abfcf9151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:15.374526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-841f2b3c-4fd4-4cda-935b-450abfcf9151 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:15.374526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:15.374526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:15.374526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:15.374526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:15.374526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:15.374526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:15.374526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:15.374526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:15.374526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:15.374526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:15.374526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:15.374526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:15.374526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:15.374526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:15.374526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:15.375451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:15.375451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:15.375451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:15.375451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:15.375451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:15.375451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:15.375451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:15.375451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:15.375451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:15.375451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:15.375451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:15.375451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:15.375451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:15.375451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:15.375451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:15.375451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:15.376277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:15.376277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:15.376277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:15.376277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:15.376277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:15.376277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:15.376277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:15.376277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:15.376277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:15.376277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:15.376277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:15.376277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:15.380827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 394/790] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:40:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:15.381738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f2b3c-4fd4-4cda-935b-450abfcf9151 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:15.394384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 397/791] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:15.395719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc6e66-6651-42d9-a13c-259a1db995fc None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:15.416002 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:15.513265 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f2b3c-4fd4-4cda-935b-450abfcf9151 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:15.521284 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:15.531064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc6e66-6651-42d9-a13c-259a1db995fc None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:15.554511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66932c7-be10-4da3-8874-348f3cac63da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:15.555401 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66932c7-be10-4da3-8874-348f3cac63da None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:15.557247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66932c7-be10-4da3-8874-348f3cac63da None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:15.557733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66932c7-be10-4da3-8874-348f3cac63da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:15.569662 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66932c7-be10-4da3-8874-348f3cac63da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:15.572299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66932c7-be10-4da3-8874-348f3cac63da None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:15.576664 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4c1de-8a03-4afd-b0ec-3b155db71053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:15.577374 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4c1de-8a03-4afd-b0ec-3b155db71053 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:15.577653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4c1de-8a03-4afd-b0ec-3b155db71053 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:15.577935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4c1de-8a03-4afd-b0ec-3b155db71053 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:15.578687 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4c1de-8a03-4afd-b0ec-3b155db71053 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:15.578998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4c1de-8a03-4afd-b0ec-3b155db71053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:15.580423 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4c1de-8a03-4afd-b0ec-3b155db71053 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:15.592407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-e66932c7-be10-4da3-8874-348f3cac63da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:40:15.592407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:15.592407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:15.592407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:15.592407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:15.592407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:15.592407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:15.592407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:15.592407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:15.592407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:15.592407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:15.592407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:15.592407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:15.592407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:15.592407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:15.592407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:15.594736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:15.594736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:15.594736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:15.594736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:15.594736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:15.594736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:15.594736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:15.594736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:15.594736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:15.594736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:15.594736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:15.594736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:15.594736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:15.594736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:15.594736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:15.594736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:15.594736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:15.594736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:15.595679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:15.595679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:15.595679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:15.595679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:15.595679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:15.595679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:15.595679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:15.595679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:15.595679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:40:15.595679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:15.596204 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 398/792] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:40:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:15.596204 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4c1de-8a03-4afd-b0ec-3b155db71053 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:15.597343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 395/793] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 23 10:40:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:15.598399 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66932c7-be10-4da3-8874-348f3cac63da None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:15.709233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:15.717375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66932c7-be10-4da3-8874-348f3cac63da None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:15.737893 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4c1de-8a03-4afd-b0ec-3b155db71053 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:15.755231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c4c15-b96b-4729-a9cc-028012585a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:15.756138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c4c15-b96b-4729-a9cc-028012585a2e None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:15.756494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c4c15-b96b-4729-a9cc-028012585a2e None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:15.756874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c4c15-b96b-4729-a9cc-028012585a2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:15.768567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c4c15-b96b-4729-a9cc-028012585a2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:15.770309 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c4c15-b96b-4729-a9cc-028012585a2e None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:15.784241 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc5439-5990-4418-b004-9e7f33fa8253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:15.785318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc5439-5990-4418-b004-9e7f33fa8253 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:15.785804 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc5439-5990-4418-b004-9e7f33fa8253 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:15.786251 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc5439-5990-4418-b004-9e7f33fa8253 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:15.789322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-fa6c4c15-b96b-4729-a9cc-028012585a2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:15.789322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:15.789322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:15.789322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:15.789322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:15.789322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:15.789322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:15.789322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:15.789322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:15.789322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:15.789322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:15.789322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:15.789322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:15.789322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:15.789322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:15.790194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:15.790194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:15.790194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:15.790194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:15.790194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:15.790194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:15.790194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:15.790194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:15.790194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:15.790194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:15.790194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:15.790194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:15.790194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:15.790194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:15.790194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:15.790194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:15.790194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:15.791098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:15.791098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:15.791098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:15.791098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:15.795484 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 396/794] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:15.796444 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c4c15-b96b-4729-a9cc-028012585a2e None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:15.801576 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc5439-5990-4418-b004-9e7f33fa8253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:15.810115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-43bc5439-5990-4418-b004-9e7f33fa8253 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:15.810115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:15.810115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:15.810115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:15.810115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:15.810115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:15.810115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:15.810115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:15.810115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:15.810115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:15.810115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:15.810115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:15.810115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:15.810115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:15.810115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:15.810115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:15.811064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:15.811064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:15.811064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:15.811064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:15.811064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:15.811064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:15.811064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:15.811064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:15.811064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:15.811064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:15.811064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:15.811064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:15.811064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:15.811064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:15.811064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:15.811064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:15.811900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:15.811900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:15.811900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:15.811900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:15.811900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:15.811900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:15.811900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:15.811900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:15.811900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:15.811900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:15.811900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:15.811900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:15.816567 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 399/795] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:40:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:15.817503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc5439-5990-4418-b004-9e7f33fa8253 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:15.821747 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:15.924926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc5439-5990-4418-b004-9e7f33fa8253 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:15.933969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c4c15-b96b-4729-a9cc-028012585a2e None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:15.961203 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87501b6-1137-4cc5-8154-4bd9667a9760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:15.961876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87501b6-1137-4cc5-8154-4bd9667a9760 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:15.962163 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87501b6-1137-4cc5-8154-4bd9667a9760 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:15.962441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87501b6-1137-4cc5-8154-4bd9667a9760 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:15.963173 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87501b6-1137-4cc5-8154-4bd9667a9760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:15.963483 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87501b6-1137-4cc5-8154-4bd9667a9760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:15.964986 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87501b6-1137-4cc5-8154-4bd9667a9760 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:15.973295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:15.975765 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c50fe0-a68b-45d1-be2c-7fa0a21d4d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:15.976664 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c50fe0-a68b-45d1-be2c-7fa0a21d4d96 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:15.977123 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c50fe0-a68b-45d1-be2c-7fa0a21d4d96 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:15.977596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c50fe0-a68b-45d1-be2c-7fa0a21d4d96 None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:15.978447 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 400/796] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:15.978792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c50fe0-a68b-45d1-be2c-7fa0a21d4d96 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:15.979247 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87501b6-1137-4cc5-8154-4bd9667a9760 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:15.979485 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c50fe0-a68b-45d1-be2c-7fa0a21d4d96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:15.981321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c50fe0-a68b-45d1-be2c-7fa0a21d4d96 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:16.001206 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 397/797] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jun 23 10:40:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:16.002782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499d2e4-2edd-4624-9e30-28e3bf60b0af None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:16.003072 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499d2e4-2edd-4624-9e30-28e3bf60b0af None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:16.003349 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499d2e4-2edd-4624-9e30-28e3bf60b0af None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:16.004739 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 398/798] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:16.009147 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499d2e4-2edd-4624-9e30-28e3bf60b0af None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:16.091472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87501b6-1137-4cc5-8154-4bd9667a9760 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:16.094250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:16.117430 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499d2e4-2edd-4624-9e30-28e3bf60b0af None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:16.126839 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65685504-8982-487f-938d-4b16cbbc96ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:16.127774 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65685504-8982-487f-938d-4b16cbbc96ab None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:16.128067 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65685504-8982-487f-938d-4b16cbbc96ab None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:16.128401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65685504-8982-487f-938d-4b16cbbc96ab None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:16.129199 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65685504-8982-487f-938d-4b16cbbc96ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:16.129506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65685504-8982-487f-938d-4b16cbbc96ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:16.130889 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65685504-8982-487f-938d-4b16cbbc96ab None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:16.139944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 401/799] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:40:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:16.145012 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65685504-8982-487f-938d-4b16cbbc96ab None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:16.154417 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb482647-d7ad-4f73-a7b1-d961d03358b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:16.155200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb482647-d7ad-4f73-a7b1-d961d03358b9 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:16.155486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb482647-d7ad-4f73-a7b1-d961d03358b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:16.155765 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb482647-d7ad-4f73-a7b1-d961d03358b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:16.163639 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb482647-d7ad-4f73-a7b1-d961d03358b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:16.165112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb482647-d7ad-4f73-a7b1-d961d03358b9 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:16.179671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-bb482647-d7ad-4f73-a7b1-d961d03358b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:40:16.179671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:16.179671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:16.179671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:16.179671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:16.179671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:16.179671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:16.179671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:16.179671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:16.179671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:16.179671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:16.179671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:16.179671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:16.179671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:16.179671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:16.179671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:16.180655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:16.180655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:16.180655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:16.180655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:16.180655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:16.180655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:16.180655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:16.180655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:16.180655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:16.180655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:16.180655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:16.180655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:16.180655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:16.180655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:16.180655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:16.180655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:16.180655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:16.180655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:16.181682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:16.181682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:16.181682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:16.181682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:16.181682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:16.181682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:16.181682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:16.181682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:16.181682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:40:16.181682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:16.181682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 399/800] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jun 23 10:40:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:16.182780 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610371f-32fe-4492-b4e6-984118ee7acf None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:16.182780 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610371f-32fe-4492-b4e6-984118ee7acf None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:16.182780 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610371f-32fe-4492-b4e6-984118ee7acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:16.199120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-9610371f-32fe-4492-b4e6-984118ee7acf None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:16.200319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9610371f-32fe-4492-b4e6-984118ee7acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:16.209957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:16.251643 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65685504-8982-487f-938d-4b16cbbc96ab None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:16.272758 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 400/801] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:16.272758 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610371f-32fe-4492-b4e6-984118ee7acf None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:16.300888 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d10b4-1283-4d79-95a8-99ec636e3028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:16.302132 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d10b4-1283-4d79-95a8-99ec636e3028 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:16.302420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d10b4-1283-4d79-95a8-99ec636e3028 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:16.302705 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d10b4-1283-4d79-95a8-99ec636e3028 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:16.314226 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d10b4-1283-4d79-95a8-99ec636e3028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:16.315677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d10b4-1283-4d79-95a8-99ec636e3028 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:16.332899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-600d10b4-1283-4d79-95a8-99ec636e3028 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:16.332899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:16.332899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:16.332899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:16.332899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:16.332899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:16.332899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:16.332899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:16.332899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:16.332899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:16.332899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:16.332899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:16.332899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:16.332899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:16.332899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:16.333982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:16.333982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:16.333982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:16.333982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:16.333982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:16.333982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:16.333982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:16.333982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:16.333982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:16.333982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:16.333982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:16.333982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:16.333982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:16.333982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:16.333982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:16.333982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:16.333982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:16.334881 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:16.334881 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:16.334881 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:16.334881 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:16.334881 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 402/802] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:16.335170 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d10b4-1283-4d79-95a8-99ec636e3028 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:16.347965 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:16.382592 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610371f-32fe-4492-b4e6-984118ee7acf None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:16.416725 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed8220-9e32-4334-95e4-c3489c17027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:16.418091 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed8220-9e32-4334-95e4-c3489c17027d None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:16.418371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed8220-9e32-4334-95e4-c3489c17027d None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:16.418647 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed8220-9e32-4334-95e4-c3489c17027d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:16.428583 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed8220-9e32-4334-95e4-c3489c17027d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:16.430054 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed8220-9e32-4334-95e4-c3489c17027d None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:16.434050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d10b4-1283-4d79-95a8-99ec636e3028 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:16.446392 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:16.447034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-8aed8220-9e32-4334-95e4-c3489c17027d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:16.447034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:16.447034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:16.447034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:16.447034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:16.447034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:16.447034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:16.447034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:16.447034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:16.447034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:16.447034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:16.447034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:16.447034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:16.447034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:16.447034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:16.448073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:16.448073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:16.448073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:16.448073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:16.448073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:16.448073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:16.448073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:16.448073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:16.448073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:16.448073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:16.448073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:16.448073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:16.448073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:16.448073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:16.448073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:16.448073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:16.448073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:16.449370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:16.449370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:16.449370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:16.449370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:16.449370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 401/803] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:16.449641 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed8220-9e32-4334-95e4-c3489c17027d None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:16.471835 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085b3df-59f1-4300-b24f-91487e8dc79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:16.472511 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085b3df-59f1-4300-b24f-91487e8dc79b None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:16.472830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085b3df-59f1-4300-b24f-91487e8dc79b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:16.473171 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085b3df-59f1-4300-b24f-91487e8dc79b None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:16.474048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085b3df-59f1-4300-b24f-91487e8dc79b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:16.474360 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085b3df-59f1-4300-b24f-91487e8dc79b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:16.475864 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085b3df-59f1-4300-b24f-91487e8dc79b None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:16.493963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 403/804] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jun 23 10:40:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:16.495048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7ca32-55b4-4d3b-97ae-957698ad7a2c None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:16.495514 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7ca32-55b4-4d3b-97ae-957698ad7a2c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:16.495956 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7ca32-55b4-4d3b-97ae-957698ad7a2c None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:16.497347 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 404/805] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:16.498171 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7ca32-55b4-4d3b-97ae-957698ad7a2c None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:16.552850 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed8220-9e32-4334-95e4-c3489c17027d None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:16.569547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:16.586052 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346f714-44e0-42e7-8991-6c6af113d853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:16.586851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346f714-44e0-42e7-8991-6c6af113d853 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:16.587141 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346f714-44e0-42e7-8991-6c6af113d853 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:16.587424 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346f714-44e0-42e7-8991-6c6af113d853 None admin] PATH_INFO: `/v3/services/network` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:16.588080 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346f714-44e0-42e7-8991-6c6af113d853 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:16.590151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346f714-44e0-42e7-8991-6c6af113d853 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:16.596983 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7ca32-55b4-4d3b-97ae-957698ad7a2c None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:16.602534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-b346f714-44e0-42e7-8991-6c6af113d853 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:40:16.602534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:16.602534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:16.602534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:16.602534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:16.602534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:16.602534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:16.602534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:16.602534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:40:16.602534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:16.602534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:16.602534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:16.602534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:16.602534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:16.602534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:16.602534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:16.602534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:16.603502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:16.603502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:16.603502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:16.603502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:16.603502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:16.603502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:16.603502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:16.603502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:16.603502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:16.603502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:16.603502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:16.603502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:16.603502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:16.603502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:16.603502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:16.603502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:16.604308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:16.604308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:16.604308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:16.604308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:16.604308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:16.604308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:16.604308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:16.604308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:16.604308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:16.604308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:16.604308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:16.604308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:16.604308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:40:16.604308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:16.604308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 402/806] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:16 2022] GET /identity/v3/services/network => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:16.605910 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346f714-44e0-42e7-8991-6c6af113d853 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:16.637579 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00347cf0-0c94-4d1a-b1c9-f51dee667d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:16.638252 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00347cf0-0c94-4d1a-b1c9-f51dee667d8e None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:16.638540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00347cf0-0c94-4d1a-b1c9-f51dee667d8e None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:16.638828 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00347cf0-0c94-4d1a-b1c9-f51dee667d8e None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:16.639552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00347cf0-0c94-4d1a-b1c9-f51dee667d8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:16.639866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00347cf0-0c94-4d1a-b1c9-f51dee667d8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:16.641296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00347cf0-0c94-4d1a-b1c9-f51dee667d8e None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:16.652331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 405/807] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:16.653165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00347cf0-0c94-4d1a-b1c9-f51dee667d8e None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:16.681922 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:16.709767 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346f714-44e0-42e7-8991-6c6af113d853 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:16.742427 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a71419-233a-4586-87a8-9d11c82cbdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:16.743090 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a71419-233a-4586-87a8-9d11c82cbdfe None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:16.743379 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a71419-233a-4586-87a8-9d11c82cbdfe None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:16.743657 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a71419-233a-4586-87a8-9d11c82cbdfe None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:16.744379 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a71419-233a-4586-87a8-9d11c82cbdfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:16.744720 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a71419-233a-4586-87a8-9d11c82cbdfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:16.746605 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a71419-233a-4586-87a8-9d11c82cbdfe None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:16.750774 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00347cf0-0c94-4d1a-b1c9-f51dee667d8e None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:16.758276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 403/808] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:16.759480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9d471-6be3-4815-aab5-ae6ac22ab44b None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:16.759766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9d471-6be3-4815-aab5-ae6ac22ab44b None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:16.760043 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9d471-6be3-4815-aab5-ae6ac22ab44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:16.776079 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-9af9d471-6be3-4815-aab5-ae6ac22ab44b None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:16.777319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9af9d471-6be3-4815-aab5-ae6ac22ab44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:16.784775 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690cc4b-fa22-4c7c-8eb5-d9889c449136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:16.785426 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690cc4b-fa22-4c7c-8eb5-d9889c449136 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:16.785712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690cc4b-fa22-4c7c-8eb5-d9889c449136 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:16.785993 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690cc4b-fa22-4c7c-8eb5-d9889c449136 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:16.811743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:16.840617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 404/809] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:16.841726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9d471-6be3-4815-aab5-ae6ac22ab44b None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:16.858380 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690cc4b-fa22-4c7c-8eb5-d9889c449136 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:16.859774 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690cc4b-fa22-4c7c-8eb5-d9889c449136 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:16.889361 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:16.940931 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9d471-6be3-4815-aab5-ae6ac22ab44b None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:16.959650 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 406/810] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:40:16.960483 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690cc4b-fa22-4c7c-8eb5-d9889c449136 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:16.978080 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aab1b-84dd-4c69-8138-688b95e1cce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:16.978766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aab1b-84dd-4c69-8138-688b95e1cce9 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:16.979030 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aab1b-84dd-4c69-8138-688b95e1cce9 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:16.979306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aab1b-84dd-4c69-8138-688b95e1cce9 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:16.980932 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5aab1b-84dd-4c69-8138-688b95e1cce9 None admin] RBAC: Adding query filter params (name=network) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:16.981254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5aab1b-84dd-4c69-8138-688b95e1cce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:16.982613 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5aab1b-84dd-4c69-8138-688b95e1cce9 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:16.986973 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 405/811] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 23 10:40:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:16.987730 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aab1b-84dd-4c69-8138-688b95e1cce9 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:17.021371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:17.059611 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690cc4b-fa22-4c7c-8eb5-d9889c449136 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:17.084518 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aab1b-84dd-4c69-8138-688b95e1cce9 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:17.086605 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:17.091877 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4508a-9f6d-44c4-9d1a-3eab14434d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:17.092686 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4508a-9f6d-44c4-9d1a-3eab14434d44 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:17.092974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4508a-9f6d-44c4-9d1a-3eab14434d44 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:17.093248 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4508a-9f6d-44c4-9d1a-3eab14434d44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:17.099865 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4508a-9f6d-44c4-9d1a-3eab14434d44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:17.101358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4508a-9f6d-44c4-9d1a-3eab14434d44 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:17.115637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-f8b4508a-9f6d-44c4-9d1a-3eab14434d44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:17.115637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:17.115637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:17.115637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:17.115637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:17.115637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:17.115637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:17.115637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:17.115637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:17.115637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:17.115637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:17.115637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:17.115637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:17.115637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:17.115637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:17.116722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:17.116722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:17.116722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:17.116722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:17.116722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:17.116722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:17.116722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:17.116722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:17.116722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:17.116722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:17.116722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:17.116722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:17.116722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:17.116722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:17.116722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:17.116722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:17.116722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:17.117820 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:17.117820 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:17.117820 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:17.117820 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:17.117820 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:17.117820 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:17.117820 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:17.117820 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:17.117820 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 407/812] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:17.117820 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4508a-9f6d-44c4-9d1a-3eab14434d44 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:17.123917 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724b6f7-2948-4956-9f73-db230118105a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:17.124754 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724b6f7-2948-4956-9f73-db230118105a None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:17.125047 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724b6f7-2948-4956-9f73-db230118105a None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:17.125329 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724b6f7-2948-4956-9f73-db230118105a None admin] PATH_INFO: `/v3/users/swift` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:17.133018 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724b6f7-2948-4956-9f73-db230118105a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:17.134456 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724b6f7-2948-4956-9f73-db230118105a None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:17.149219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-a724b6f7-2948-4956-9f73-db230118105a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:40:17.149219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:17.149219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:17.149219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:17.149219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:17.149219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:17.149219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:17.149219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:17.149219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:17.149219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:17.149219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:17.149219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:17.149219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:17.149219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:17.149219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:17.149219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:17.150331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:17.150331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:17.150331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:17.150331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:17.150331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:17.150331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:17.150331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:17.150331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:17.150331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:17.150331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:17.150331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:17.150331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:17.150331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:17.150331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:17.150331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:17.150331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:17.150331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:17.150331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:17.151808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:17.151808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:17.151808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:17.151808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:17.151808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:17.151808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:17.151808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:17.151808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:17.151808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:40:17.151808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:17.151808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 406/813] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:40:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:17.151808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724b6f7-2948-4956-9f73-db230118105a None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:17.219709 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4508a-9f6d-44c4-9d1a-3eab14434d44 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:17.245300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:17.250969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724b6f7-2948-4956-9f73-db230118105a None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:17.252844 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be6809-ed4c-4cd6-998e-f71bf780da57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:17.258464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be6809-ed4c-4cd6-998e-f71bf780da57 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:17.258464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be6809-ed4c-4cd6-998e-f71bf780da57 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:17.258464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be6809-ed4c-4cd6-998e-f71bf780da57 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:17.258464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be6809-ed4c-4cd6-998e-f71bf780da57 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:17.258464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be6809-ed4c-4cd6-998e-f71bf780da57 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:17.268277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-20be6809-ed4c-4cd6-998e-f71bf780da57 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:40:17.268277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:17.268277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:17.268277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:17.268277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:17.268277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:17.268277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:17.268277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:17.268277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:40:17.268277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:17.268277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:17.268277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:17.268277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:17.268277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:17.268277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:17.268277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:17.269304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:17.269304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:17.269304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:17.269304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:17.269304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:17.269304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:17.269304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:17.269304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:17.269304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:17.269304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:17.269304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:17.269304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:17.269304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:17.269304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:17.269304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:17.269304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:17.270160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:17.270160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:17.270160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:17.270160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:17.270160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:17.270160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:17.270160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:17.270160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:17.270160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:17.270160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:17.270160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:17.270160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:17.270160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:17.270160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:40:17.270160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:17.270160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 408/814] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Jun 23 10:40:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:17.271017 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be6809-ed4c-4cd6-998e-f71bf780da57 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:17.285997 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423df21-9dde-4f49-9ad2-7d6a48bc6681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:17.286792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423df21-9dde-4f49-9ad2-7d6a48bc6681 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:17.287080 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423df21-9dde-4f49-9ad2-7d6a48bc6681 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:17.287357 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423df21-9dde-4f49-9ad2-7d6a48bc6681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:17.298291 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423df21-9dde-4f49-9ad2-7d6a48bc6681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:17.299724 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423df21-9dde-4f49-9ad2-7d6a48bc6681 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:17.316500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-f423df21-9dde-4f49-9ad2-7d6a48bc6681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:17.316500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:17.316500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:17.316500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:17.316500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:17.316500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:17.316500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:17.316500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:17.316500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:17.316500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:17.316500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:17.316500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:17.316500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:17.316500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:17.316500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:17.317486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:17.317486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:17.317486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:17.317486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:17.317486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:17.317486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:17.317486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:17.317486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:17.317486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:17.317486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:17.317486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:17.317486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:17.317486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:17.317486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:17.317486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:17.317486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:17.317486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:17.318379 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:17.318379 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:17.318379 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:17.318379 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:17.318379 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 407/815] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:17.318664 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423df21-9dde-4f49-9ad2-7d6a48bc6681 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:17.331974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:17.376516 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be6809-ed4c-4cd6-998e-f71bf780da57 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:17.409102 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4e855-0ef5-494a-9c5c-57b1083663c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:17.409759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4e855-0ef5-494a-9c5c-57b1083663c5 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:17.410135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4e855-0ef5-494a-9c5c-57b1083663c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:17.410415 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4e855-0ef5-494a-9c5c-57b1083663c5 None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:17.411114 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4e855-0ef5-494a-9c5c-57b1083663c5 None admin] RBAC: Adding query filter params (type=network) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:17.411422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4e855-0ef5-494a-9c5c-57b1083663c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:17.412812 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4e855-0ef5-494a-9c5c-57b1083663c5 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:17.416773 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423df21-9dde-4f49-9ad2-7d6a48bc6681 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:17.418042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 409/816] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 23 10:40:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:17.418814 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4e855-0ef5-494a-9c5c-57b1083663c5 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:17.455133 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee34da1-b347-4a81-a5b5-39ac4325b9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:17.455782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee34da1-b347-4a81-a5b5-39ac4325b9a7 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:17.456064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee34da1-b347-4a81-a5b5-39ac4325b9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:17.456337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee34da1-b347-4a81-a5b5-39ac4325b9a7 None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:17.457151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee34da1-b347-4a81-a5b5-39ac4325b9a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:17.457464 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee34da1-b347-4a81-a5b5-39ac4325b9a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:17.458882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee34da1-b347-4a81-a5b5-39ac4325b9a7 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:17.470545 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 408/817] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:17.471335 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee34da1-b347-4a81-a5b5-39ac4325b9a7 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:17.484108 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:17.518360 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4e855-0ef5-494a-9c5c-57b1083663c5 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:17.535065 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:17.552251 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3348649-0c42-4078-80eb-817ee7457b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:17.552974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3348649-0c42-4078-80eb-817ee7457b66 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:17.553256 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3348649-0c42-4078-80eb-817ee7457b66 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:17.553537 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3348649-0c42-4078-80eb-817ee7457b66 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:17.554370 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3348649-0c42-4078-80eb-817ee7457b66 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:17.554678 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3348649-0c42-4078-80eb-817ee7457b66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:17.556401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3348649-0c42-4078-80eb-817ee7457b66 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:17.573590 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee34da1-b347-4a81-a5b5-39ac4325b9a7 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:17.575069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 410/818] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jun 23 10:40:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:17.575733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3348649-0c42-4078-80eb-817ee7457b66 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:17.613024 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec21e57-1617-47c4-ba3b-81784abbfcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:17.613875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec21e57-1617-47c4-ba3b-81784abbfcac None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:17.614166 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec21e57-1617-47c4-ba3b-81784abbfcac None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:17.614443 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec21e57-1617-47c4-ba3b-81784abbfcac None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:17.615154 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec21e57-1617-47c4-ba3b-81784abbfcac None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:17.615897 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec21e57-1617-47c4-ba3b-81784abbfcac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:17.617698 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec21e57-1617-47c4-ba3b-81784abbfcac None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:17.627997 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 409/819] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jun 23 10:40:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:17.627997 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec21e57-1617-47c4-ba3b-81784abbfcac None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:17.674997 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3348649-0c42-4078-80eb-817ee7457b66 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:17.694508 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:17.708562 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a315a6-01ac-4e30-96fc-b24545629192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:17.709296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a315a6-01ac-4e30-96fc-b24545629192 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:17.709581 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a315a6-01ac-4e30-96fc-b24545629192 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:17.709857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a315a6-01ac-4e30-96fc-b24545629192 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:17.710582 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a315a6-01ac-4e30-96fc-b24545629192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:17.710892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a315a6-01ac-4e30-96fc-b24545629192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:17.712270 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a315a6-01ac-4e30-96fc-b24545629192 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:17.723770 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 411/820] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:17.724534 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a315a6-01ac-4e30-96fc-b24545629192 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:17.724977 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec21e57-1617-47c4-ba3b-81784abbfcac None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:17.758951 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:17.760469 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597886a3-b3ae-4367-9017-125199bbd9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:17.761570 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597886a3-b3ae-4367-9017-125199bbd9cd None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:17.761865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597886a3-b3ae-4367-9017-125199bbd9cd None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:17.762150 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597886a3-b3ae-4367-9017-125199bbd9cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:17.762917 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597886a3-b3ae-4367-9017-125199bbd9cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:17.764280 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597886a3-b3ae-4367-9017-125199bbd9cd None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:17.821015 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a315a6-01ac-4e30-96fc-b24545629192 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:17.847336 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 410/821] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jun 23 10:40:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:40:17.848153 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597886a3-b3ae-4367-9017-125199bbd9cd None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:17.860737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bad91-370e-4918-9f25-cbf7c504ab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:17.861658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bad91-370e-4918-9f25-cbf7c504ab64 None admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:17.861942 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bad91-370e-4918-9f25-cbf7c504ab64 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:17.862220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bad91-370e-4918-9f25-cbf7c504ab64 None admin] PATH_INFO: `/v3/projects/d7a9c82a62044db884e547da9a523927/users/1b03d940626a449dbe904f02f3d70854/roles/3522dd96085d47688d7a42ed133484a9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:17.881924 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bad91-370e-4918-9f25-cbf7c504ab64 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7a9c82a62044db884e547da9a523927, user_id=1b03d940626a449dbe904f02f3d70854, role_id=3522dd96085d47688d7a42ed133484a9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:17.883390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bad91-370e-4918-9f25-cbf7c504ab64 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:17.945230 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 412/822] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:40:17 2022] PUT /identity/v3/projects/d7a9c82a62044db884e547da9a523927/users/1b03d940626a449dbe904f02f3d70854/roles/3522dd96085d47688d7a42ed133484a9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:40:17.946224 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bad91-370e-4918-9f25-cbf7c504ab64 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:17.973271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597886a3-b3ae-4367-9017-125199bbd9cd None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:18.013050 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:18.019774 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec168816-10a8-4997-b6d2-9e8e0a755387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:18.020616 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec168816-10a8-4997-b6d2-9e8e0a755387 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:18.021009 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec168816-10a8-4997-b6d2-9e8e0a755387 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:18.021302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec168816-10a8-4997-b6d2-9e8e0a755387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:18.037453 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec168816-10a8-4997-b6d2-9e8e0a755387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:18.039327 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec168816-10a8-4997-b6d2-9e8e0a755387 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:18.061302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-ec168816-10a8-4997-b6d2-9e8e0a755387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:18.061302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:18.061302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:18.061302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:18.061302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:18.061302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:18.061302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:18.061302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:18.061302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:18.061302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:18.061302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:18.061302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:18.061302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:18.061302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:18.061302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:18.062287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:18.062287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:18.062287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:18.062287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:18.062287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:18.062287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:18.062287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:18.062287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:18.062287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:18.062287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:18.062287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:18.062287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:18.062287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:18.062287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:18.062287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:18.062287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:18.062287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:18.063338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:18.063338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:18.063338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:18.063338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:18.065402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 411/823] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:18.066598 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec168816-10a8-4997-b6d2-9e8e0a755387 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:18.081130 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:18.107529 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bad91-370e-4918-9f25-cbf7c504ab64 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:18.151140 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42541a1e-0335-409b-9acf-a18a2077d51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:18.151742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42541a1e-0335-409b-9acf-a18a2077d51f None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:18.152027 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42541a1e-0335-409b-9acf-a18a2077d51f None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:18.152309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42541a1e-0335-409b-9acf-a18a2077d51f None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:18.153073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42541a1e-0335-409b-9acf-a18a2077d51f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:18.153380 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42541a1e-0335-409b-9acf-a18a2077d51f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:18.154750 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42541a1e-0335-409b-9acf-a18a2077d51f None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:18.159889 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 413/824] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jun 23 10:40:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:18.160725 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42541a1e-0335-409b-9acf-a18a2077d51f None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:18.201343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec168816-10a8-4997-b6d2-9e8e0a755387 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:18.237856 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786428a3-67b6-445c-8b1a-2fff5f2dd89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:18.238660 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786428a3-67b6-445c-8b1a-2fff5f2dd89a None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:18.238946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786428a3-67b6-445c-8b1a-2fff5f2dd89a None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:18.239226 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786428a3-67b6-445c-8b1a-2fff5f2dd89a None admin] PATH_INFO: `/v3/projects/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:18.246584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786428a3-67b6-445c-8b1a-2fff5f2dd89a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:18.248023 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786428a3-67b6-445c-8b1a-2fff5f2dd89a None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:18.262695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-786428a3-67b6-445c-8b1a-2fff5f2dd89a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:18.262695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:18.262695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:18.262695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:18.262695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:18.262695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:18.262695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:18.262695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:18.262695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:18.262695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:18.262695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:18.262695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:18.262695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:18.262695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:18.262695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:18.263794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:18.263794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:18.263794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:18.263794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:18.263794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:18.263794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:18.263794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:18.263794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:18.263794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:18.263794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:18.263794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:18.263794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:18.263794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:18.263794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:18.263794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:18.263794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:18.263794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:18.264763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:18.264763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:18.264763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:18.264763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:18.264763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:18.264763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:18.264763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:18.264763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:18.264763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 412/825] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:18.264763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786428a3-67b6-445c-8b1a-2fff5f2dd89a None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:18.271218 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42541a1e-0335-409b-9acf-a18a2077d51f None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:18.308225 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406aee6-a7cf-47f5-9757-31b43fc23565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:18.308856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406aee6-a7cf-47f5-9757-31b43fc23565 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:18.309144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406aee6-a7cf-47f5-9757-31b43fc23565 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:18.309431 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406aee6-a7cf-47f5-9757-31b43fc23565 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:18.310223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406aee6-a7cf-47f5-9757-31b43fc23565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:18.310536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406aee6-a7cf-47f5-9757-31b43fc23565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:18.311207 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:18.311999 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406aee6-a7cf-47f5-9757-31b43fc23565 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:18.324277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 414/826] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:18.325686 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406aee6-a7cf-47f5-9757-31b43fc23565 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:18.334805 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:18.378293 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786428a3-67b6-445c-8b1a-2fff5f2dd89a None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:18.414494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb9f90-468f-4124-9ba3-bed1b2779315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:18.415081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb9f90-468f-4124-9ba3-bed1b2779315 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:18.415368 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb9f90-468f-4124-9ba3-bed1b2779315 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:18.415644 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb9f90-468f-4124-9ba3-bed1b2779315 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:18.416382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb9f90-468f-4124-9ba3-bed1b2779315 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:18.417807 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb9f90-468f-4124-9ba3-bed1b2779315 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:18.435239 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406aee6-a7cf-47f5-9757-31b43fc23565 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:18.469520 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eecab2-f67c-4f3b-aa44-75628c25e8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:18.470189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eecab2-f67c-4f3b-aa44-75628c25e8f3 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:18.470477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eecab2-f67c-4f3b-aa44-75628c25e8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:18.470756 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eecab2-f67c-4f3b-aa44-75628c25e8f3 None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:18.471554 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eecab2-f67c-4f3b-aa44-75628c25e8f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:18.471867 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eecab2-f67c-4f3b-aa44-75628c25e8f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:18.473338 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eecab2-f67c-4f3b-aa44-75628c25e8f3 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:18.486383 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 415/827] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:18.487125 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eecab2-f67c-4f3b-aa44-75628c25e8f3 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:18.500960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 413/828] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jun 23 10:40:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:40:18.502492 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb9f90-468f-4124-9ba3-bed1b2779315 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:18.572078 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:18.620057 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eecab2-f67c-4f3b-aa44-75628c25e8f3 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:18.645864 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:18.660098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb9f90-468f-4124-9ba3-bed1b2779315 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:18.676197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcb734-fad8-4179-9398-82e147e593b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:18.677732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcb734-fad8-4179-9398-82e147e593b1 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:18.677846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcb734-fad8-4179-9398-82e147e593b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:18.678192 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcb734-fad8-4179-9398-82e147e593b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:18.687757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcb734-fad8-4179-9398-82e147e593b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:18.689711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcb734-fad8-4179-9398-82e147e593b1 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:18.704762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-a9bcb734-fad8-4179-9398-82e147e593b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:18.704762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:18.704762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:18.704762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:18.704762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:18.704762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:18.704762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:18.704762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:18.704762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:18.704762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:18.704762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:18.704762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:18.704762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:18.704762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:18.704762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:18.705657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:18.705657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:18.705657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:18.705657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:18.705657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:18.705657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:18.705657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:18.705657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:18.705657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:18.705657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:18.705657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:18.705657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:18.705657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:18.705657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:18.705657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:18.705657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:18.705657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:18.707052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:18.707052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:18.707052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:18.707052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:18.707052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:18.707052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:18.707052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:18.707052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:18.707052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 416/829] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:18.707735 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e39ae-018d-497f-9b3c-b04c7e1bad76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:18.707735 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e39ae-018d-497f-9b3c-b04c7e1bad76 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:18.707995 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e39ae-018d-497f-9b3c-b04c7e1bad76 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:18.709920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e39ae-018d-497f-9b3c-b04c7e1bad76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:18.709920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e39ae-018d-497f-9b3c-b04c7e1bad76 None admin] RBAC: Adding query filter params (role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=39840f048d254831bdb963b38520f706) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:18.709920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e39ae-018d-497f-9b3c-b04c7e1bad76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:18.711954 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e39ae-018d-497f-9b3c-b04c7e1bad76 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:18.712063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcb734-fad8-4179-9398-82e147e593b1 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:18.719720 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 414/830] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:18 2022] GET /identity/v3/role_assignments?user.id=39840f048d254831bdb963b38520f706&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:18.832827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcb734-fad8-4179-9398-82e147e593b1 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:18.865045 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:18.871688 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb29a7-57bf-48f5-95df-94f1e75cf462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:18.872374 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb29a7-57bf-48f5-95df-94f1e75cf462 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:18.872689 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb29a7-57bf-48f5-95df-94f1e75cf462 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:18.872977 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb29a7-57bf-48f5-95df-94f1e75cf462 None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:18.873778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb29a7-57bf-48f5-95df-94f1e75cf462 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:18.874093 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb29a7-57bf-48f5-95df-94f1e75cf462 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:18.875539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb29a7-57bf-48f5-95df-94f1e75cf462 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:18.889304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 417/831] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:18.895141 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e39ae-018d-497f-9b3c-b04c7e1bad76 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:19.011330 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e39ae-018d-497f-9b3c-b04c7e1bad76 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:19.047070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74834f19-54ec-4311-a481-32030df29bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:19.047968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74834f19-54ec-4311-a481-32030df29bed None admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:19.048251 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74834f19-54ec-4311-a481-32030df29bed None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:19.048530 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74834f19-54ec-4311-a481-32030df29bed None admin] PATH_INFO: `/v3/projects/d7a9c82a62044db884e547da9a523927/users/4a54fa1c326f41e88688404a56b75c30/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:19.050540 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74834f19-54ec-4311-a481-32030df29bed None admin] RBAC: Authorizing `identity:create_grant(project_id=d7a9c82a62044db884e547da9a523927, user_id=4a54fa1c326f41e88688404a56b75c30, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:19.051982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74834f19-54ec-4311-a481-32030df29bed None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:19.117516 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 415/832] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:40:18 2022] PUT /identity/v3/projects/d7a9c82a62044db884e547da9a523927/users/4a54fa1c326f41e88688404a56b75c30/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:40:20.079238 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dc299-814f-4286-a387-c998addd9801 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:20.079733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dc299-814f-4286-a387-c998addd9801 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:20.079733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dc299-814f-4286-a387-c998addd9801 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:20.081345 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 418/833] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:20.086701 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a95cb-5253-44f6-9083-3350db0be37c None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:20.087102 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a95cb-5253-44f6-9083-3350db0be37c None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:20.087267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a95cb-5253-44f6-9083-3350db0be37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:20.104628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-620a95cb-5253-44f6-9083-3350db0be37c None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:20.106147 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-620a95cb-5253-44f6-9083-3350db0be37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:20.116917 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:20.179514 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 416/834] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:20.203487 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dc299-814f-4286-a387-c998addd9801 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:20.322224 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dc299-814f-4286-a387-c998addd9801 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:20.358755 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684c050-9cab-4634-95f3-e11668e0173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:20.359565 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684c050-9cab-4634-95f3-e11668e0173d None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:20.359855 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684c050-9cab-4634-95f3-e11668e0173d None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:20.360135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684c050-9cab-4634-95f3-e11668e0173d None admin] PATH_INFO: `/v3/roles/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:20.371446 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684c050-9cab-4634-95f3-e11668e0173d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:20.379477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-f684c050-9cab-4634-95f3-e11668e0173d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:40:20.379477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:20.379477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:20.379477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:20.379477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:20.379477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:20.379477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:20.379477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:20.379477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:20.379477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:20.379477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:20.379477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:20.379477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:20.379477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:20.379477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:20.379477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:20.380387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:20.380387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:20.380387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:20.380387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:20.380387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:20.380387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:20.380387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:20.380387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:20.380387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:20.380387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:20.380387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:20.380387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:20.380387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:20.380387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:20.380387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:20.380387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:20.382128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:20.382128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:20.382128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:20.382128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:20.382128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:20.382128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:20.382128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:20.382128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:20.382128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:20.382128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:20.382128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:40:20.382128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:20.382128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 419/835] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:40:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:20.387328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a95cb-5253-44f6-9083-3350db0be37c None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:20.492562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a95cb-5253-44f6-9083-3350db0be37c None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:20.527494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc132b0-e9c6-4549-a944-e75a58cc2e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:20.528170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc132b0-e9c6-4549-a944-e75a58cc2e67 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:20.528450 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc132b0-e9c6-4549-a944-e75a58cc2e67 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:20.528754 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc132b0-e9c6-4549-a944-e75a58cc2e67 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:20.529501 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc132b0-e9c6-4549-a944-e75a58cc2e67 None admin] RBAC: Adding query filter params (name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:20.529807 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc132b0-e9c6-4549-a944-e75a58cc2e67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:20.531173 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc132b0-e9c6-4549-a944-e75a58cc2e67 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:20.539769 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 417/836] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:40:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:20.546261 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684c050-9cab-4634-95f3-e11668e0173d None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:20.598724 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:20.667014 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684c050-9cab-4634-95f3-e11668e0173d None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:20.694179 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebea1c9-afd7-44b3-a61d-def92c0c5b01 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:20.694807 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebea1c9-afd7-44b3-a61d-def92c0c5b01 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:20.695284 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebea1c9-afd7-44b3-a61d-def92c0c5b01 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:20.698566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 418/837] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:20.702806 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f56104-2c44-4f23-bc11-7b5f19d4e1e0 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:20.703339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f56104-2c44-4f23-bc11-7b5f19d4e1e0 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:20.703467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d460b42-9e7c-4703-8692-9e67a45b1703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:20.703964 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f56104-2c44-4f23-bc11-7b5f19d4e1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:20.704247 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d460b42-9e7c-4703-8692-9e67a45b1703 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:20.704537 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d460b42-9e7c-4703-8692-9e67a45b1703 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:20.704959 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d460b42-9e7c-4703-8692-9e67a45b1703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:20.717338 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d460b42-9e7c-4703-8692-9e67a45b1703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:20.718814 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d460b42-9e7c-4703-8692-9e67a45b1703 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:20.722489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-d4f56104-2c44-4f23-bc11-7b5f19d4e1e0 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:20.723892 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d4f56104-2c44-4f23-bc11-7b5f19d4e1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:20.726160 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:20.738172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-8d460b42-9e7c-4703-8692-9e67a45b1703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:20.738172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:20.738172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:20.738172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:20.738172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:20.738172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:20.738172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:20.738172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:20.738172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:20.738172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:20.738172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:20.738172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:20.738172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:20.738172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:20.738172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:20.739072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:20.739072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:20.739072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:20.739072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:20.739072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:20.739072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:20.739072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:20.739072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:20.739072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:20.739072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:20.739072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:20.739072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:20.739072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:20.739072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:20.739072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:20.739072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:20.739072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:20.740564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:20.740564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:20.740564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:20.740564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:20.740564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 420/838] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:20.745623 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d460b42-9e7c-4703-8692-9e67a45b1703 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:20.812856 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 419/839] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:20.827459 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f56104-2c44-4f23-bc11-7b5f19d4e1e0 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:20.852512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:20.856928 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d460b42-9e7c-4703-8692-9e67a45b1703 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:20.894888 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30429e27-77d3-4a7c-9b0c-816bd3a86253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:20.895474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30429e27-77d3-4a7c-9b0c-816bd3a86253 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:20.895830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30429e27-77d3-4a7c-9b0c-816bd3a86253 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:20.896150 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30429e27-77d3-4a7c-9b0c-816bd3a86253 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:20.896890 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30429e27-77d3-4a7c-9b0c-816bd3a86253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:20.897208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30429e27-77d3-4a7c-9b0c-816bd3a86253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:20.898662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30429e27-77d3-4a7c-9b0c-816bd3a86253 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:20.939116 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f56104-2c44-4f23-bc11-7b5f19d4e1e0 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:20.979024 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76161bdb-a5bf-4f8c-9719-eb414e09f6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:20.979838 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76161bdb-a5bf-4f8c-9719-eb414e09f6f7 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:20.980127 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76161bdb-a5bf-4f8c-9719-eb414e09f6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:20.980395 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76161bdb-a5bf-4f8c-9719-eb414e09f6f7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:20.981103 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76161bdb-a5bf-4f8c-9719-eb414e09f6f7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:20.982530 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76161bdb-a5bf-4f8c-9719-eb414e09f6f7 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:20.995852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-76161bdb-a5bf-4f8c-9719-eb414e09f6f7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:40:20.995852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:20.995852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:20.995852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:20.995852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:20.995852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:20.995852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:20.995852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:20.995852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:40:20.995852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:20.995852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:20.995852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:20.995852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:20.995852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:20.995852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:20.995852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:20.995852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:20.996993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:20.996993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:20.996993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:20.996993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:20.996993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:20.996993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:20.996993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:20.996993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:20.996993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:20.996993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:20.996993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:20.996993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:20.996993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:20.996993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:20.996993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:20.996993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:20.998298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:20.998298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:20.998298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:20.998298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:20.998298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:20.998298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:20.998298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:20.998298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:20.998298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:20.998298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:20.998298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:20.998298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:20.998298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:40:20.998298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:21.001008 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 420/840] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:40:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:21.003369 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805ddbd-a031-4b26-a4a4-1b780baf5e87 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:21.003666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805ddbd-a031-4b26-a4a4-1b780baf5e87 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:21.003944 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805ddbd-a031-4b26-a4a4-1b780baf5e87 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:21.005562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 421/841] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:21.010056 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805ddbd-a031-4b26-a4a4-1b780baf5e87 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:21.013930 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:21.034965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 421/842] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:21.034965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939f0ac-e0b2-4090-bf40-f0997312aa27 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:21.034965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939f0ac-e0b2-4090-bf40-f0997312aa27 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:21.034965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939f0ac-e0b2-4090-bf40-f0997312aa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:21.049280 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-e939f0ac-e0b2-4090-bf40-f0997312aa27 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:21.050541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e939f0ac-e0b2-4090-bf40-f0997312aa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:21.122786 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805ddbd-a031-4b26-a4a4-1b780baf5e87 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:21.123494 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 422/843] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:21.124387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939f0ac-e0b2-4090-bf40-f0997312aa27 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:21.165116 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ef111-c066-4997-b581-c7b87e836a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:21.165785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ef111-c066-4997-b581-c7b87e836a3f None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:21.165992 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ef111-c066-4997-b581-c7b87e836a3f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:21.166276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ef111-c066-4997-b581-c7b87e836a3f None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:21.166980 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ef111-c066-4997-b581-c7b87e836a3f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:21.167294 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ef111-c066-4997-b581-c7b87e836a3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:21.168687 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ef111-c066-4997-b581-c7b87e836a3f None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:21.177999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 422/844] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:40:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:21.177999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ef111-c066-4997-b581-c7b87e836a3f None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:21.228774 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:21.239997 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939f0ac-e0b2-4090-bf40-f0997312aa27 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:21.245537 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:21.274207 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add39373-3af9-40fe-b74e-c67637a78e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:21.275017 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add39373-3af9-40fe-b74e-c67637a78e80 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:21.275299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add39373-3af9-40fe-b74e-c67637a78e80 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:21.275585 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add39373-3af9-40fe-b74e-c67637a78e80 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:21.280174 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ef111-c066-4997-b581-c7b87e836a3f None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:21.282490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add39373-3af9-40fe-b74e-c67637a78e80 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:21.283928 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add39373-3af9-40fe-b74e-c67637a78e80 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:21.298346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-add39373-3af9-40fe-b74e-c67637a78e80 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:40:21.298346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:21.298346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:21.298346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:21.298346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:21.298346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:21.298346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:21.298346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:21.298346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:21.298346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:21.298346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:21.298346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:21.298346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:21.298346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:21.298346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:21.298346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:21.299291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:21.299291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:21.299291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:21.299291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:21.299291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:21.299291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:21.299291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:21.299291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:21.299291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:21.299291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:21.299291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:21.299291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:21.299291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:21.299291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:21.299291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:21.299291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:21.299291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:21.299291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:21.300209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:21.300209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:21.300209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:21.300209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:21.300209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:21.300209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:21.300209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:21.300209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:21.300209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:40:21.300209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:21.300209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 423/845] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 23 10:40:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:21.300811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add39373-3af9-40fe-b74e-c67637a78e80 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:21.315500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3db73a-81d3-479b-a34f-afa474d5c582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:21.316310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3db73a-81d3-479b-a34f-afa474d5c582 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:21.316596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3db73a-81d3-479b-a34f-afa474d5c582 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:21.316906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3db73a-81d3-479b-a34f-afa474d5c582 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:21.317559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3db73a-81d3-479b-a34f-afa474d5c582 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:21.318917 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3db73a-81d3-479b-a34f-afa474d5c582 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:21.330851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-2f3db73a-81d3-479b-a34f-afa474d5c582 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:40:21.330851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:21.330851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:21.330851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:21.330851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:21.330851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:21.330851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:21.330851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:21.330851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:40:21.330851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:21.330851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:21.330851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:21.330851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:21.330851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:21.330851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:21.330851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:21.331955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:21.331955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:21.331955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:21.331955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:21.331955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:21.331955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:21.331955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:21.331955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:21.331955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:21.331955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:21.331955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:21.331955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:21.331955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:21.331955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:21.331955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:21.331955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:21.332988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:21.332988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:21.332988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:21.332988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:21.332988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:21.332988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:21.332988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:21.332988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:21.332988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:21.332988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:21.332988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:21.332988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:21.332988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:21.332988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:40:21.332988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:21.332988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 423/846] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Jun 23 10:40:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:21.333823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f2392-7015-44f6-afd7-ef728e4bf3bd None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:21.333823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f2392-7015-44f6-afd7-ef728e4bf3bd None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:21.333947 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f2392-7015-44f6-afd7-ef728e4bf3bd None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:21.335101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 424/847] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:21.335847 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f2392-7015-44f6-afd7-ef728e4bf3bd None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:21.408601 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add39373-3af9-40fe-b74e-c67637a78e80 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:21.440541 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f2392-7015-44f6-afd7-ef728e4bf3bd None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:21.441813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad822cf5-1b39-4c4b-b1de-9dabaff64778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:21.442477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad822cf5-1b39-4c4b-b1de-9dabaff64778 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:21.442762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad822cf5-1b39-4c4b-b1de-9dabaff64778 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:21.443038 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad822cf5-1b39-4c4b-b1de-9dabaff64778 None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:21.443744 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad822cf5-1b39-4c4b-b1de-9dabaff64778 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:21.444051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad822cf5-1b39-4c4b-b1de-9dabaff64778 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:21.445467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad822cf5-1b39-4c4b-b1de-9dabaff64778 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:21.450424 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 424/848] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:40:21 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:21.451014 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad822cf5-1b39-4c4b-b1de-9dabaff64778 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:21.468173 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:21.471125 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:21.480355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f985f-548a-4a04-a9b5-8c804bf00143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:21.488584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f985f-548a-4a04-a9b5-8c804bf00143 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:21.488584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f985f-548a-4a04-a9b5-8c804bf00143 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:21.488584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f985f-548a-4a04-a9b5-8c804bf00143 None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:21.488584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f985f-548a-4a04-a9b5-8c804bf00143 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:21.488584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f985f-548a-4a04-a9b5-8c804bf00143 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:21.488584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f985f-548a-4a04-a9b5-8c804bf00143 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:21.505155 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 425/849] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jun 23 10:40:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:21.506873 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71606c7-90f6-43a0-bf1d-21d24d11a295 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:21.507350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71606c7-90f6-43a0-bf1d-21d24d11a295 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:21.507457 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71606c7-90f6-43a0-bf1d-21d24d11a295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:21.526160 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-e71606c7-90f6-43a0-bf1d-21d24d11a295 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:21.527520 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e71606c7-90f6-43a0-bf1d-21d24d11a295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:21.578232 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad822cf5-1b39-4c4b-b1de-9dabaff64778 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:21.604744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 426/850] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:21.613395 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71606c7-90f6-43a0-bf1d-21d24d11a295 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:21.623032 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f45d4-9c90-4109-9258-8b9fdb13c689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:21.623783 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f45d4-9c90-4109-9258-8b9fdb13c689 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:21.624074 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f45d4-9c90-4109-9258-8b9fdb13c689 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:21.624350 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f45d4-9c90-4109-9258-8b9fdb13c689 None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:21.627092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f45d4-9c90-4109-9258-8b9fdb13c689 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:21.627092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f45d4-9c90-4109-9258-8b9fdb13c689 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:21.627092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f45d4-9c90-4109-9258-8b9fdb13c689 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:21.632344 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 425/851] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 23 10:40:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:21.636194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f45d4-9c90-4109-9258-8b9fdb13c689 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:21.714312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:21.731254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71606c7-90f6-43a0-bf1d-21d24d11a295 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:21.736127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f45d4-9c90-4109-9258-8b9fdb13c689 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:21.750891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:21.769945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33b9fc-27b2-46ae-a555-cba3079b87b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:21.771179 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33b9fc-27b2-46ae-a555-cba3079b87b9 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:21.771675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33b9fc-27b2-46ae-a555-cba3079b87b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:21.772162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33b9fc-27b2-46ae-a555-cba3079b87b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:21.774310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cc540-55d1-43cd-9531-8e6ed15f0d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:21.775277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cc540-55d1-43cd-9531-8e6ed15f0d11 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:21.775558 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cc540-55d1-43cd-9531-8e6ed15f0d11 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:21.775842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cc540-55d1-43cd-9531-8e6ed15f0d11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:21.787035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cc540-55d1-43cd-9531-8e6ed15f0d11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:21.794757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-206cc540-55d1-43cd-9531-8e6ed15f0d11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:21.794757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:21.794757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:21.794757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:21.794757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:21.794757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:21.794757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:21.794757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:21.794757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:21.794757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:21.794757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:21.794757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:21.794757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:21.794757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:21.794757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:21.794757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:21.795680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:21.795680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:21.795680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:21.795680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:21.795680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:21.795680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:21.795680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:21.795680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:21.795680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:21.795680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:21.795680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:21.795680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:21.795680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:21.795680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:21.795680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:21.795680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:21.797305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:21.797305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:21.797305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:21.797305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:21.797305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:21.797305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:21.797305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:21.797305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:21.797305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:21.797305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:21.797305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:21.797305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:21.797305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 426/852] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:40:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:21.797305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cc540-55d1-43cd-9531-8e6ed15f0d11 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:21.850360 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33b9fc-27b2-46ae-a555-cba3079b87b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:21.851892 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33b9fc-27b2-46ae-a555-cba3079b87b9 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:21.907273 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cc540-55d1-43cd-9531-8e6ed15f0d11 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:21.946020 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f2197-10a1-4617-83dd-f3bb6fb72cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:21.946692 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f2197-10a1-4617-83dd-f3bb6fb72cc7 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:21.946978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f2197-10a1-4617-83dd-f3bb6fb72cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:21.947254 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f2197-10a1-4617-83dd-f3bb6fb72cc7 None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:21.948698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f2197-10a1-4617-83dd-f3bb6fb72cc7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:21.949108 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f2197-10a1-4617-83dd-f3bb6fb72cc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:21.950495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f2197-10a1-4617-83dd-f3bb6fb72cc7 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:21.953118 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:21.964760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 427/853] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 23 10:40:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:21.964760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f2197-10a1-4617-83dd-f3bb6fb72cc7 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:21.965020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 427/854] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:21 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:40:21.965020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33b9fc-27b2-46ae-a555-cba3079b87b9 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:21.986682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:22.097303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33b9fc-27b2-46ae-a555-cba3079b87b9 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:22.108936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f2197-10a1-4617-83dd-f3bb6fb72cc7 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:22.135874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c3f03-fba1-42cf-9fe8-755e97bf5995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:22.136703 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c3f03-fba1-42cf-9fe8-755e97bf5995 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:22.137011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c3f03-fba1-42cf-9fe8-755e97bf5995 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:22.137286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c3f03-fba1-42cf-9fe8-755e97bf5995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:22.150075 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c3f03-fba1-42cf-9fe8-755e97bf5995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:22.152330 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c3f03-fba1-42cf-9fe8-755e97bf5995 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:22.153033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286c848-0009-4b86-9b56-8f1368284a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:22.153718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286c848-0009-4b86-9b56-8f1368284a6b None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:22.154269 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286c848-0009-4b86-9b56-8f1368284a6b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:22.154552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286c848-0009-4b86-9b56-8f1368284a6b None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:22.155741 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286c848-0009-4b86-9b56-8f1368284a6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:22.156048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286c848-0009-4b86-9b56-8f1368284a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:22.157441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286c848-0009-4b86-9b56-8f1368284a6b None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:22.167878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 428/855] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:40:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:22.170784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-497c3f03-fba1-42cf-9fe8-755e97bf5995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:22.170784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:22.170784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:22.170784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:22.170784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:22.170784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:22.170784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:22.170784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:22.170784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:22.170784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:22.170784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:22.170784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:22.170784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:22.170784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:22.170784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:22.171649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:22.171649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:22.171649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:22.171649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:22.171649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:22.171649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:22.171649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:22.171649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:22.171649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:22.171649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:22.171649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:22.171649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:22.171649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:22.171649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:22.171649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:22.171649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:22.171649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:22.172538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:22.172538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:22.172538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:22.172538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:22.172538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 428/856] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:22.173061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286c848-0009-4b86-9b56-8f1368284a6b None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:22.177933 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c3f03-fba1-42cf-9fe8-755e97bf5995 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:22.243111 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:22.266394 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:22.286587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286c848-0009-4b86-9b56-8f1368284a6b None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:22.314770 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c3f03-fba1-42cf-9fe8-755e97bf5995 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:22.324868 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b09101-390f-4601-9974-6ac30c2e755e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:22.325671 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b09101-390f-4601-9974-6ac30c2e755e None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:22.325953 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b09101-390f-4601-9974-6ac30c2e755e None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:22.326227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b09101-390f-4601-9974-6ac30c2e755e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:22.336970 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b09101-390f-4601-9974-6ac30c2e755e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:22.338894 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b09101-390f-4601-9974-6ac30c2e755e None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:22.352214 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930d505-ffe3-4514-b18d-93cb8d166e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:22.352940 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930d505-ffe3-4514-b18d-93cb8d166e19 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:22.353235 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930d505-ffe3-4514-b18d-93cb8d166e19 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:22.353527 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930d505-ffe3-4514-b18d-93cb8d166e19 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:22.355115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930d505-ffe3-4514-b18d-93cb8d166e19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:22.355449 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930d505-ffe3-4514-b18d-93cb8d166e19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:22.356614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-55b09101-390f-4601-9974-6ac30c2e755e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:22.356614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:22.356614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:22.356614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:22.356614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:22.356614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:22.356614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:22.356614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:22.356614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:22.356614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:22.356614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:22.356614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:22.356614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:22.356614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:22.356614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:22.357661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:22.357661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:22.357661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:22.357661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:22.357661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:22.357661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:22.357661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:22.357661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:22.357661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:22.357661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:22.357661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:22.357661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:22.357661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:22.357661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:22.357661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:22.357661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:22.357661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:22.358743 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:22.358743 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:22.358743 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:22.358743 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:22.359002 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930d505-ffe3-4514-b18d-93cb8d166e19 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:22.359091 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 429/857] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:22.364159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b09101-390f-4601-9974-6ac30c2e755e None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:22.375379 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 429/858] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:22.383332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930d505-ffe3-4514-b18d-93cb8d166e19 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:22.497752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b09101-390f-4601-9974-6ac30c2e755e None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:22.518305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:22.519140 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930d505-ffe3-4514-b18d-93cb8d166e19 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:22.547507 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685464a-dfcf-40be-8b3a-e606d3591dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:22.549238 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685464a-dfcf-40be-8b3a-e606d3591dac None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:22.549666 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685464a-dfcf-40be-8b3a-e606d3591dac None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:22.550113 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685464a-dfcf-40be-8b3a-e606d3591dac None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:22.550334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:22.551330 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685464a-dfcf-40be-8b3a-e606d3591dac None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:22.552065 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685464a-dfcf-40be-8b3a-e606d3591dac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:22.553968 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685464a-dfcf-40be-8b3a-e606d3591dac None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:22.557925 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d05e0e-c697-456b-b393-61054a37dfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:22.558961 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d05e0e-c697-456b-b393-61054a37dfb7 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:22.558961 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d05e0e-c697-456b-b393-61054a37dfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:22.559207 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d05e0e-c697-456b-b393-61054a37dfb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:22.566702 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d05e0e-c697-456b-b393-61054a37dfb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:22.568222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d05e0e-c697-456b-b393-61054a37dfb7 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:22.569602 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 430/859] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:22.574749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685464a-dfcf-40be-8b3a-e606d3591dac None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:22.584921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-c2d05e0e-c697-456b-b393-61054a37dfb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:22.584921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:22.584921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:22.584921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:22.584921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:22.584921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:22.584921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:22.584921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:22.584921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:22.584921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:22.584921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:22.584921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:22.584921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:22.584921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:22.584921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:22.586034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:22.586034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:22.586034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:22.586034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:22.586034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:22.586034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:22.586034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:22.586034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:22.586034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:22.586034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:22.586034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:22.586034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:22.586034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:22.586034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:22.586034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:22.586034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:22.586034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:22.587152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:22.587152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:22.587152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:22.587152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:22.587152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:22.587152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:22.587152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:22.587152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:22.592810 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 430/860] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:22.595314 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d05e0e-c697-456b-b393-61054a37dfb7 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:22.700337 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685464a-dfcf-40be-8b3a-e606d3591dac None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:22.708897 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d05e0e-c697-456b-b393-61054a37dfb7 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:22.738683 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7fc2f-2d6d-4702-a394-d50eafe97583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:22.739726 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7fc2f-2d6d-4702-a394-d50eafe97583 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:22.740113 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7fc2f-2d6d-4702-a394-d50eafe97583 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:22.740665 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7fc2f-2d6d-4702-a394-d50eafe97583 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:22.745827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69969689-8d70-473d-b156-e3b2aab5aa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:22.746654 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69969689-8d70-473d-b156-e3b2aab5aa1e None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:22.747079 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69969689-8d70-473d-b156-e3b2aab5aa1e None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:22.747492 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69969689-8d70-473d-b156-e3b2aab5aa1e None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:22.748490 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69969689-8d70-473d-b156-e3b2aab5aa1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:22.749046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69969689-8d70-473d-b156-e3b2aab5aa1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:22.749313 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7fc2f-2d6d-4702-a394-d50eafe97583 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:22.750835 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69969689-8d70-473d-b156-e3b2aab5aa1e None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:22.750966 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7fc2f-2d6d-4702-a394-d50eafe97583 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:22.768753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-54f7fc2f-2d6d-4702-a394-d50eafe97583 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:40:22.768753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:22.768753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:22.768753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:22.768753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:22.768753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:22.768753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:22.768753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:22.768753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:22.768753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:22.768753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:22.768753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:22.768753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:22.768753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:22.768753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:22.768753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:22.769917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:22.769917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:22.769917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:22.769917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:22.769917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:22.769917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:22.769917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:22.769917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:22.769917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:22.769917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:22.769917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:22.769917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:22.769917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:22.769917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:22.769917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:22.769917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:22.769917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:22.769917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:22.770923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:22.770923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:22.770923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:22.770923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:22.770923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:22.770923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:22.770923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:22.770923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:22.770923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:40:22.770923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:22.770923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 431/862] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:40:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:22.770923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7fc2f-2d6d-4702-a394-d50eafe97583 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:22.771913 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 431/862] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:22.777815 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69969689-8d70-473d-b156-e3b2aab5aa1e None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:22.808179 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:22.831734 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:22.882890 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7fc2f-2d6d-4702-a394-d50eafe97583 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:22.886542 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69969689-8d70-473d-b156-e3b2aab5aa1e None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:22.920027 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab7096-fc96-4c79-ad83-f092839e2100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:22.921045 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab7096-fc96-4c79-ad83-f092839e2100 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:22.921562 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab7096-fc96-4c79-ad83-f092839e2100 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:22.921985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab7096-fc96-4c79-ad83-f092839e2100 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:22.922525 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc68bb9-e59d-48f6-8db2-9b1bbfc2772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:22.923147 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab7096-fc96-4c79-ad83-f092839e2100 None admin] RBAC: Adding query filter params (role.id=3522dd96085d47688d7a42ed133484a9, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=1b03d940626a449dbe904f02f3d70854) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:22.923321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc68bb9-e59d-48f6-8db2-9b1bbfc2772b None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:22.923675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc68bb9-e59d-48f6-8db2-9b1bbfc2772b None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:22.923914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab7096-fc96-4c79-ad83-f092839e2100 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:22.924078 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc68bb9-e59d-48f6-8db2-9b1bbfc2772b None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:22.925009 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc68bb9-e59d-48f6-8db2-9b1bbfc2772b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:22.925391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc68bb9-e59d-48f6-8db2-9b1bbfc2772b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:22.925972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab7096-fc96-4c79-ad83-f092839e2100 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:22.927130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc68bb9-e59d-48f6-8db2-9b1bbfc2772b None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:22.932894 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 432/863] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:22 2022] GET /identity/v3/role_assignments?user.id=1b03d940626a449dbe904f02f3d70854&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=3522dd96085d47688d7a42ed133484a9 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:22.958205 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 432/864] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jun 23 10:40:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:22.964361 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab7096-fc96-4c79-ad83-f092839e2100 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:23.073450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:23.076727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab7096-fc96-4c79-ad83-f092839e2100 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:23.113284 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33851324-6514-4ef5-b709-864d9401e935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:23.114230 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33851324-6514-4ef5-b709-864d9401e935 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:23.114706 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33851324-6514-4ef5-b709-864d9401e935 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:23.115282 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33851324-6514-4ef5-b709-864d9401e935 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:23.194101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33851324-6514-4ef5-b709-864d9401e935 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:23.196221 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33851324-6514-4ef5-b709-864d9401e935 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:23.294595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:23.300021 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 433/865] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:22 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:40:23.305252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc68bb9-e59d-48f6-8db2-9b1bbfc2772b None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:23.409209 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc68bb9-e59d-48f6-8db2-9b1bbfc2772b None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:23.419594 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:23.445188 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5119a88-2f90-4234-9302-6fc655fd89be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:23.445992 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5119a88-2f90-4234-9302-6fc655fd89be None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:23.446283 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5119a88-2f90-4234-9302-6fc655fd89be None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:23.446565 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5119a88-2f90-4234-9302-6fc655fd89be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:23.458205 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5119a88-2f90-4234-9302-6fc655fd89be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:23.460162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5119a88-2f90-4234-9302-6fc655fd89be None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:23.478579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-e5119a88-2f90-4234-9302-6fc655fd89be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:23.478579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:23.478579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:23.478579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:23.478579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:23.478579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:23.478579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:23.478579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:23.478579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:23.478579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:23.478579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:23.478579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:23.478579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:23.478579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:23.478579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:23.479549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:23.479549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:23.479549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:23.479549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:23.479549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:23.479549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:23.479549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:23.479549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:23.479549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:23.479549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:23.479549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:23.479549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:23.479549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:23.479549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:23.479549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:23.479549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:23.479549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:23.480443 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:23.480443 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:23.480443 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:23.480443 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:23.480781 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 433/866] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:23.486024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33851324-6514-4ef5-b709-864d9401e935 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:23.567087 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a4370-e1b2-4302-b494-37af5e0b61bd None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:23.567435 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a4370-e1b2-4302-b494-37af5e0b61bd None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:23.567661 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a4370-e1b2-4302-b494-37af5e0b61bd None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:23.569434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 434/867] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:23.575111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11229ed-9a41-483c-9e36-33fe73cc9f18 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:23.575657 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11229ed-9a41-483c-9e36-33fe73cc9f18 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:23.576156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11229ed-9a41-483c-9e36-33fe73cc9f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:23.594044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-a11229ed-9a41-483c-9e36-33fe73cc9f18 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:23.595224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-a11229ed-9a41-483c-9e36-33fe73cc9f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:23.603161 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33851324-6514-4ef5-b709-864d9401e935 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:23.650063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d67d9a-9107-46dd-b0d7-011f5b30d201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:23.652240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d67d9a-9107-46dd-b0d7-011f5b30d201 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:23.652611 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d67d9a-9107-46dd-b0d7-011f5b30d201 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:23.652990 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d67d9a-9107-46dd-b0d7-011f5b30d201 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:23.653807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d67d9a-9107-46dd-b0d7-011f5b30d201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:23.654198 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d67d9a-9107-46dd-b0d7-011f5b30d201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:23.656130 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d67d9a-9107-46dd-b0d7-011f5b30d201 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:23.673362 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 435/869] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:40:23.676408 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 434/869] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:23.677510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11229ed-9a41-483c-9e36-33fe73cc9f18 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:23.694286 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d67d9a-9107-46dd-b0d7-011f5b30d201 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:23.761478 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:23.803224 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d67d9a-9107-46dd-b0d7-011f5b30d201 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:23.809102 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:23.817298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11229ed-9a41-483c-9e36-33fe73cc9f18 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:23.851599 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd83bb-653b-4606-baf0-94f2d0e909bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:23.852279 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd83bb-653b-4606-baf0-94f2d0e909bc None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:23.852560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd83bb-653b-4606-baf0-94f2d0e909bc None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:23.852861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd83bb-653b-4606-baf0-94f2d0e909bc None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:23.853648 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd83bb-653b-4606-baf0-94f2d0e909bc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:23.855315 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd83bb-653b-4606-baf0-94f2d0e909bc None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:23.857033 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53213ed6-11be-4dfb-b39e-62f2c6f2029d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:23.858369 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53213ed6-11be-4dfb-b39e-62f2c6f2029d None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:23.858864 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53213ed6-11be-4dfb-b39e-62f2c6f2029d None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:23.859854 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53213ed6-11be-4dfb-b39e-62f2c6f2029d None admin] PATH_INFO: `/v3/projects/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:23.867633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53213ed6-11be-4dfb-b39e-62f2c6f2029d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:23.873750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53213ed6-11be-4dfb-b39e-62f2c6f2029d None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:23.884010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-53213ed6-11be-4dfb-b39e-62f2c6f2029d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:23.884010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:23.884010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:23.884010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:23.884010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:23.884010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:23.884010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:23.884010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:23.884010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:23.884010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:23.884010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:23.884010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:23.884010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:23.884010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:23.884010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:23.885513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:23.885513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:23.885513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:23.885513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:23.885513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:23.885513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:23.885513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:23.885513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:23.885513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:23.885513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:23.885513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:23.885513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:23.885513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:23.885513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:23.885513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:23.885513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:23.885513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:23.886559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:23.886559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:23.886559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:23.886559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:23.886559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:23.886559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:23.886559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:23.886559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:23.887518 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 436/870] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:23.891726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53213ed6-11be-4dfb-b39e-62f2c6f2029d None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:23.924784 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 435/871] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 23 10:40:23 2022] POST /identity/v3/services => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:40:24.016505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53213ed6-11be-4dfb-b39e-62f2c6f2029d None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:24.061225 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736671cd-974f-45b4-947d-a93f5013f45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:24.062192 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736671cd-974f-45b4-947d-a93f5013f45c None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:24.062637 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736671cd-974f-45b4-947d-a93f5013f45c None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:24.063061 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736671cd-974f-45b4-947d-a93f5013f45c None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:24.064017 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736671cd-974f-45b4-947d-a93f5013f45c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:24.064485 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736671cd-974f-45b4-947d-a93f5013f45c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:24.066086 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736671cd-974f-45b4-947d-a93f5013f45c None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:24.080703 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 437/872] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:24.089866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd83bb-653b-4606-baf0-94f2d0e909bc None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:24.123604 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a4ac5-3459-4695-8e35-88fe36f6084c None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:24.123886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a4ac5-3459-4695-8e35-88fe36f6084c None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:24.124171 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a4ac5-3459-4695-8e35-88fe36f6084c None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:24.126276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 438/873] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:24.131486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d82dec-0539-4e77-9afa-085879391167 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:24.131785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d82dec-0539-4e77-9afa-085879391167 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:24.132071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d82dec-0539-4e77-9afa-085879391167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:24.145231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:24.151176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-62d82dec-0539-4e77-9afa-085879391167 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:24.153187 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-62d82dec-0539-4e77-9afa-085879391167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:24.213814 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd83bb-653b-4606-baf0-94f2d0e909bc None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:24.232788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:24.250558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 439/874] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:24 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:24.256791 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36ce16-1989-4859-be8c-b0e82daad1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:24.256791 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36ce16-1989-4859-be8c-b0e82daad1a7 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:24.256791 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36ce16-1989-4859-be8c-b0e82daad1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:24.256791 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36ce16-1989-4859-be8c-b0e82daad1a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:24.257150 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36ce16-1989-4859-be8c-b0e82daad1a7 None admin] RBAC: Adding query filter params (role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=4a54fa1c326f41e88688404a56b75c30) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:24.257150 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36ce16-1989-4859-be8c-b0e82daad1a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:24.257150 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36ce16-1989-4859-be8c-b0e82daad1a7 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:24.262731 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 436/875] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:24 2022] GET /identity/v3/role_assignments?user.id=4a54fa1c326f41e88688404a56b75c30&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:24.279570 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d82dec-0539-4e77-9afa-085879391167 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:24.401338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d82dec-0539-4e77-9afa-085879391167 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:24.441136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578f597-8e69-4c6e-b5e7-1cd204611205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:24.442059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578f597-8e69-4c6e-b5e7-1cd204611205 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:24.442493 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578f597-8e69-4c6e-b5e7-1cd204611205 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:24.442919 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578f597-8e69-4c6e-b5e7-1cd204611205 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:24.443818 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578f597-8e69-4c6e-b5e7-1cd204611205 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:24.445373 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578f597-8e69-4c6e-b5e7-1cd204611205 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:24.449727 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:24.539348 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 440/876] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 23 10:40:24 2022] POST /identity/v3/services => generated 269 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:40:25.242578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563191af-6256-493b-83a3-3f96db0e584d None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:25.243126 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563191af-6256-493b-83a3-3f96db0e584d None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:25.243126 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563191af-6256-493b-83a3-3f96db0e584d None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:25.245447 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 437/877] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:25.250639 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb35c7-b846-48c9-8cba-8becb98b66d5 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:25.251182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb35c7-b846-48c9-8cba-8becb98b66d5 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:25.251458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb35c7-b846-48c9-8cba-8becb98b66d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:25.269119 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-3fdb35c7-b846-48c9-8cba-8becb98b66d5 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:25.270294 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-3fdb35c7-b846-48c9-8cba-8becb98b66d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:25.345663 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 441/878] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:25.370239 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563191af-6256-493b-83a3-3f96db0e584d None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:25.478847 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563191af-6256-493b-83a3-3f96db0e584d None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:25.514738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62887b-2ea7-4492-bf04-dfbc2849ed96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:25.515935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62887b-2ea7-4492-bf04-dfbc2849ed96 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:25.516446 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62887b-2ea7-4492-bf04-dfbc2849ed96 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:25.516984 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62887b-2ea7-4492-bf04-dfbc2849ed96 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:25.529566 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62887b-2ea7-4492-bf04-dfbc2849ed96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:25.538047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-bc62887b-2ea7-4492-bf04-dfbc2849ed96 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:40:25.538047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:25.538047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:25.538047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:25.538047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:25.538047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:25.538047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:25.538047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:25.538047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:25.538047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:25.538047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:25.538047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:25.538047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:25.538047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:25.538047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:25.538047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:25.538980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:25.538980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:25.538980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:25.538980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:25.538980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:25.538980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:25.538980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:25.538980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:25.538980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:25.538980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:25.538980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:25.538980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:25.538980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:25.538980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:25.538980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:25.538980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:25.539825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:25.539825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:25.539825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:25.539825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:25.539825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:25.539825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:25.539825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:25.539825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:25.539825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:25.539825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:25.539825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:40:25.539825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:25.543435 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 438/879] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jun 23 10:40:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:25.549000 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb35c7-b846-48c9-8cba-8becb98b66d5 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:25.672709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb35c7-b846-48c9-8cba-8becb98b66d5 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:25.697690 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:25.722760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff502a1b-ab26-4e84-bb82-25c44a51e5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:25.722760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff502a1b-ab26-4e84-bb82-25c44a51e5a6 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:25.722760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff502a1b-ab26-4e84-bb82-25c44a51e5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:25.722760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff502a1b-ab26-4e84-bb82-25c44a51e5a6 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:25.723216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff502a1b-ab26-4e84-bb82-25c44a51e5a6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:25.723216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff502a1b-ab26-4e84-bb82-25c44a51e5a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:25.723617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff502a1b-ab26-4e84-bb82-25c44a51e5a6 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:25.735367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 442/880] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jun 23 10:40:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:25.745693 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62887b-2ea7-4492-bf04-dfbc2849ed96 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:25.791823 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:25.849818 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62887b-2ea7-4492-bf04-dfbc2849ed96 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:25.885124 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fcea5-9bfd-4e5f-9b05-0b52c6c56d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:25.886246 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fcea5-9bfd-4e5f-9b05-0b52c6c56d63 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:25.886757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fcea5-9bfd-4e5f-9b05-0b52c6c56d63 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:25.887228 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fcea5-9bfd-4e5f-9b05-0b52c6c56d63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:25.897656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fcea5-9bfd-4e5f-9b05-0b52c6c56d63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:25.899351 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fcea5-9bfd-4e5f-9b05-0b52c6c56d63 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:25.917676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-a27fcea5-9bfd-4e5f-9b05-0b52c6c56d63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:25.917676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:25.917676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:25.917676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:25.917676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:25.917676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:25.917676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:25.917676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:25.917676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:25.917676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:25.917676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:25.917676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:25.917676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:25.917676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:25.917676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:25.918571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:25.918571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:25.918571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:25.918571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:25.918571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:25.918571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:25.918571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:25.918571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:25.918571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:25.918571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:25.918571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:25.918571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:25.918571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:25.918571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:25.918571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:25.918571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:25.918571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:25.919469 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:25.919469 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:25.919469 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:25.919469 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:25.925752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 439/881] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:25.927020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff502a1b-ab26-4e84-bb82-25c44a51e5a6 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:26.102124 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff502a1b-ab26-4e84-bb82-25c44a51e5a6 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:26.159305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadaf6f-04da-405c-8f33-6c451d6fe29f None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:26.159938 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadaf6f-04da-405c-8f33-6c451d6fe29f None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:26.160412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadaf6f-04da-405c-8f33-6c451d6fe29f None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:26.166250 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 440/882] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:26.168113 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b5ebe-9a6a-4e28-bfa2-0c067ff09382 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:26.168689 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b5ebe-9a6a-4e28-bfa2-0c067ff09382 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:26.169172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b5ebe-9a6a-4e28-bfa2-0c067ff09382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:26.175723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88154571-9e98-4a05-bc84-75f98ba0ba7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:26.175723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88154571-9e98-4a05-bc84-75f98ba0ba7b None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:26.175947 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88154571-9e98-4a05-bc84-75f98ba0ba7b None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:26.176200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88154571-9e98-4a05-bc84-75f98ba0ba7b None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:26.176967 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88154571-9e98-4a05-bc84-75f98ba0ba7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:26.177280 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88154571-9e98-4a05-bc84-75f98ba0ba7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:26.178654 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88154571-9e98-4a05-bc84-75f98ba0ba7b None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:26.187264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-bf7b5ebe-9a6a-4e28-bfa2-0c067ff09382 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:26.188771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-bf7b5ebe-9a6a-4e28-bfa2-0c067ff09382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:26.207113 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 443/883] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:26.211769 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88154571-9e98-4a05-bc84-75f98ba0ba7b None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:26.287345 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:26.341090 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 441/884] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:26.358120 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b5ebe-9a6a-4e28-bfa2-0c067ff09382 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:26.358588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88154571-9e98-4a05-bc84-75f98ba0ba7b None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:26.389006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:26.404880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8645a91-41ca-49fd-b20b-2c0441031036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:26.406472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8645a91-41ca-49fd-b20b-2c0441031036 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:26.406919 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8645a91-41ca-49fd-b20b-2c0441031036 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:26.407499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8645a91-41ca-49fd-b20b-2c0441031036 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:26.417505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8645a91-41ca-49fd-b20b-2c0441031036 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:26.419831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8645a91-41ca-49fd-b20b-2c0441031036 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:26.440211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-b8645a91-41ca-49fd-b20b-2c0441031036 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:40:26.440211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:26.440211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:26.440211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:26.440211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:26.440211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:26.440211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:26.440211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:26.440211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:26.440211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:26.440211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:26.440211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:26.440211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:26.440211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:26.440211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:26.440211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:26.441312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:26.441312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:26.441312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:26.441312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:26.441312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:26.441312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:26.441312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:26.441312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:26.441312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:26.441312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:26.441312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:26.441312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:26.441312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:26.441312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:26.441312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:26.441312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:26.441312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:26.441312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:26.442247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:26.442247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:26.442247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:26.442247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:26.442247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:26.442247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:26.442247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:26.442247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:26.442247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:40:26.442247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:26.445070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 444/885] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 23 10:40:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:26.451702 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8645a91-41ca-49fd-b20b-2c0441031036 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:26.471342 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b5ebe-9a6a-4e28-bfa2-0c067ff09382 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:26.506287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5048a3-99ae-425c-b4ad-aae385d3bfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:26.507084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5048a3-99ae-425c-b4ad-aae385d3bfd0 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:26.507365 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5048a3-99ae-425c-b4ad-aae385d3bfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:26.507628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5048a3-99ae-425c-b4ad-aae385d3bfd0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:26.508281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5048a3-99ae-425c-b4ad-aae385d3bfd0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:26.510357 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5048a3-99ae-425c-b4ad-aae385d3bfd0 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:26.522373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-fe5048a3-99ae-425c-b4ad-aae385d3bfd0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:40:26.522373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:26.522373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:26.522373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:26.522373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:26.522373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:26.522373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:26.522373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:26.522373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:40:26.522373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:26.522373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:26.522373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:26.522373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:26.522373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:26.522373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:26.522373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:26.522373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:26.523414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:26.523414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:26.523414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:26.523414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:26.523414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:26.523414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:26.523414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:26.523414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:26.523414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:26.523414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:26.523414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:26.523414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:26.523414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:26.523414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:26.523414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:26.523414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:26.524243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:26.524243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:26.524243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:26.524243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:26.524243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:26.524243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:26.524243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:26.524243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:26.524243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:26.524243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:26.524243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:26.524243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:26.524243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:40:26.524243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:26.529174 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 442/886] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:40:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:26.530386 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5048a3-99ae-425c-b4ad-aae385d3bfd0 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:26.567568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8645a91-41ca-49fd-b20b-2c0441031036 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:26.570685 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:26.607347 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd32e9-c4cf-48e8-b1c2-e26209b0fada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:26.608448 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd32e9-c4cf-48e8-b1c2-e26209b0fada None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:26.608976 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd32e9-c4cf-48e8-b1c2-e26209b0fada None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:26.609461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd32e9-c4cf-48e8-b1c2-e26209b0fada None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:26.610539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd32e9-c4cf-48e8-b1c2-e26209b0fada None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:26.611053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd32e9-c4cf-48e8-b1c2-e26209b0fada None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:26.612760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd32e9-c4cf-48e8-b1c2-e26209b0fada None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:26.633313 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 445/887] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jun 23 10:40:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:26.639608 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c05716-957c-45bd-ac57-2f029aee678f None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:26.639608 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c05716-957c-45bd-ac57-2f029aee678f None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:26.639608 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c05716-957c-45bd-ac57-2f029aee678f None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:26.640768 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 446/888] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:26.642023 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c05716-957c-45bd-ac57-2f029aee678f None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:26.642326 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:26.655554 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5048a3-99ae-425c-b4ad-aae385d3bfd0 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:26.689528 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5d237-40a2-48ac-b8cb-b048135e582f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:26.690196 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5d237-40a2-48ac-b8cb-b048135e582f None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:26.690475 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5d237-40a2-48ac-b8cb-b048135e582f None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:26.690752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5d237-40a2-48ac-b8cb-b048135e582f None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:26.691456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5d237-40a2-48ac-b8cb-b048135e582f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:26.691758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5d237-40a2-48ac-b8cb-b048135e582f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:26.693165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5d237-40a2-48ac-b8cb-b048135e582f None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:26.698220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 443/889] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:40:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:26.699390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967475-5afc-42d1-b8df-19f2efc495a5 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:26.699674 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967475-5afc-42d1-b8df-19f2efc495a5 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:26.699955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967475-5afc-42d1-b8df-19f2efc495a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:26.716065 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-a8967475-5afc-42d1-b8df-19f2efc495a5 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:26.717262 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a8967475-5afc-42d1-b8df-19f2efc495a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:26.751401 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c05716-957c-45bd-ac57-2f029aee678f None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:26.783342 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 444/890] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:26.784430 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef7ca0-a9db-45c6-a649-279c0220e95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:26.784554 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583f504-fba4-4171-a044-d399b86da0a4 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:26.784815 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583f504-fba4-4171-a044-d399b86da0a4 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:26.785094 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583f504-fba4-4171-a044-d399b86da0a4 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:26.785209 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef7ca0-a9db-45c6-a649-279c0220e95d None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:26.785392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef7ca0-a9db-45c6-a649-279c0220e95d None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:26.785670 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef7ca0-a9db-45c6-a649-279c0220e95d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:26.786499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 445/891] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:26.789526 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583f504-fba4-4171-a044-d399b86da0a4 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:26.817553 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:26.855421 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef7ca0-a9db-45c6-a649-279c0220e95d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:26.856906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef7ca0-a9db-45c6-a649-279c0220e95d None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:26.875083 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:26.893620 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583f504-fba4-4171-a044-d399b86da0a4 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:26.927439 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3235f-3671-43f0-9d82-84d99bc17d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:26.928104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3235f-3671-43f0-9d82-84d99bc17d95 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:26.928384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3235f-3671-43f0-9d82-84d99bc17d95 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:26.928716 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3235f-3671-43f0-9d82-84d99bc17d95 None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:26.929760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3235f-3671-43f0-9d82-84d99bc17d95 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:26.930069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3235f-3671-43f0-9d82-84d99bc17d95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:26.932261 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3235f-3671-43f0-9d82-84d99bc17d95 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:26.937341 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 446/892] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:40:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:26.938595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914cbcd-1a27-4d09-91ee-a54e88ae04a6 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:26.938888 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914cbcd-1a27-4d09-91ee-a54e88ae04a6 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:26.939171 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914cbcd-1a27-4d09-91ee-a54e88ae04a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:26.955410 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-9914cbcd-1a27-4d09-91ee-a54e88ae04a6 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:26.955720 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 447/893] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:26 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:40:26.956555 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef7ca0-a9db-45c6-a649-279c0220e95d None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:26.956670 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-9914cbcd-1a27-4d09-91ee-a54e88ae04a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:27.020118 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:27.022857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 447/894] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:27.023684 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914cbcd-1a27-4d09-91ee-a54e88ae04a6 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:27.058121 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef7ca0-a9db-45c6-a649-279c0220e95d None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:27.090928 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2b06d-d337-4a40-9d36-3d49455bee56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:27.091730 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2b06d-d337-4a40-9d36-3d49455bee56 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:27.092020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2b06d-d337-4a40-9d36-3d49455bee56 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:27.092305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2b06d-d337-4a40-9d36-3d49455bee56 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:27.093171 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2b06d-d337-4a40-9d36-3d49455bee56 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:27.095139 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2b06d-d337-4a40-9d36-3d49455bee56 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:27.099135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:27.110528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-dfa2b06d-d337-4a40-9d36-3d49455bee56 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:40:27.110528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:27.110528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:27.110528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:27.110528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:27.110528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:27.110528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:27.110528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:27.110528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:40:27.110528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:27.110528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:27.110528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:27.110528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:27.110528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:27.110528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:27.110528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:27.110528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:27.111601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:27.111601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:27.111601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:27.111601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:27.111601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:27.111601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:27.111601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:27.111601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:27.111601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:27.111601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:27.111601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:27.111601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:27.111601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:27.111601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:27.111601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:27.111601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:27.112461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:27.112461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:27.112461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:27.112461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:27.112461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:27.112461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:27.112461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:27.112461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:27.112461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:27.112461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:27.112461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:27.112461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:27.112461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:40:27.112461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:27.112461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 448/895] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 23 10:40:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:27.113303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2b06d-d337-4a40-9d36-3d49455bee56 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:27.125331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914cbcd-1a27-4d09-91ee-a54e88ae04a6 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:27.160259 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366baa4-7c9f-40b3-bb7b-d085a0fa557a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:27.160959 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366baa4-7c9f-40b3-bb7b-d085a0fa557a None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:27.161245 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366baa4-7c9f-40b3-bb7b-d085a0fa557a None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:27.161523 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366baa4-7c9f-40b3-bb7b-d085a0fa557a None admin] PATH_INFO: `/v3/endpoints` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:27.162310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366baa4-7c9f-40b3-bb7b-d085a0fa557a None admin] RBAC: Adding query filter params (interface=public, service_id=fe40646cf11844bc8330b08ba74d0d9c, region_id=RegionOne) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:27.162625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366baa4-7c9f-40b3-bb7b-d085a0fa557a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:27.164004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366baa4-7c9f-40b3-bb7b-d085a0fa557a None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:27.169252 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 448/896] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jun 23 10:40:27 2022] GET /identity/v3/endpoints?service_id=fe40646cf11844bc8330b08ba74d0d9c&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:27.170040 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366baa4-7c9f-40b3-bb7b-d085a0fa557a None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:27.216213 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2b06d-d337-4a40-9d36-3d49455bee56 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:27.241090 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:27.249959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a65d5-382b-47bd-a491-6354307bf935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:27.251018 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a65d5-382b-47bd-a491-6354307bf935 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:27.251304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a65d5-382b-47bd-a491-6354307bf935 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:27.251584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a65d5-382b-47bd-a491-6354307bf935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:27.262577 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a65d5-382b-47bd-a491-6354307bf935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:27.264028 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a65d5-382b-47bd-a491-6354307bf935 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:27.268579 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366baa4-7c9f-40b3-bb7b-d085a0fa557a None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:27.281184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-ab1a65d5-382b-47bd-a491-6354307bf935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:27.281184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:27.281184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:27.281184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:27.281184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:27.281184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:27.281184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:27.281184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:27.281184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:27.281184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:27.281184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:27.281184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:27.281184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:27.281184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:27.281184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:27.282111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:27.282111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:27.282111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:27.282111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:27.282111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:27.282111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:27.282111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:27.282111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:27.282111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:27.282111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:27.282111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:27.282111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:27.282111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:27.282111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:27.282111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:27.282111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:27.282111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:27.282998 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:27.282998 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:27.282998 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:27.282998 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:27.282998 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 449/897] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:27.283367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a65d5-382b-47bd-a491-6354307bf935 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:27.305298 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861b25c-401e-4f32-b7bf-b597d3b0739e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:27.306785 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861b25c-401e-4f32-b7bf-b597d3b0739e None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:27.307034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861b25c-401e-4f32-b7bf-b597d3b0739e None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:27.307308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861b25c-401e-4f32-b7bf-b597d3b0739e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:27.307961 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861b25c-401e-4f32-b7bf-b597d3b0739e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:27.309369 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861b25c-401e-4f32-b7bf-b597d3b0739e None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:27.322069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-1861b25c-401e-4f32-b7bf-b597d3b0739e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:40:27.322069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:27.322069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:27.322069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:27.322069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:27.322069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:27.322069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:27.322069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:27.322069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:40:27.322069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:27.322069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:27.322069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:27.322069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:27.322069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:27.322069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:27.322069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:27.323054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:27.323054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:27.323054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:27.323054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:27.323054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:27.323054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:27.323054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:27.323054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:27.323054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:27.323054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:27.323054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:27.323054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:27.323054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:27.323054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:27.323054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:27.323054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:27.323886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:27.323886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:27.323886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:27.323886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:27.323886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:27.323886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:27.323886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:27.323886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:27.323886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:27.323886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:27.323886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:27.323886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:27.323886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:27.323886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:40:27.323886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:27.323886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 449/898] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Jun 23 10:40:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:27.325442 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861b25c-401e-4f32-b7bf-b597d3b0739e None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:27.328354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:27.386639 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a65d5-382b-47bd-a491-6354307bf935 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:27.420273 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bdec7-5400-467e-b0f6-07c856e39629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:27.420966 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bdec7-5400-467e-b0f6-07c856e39629 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:27.421256 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bdec7-5400-467e-b0f6-07c856e39629 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:27.421533 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bdec7-5400-467e-b0f6-07c856e39629 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:27.422238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bdec7-5400-467e-b0f6-07c856e39629 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:27.422547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bdec7-5400-467e-b0f6-07c856e39629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:27.423910 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709bdec7-5400-467e-b0f6-07c856e39629 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:27.425449 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861b25c-401e-4f32-b7bf-b597d3b0739e None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:27.428429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 450/899] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 23 10:40:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:27.429243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bdec7-5400-467e-b0f6-07c856e39629 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:27.460180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de38d6a-c2de-4b17-adf6-2aaf0159bcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:27.460872 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de38d6a-c2de-4b17-adf6-2aaf0159bcb4 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:27.461159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de38d6a-c2de-4b17-adf6-2aaf0159bcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:27.461436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de38d6a-c2de-4b17-adf6-2aaf0159bcb4 None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:27.462182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de38d6a-c2de-4b17-adf6-2aaf0159bcb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:27.463616 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de38d6a-c2de-4b17-adf6-2aaf0159bcb4 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:27.469165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 450/900] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jun 23 10:40:27 2022] GET /identity/v3/services => generated 1268 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:40:27.470005 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de38d6a-c2de-4b17-adf6-2aaf0159bcb4 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:27.482602 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:27.546745 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bdec7-5400-467e-b0f6-07c856e39629 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:27.554350 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:27.585369 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df2cca-75fc-4527-9ad2-708a5ec01cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:27.586165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df2cca-75fc-4527-9ad2-708a5ec01cb5 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:27.586453 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df2cca-75fc-4527-9ad2-708a5ec01cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:27.586725 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df2cca-75fc-4527-9ad2-708a5ec01cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:27.588345 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df2cca-75fc-4527-9ad2-708a5ec01cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:27.588686 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df2cca-75fc-4527-9ad2-708a5ec01cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:27.590121 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df2cca-75fc-4527-9ad2-708a5ec01cb5 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:27.592628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de38d6a-c2de-4b17-adf6-2aaf0159bcb4 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:27.607729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 451/901] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:27.607729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df2cca-75fc-4527-9ad2-708a5ec01cb5 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:27.644464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8b539-0fdb-4d22-8f86-f946cb51db57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:27.646764 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8b539-0fdb-4d22-8f86-f946cb51db57 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:27.646764 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8b539-0fdb-4d22-8f86-f946cb51db57 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:27.647125 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8b539-0fdb-4d22-8f86-f946cb51db57 None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:27.647848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8b539-0fdb-4d22-8f86-f946cb51db57 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:27.648157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8b539-0fdb-4d22-8f86-f946cb51db57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:27.649589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8b539-0fdb-4d22-8f86-f946cb51db57 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:27.655051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 451/902] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 23 10:40:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:27.655901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8b539-0fdb-4d22-8f86-f946cb51db57 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:27.725372 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df2cca-75fc-4527-9ad2-708a5ec01cb5 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:27.726870 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:27.764144 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b9741-2b74-49d6-bd01-ca1673f05fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:27.764847 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b9741-2b74-49d6-bd01-ca1673f05fa1 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:27.765131 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b9741-2b74-49d6-bd01-ca1673f05fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:27.765407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b9741-2b74-49d6-bd01-ca1673f05fa1 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:27.766119 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b9741-2b74-49d6-bd01-ca1673f05fa1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:27.766429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b9741-2b74-49d6-bd01-ca1673f05fa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:27.767361 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8b539-0fdb-4d22-8f86-f946cb51db57 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:27.767797 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b9741-2b74-49d6-bd01-ca1673f05fa1 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:27.772710 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 452/903] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 23 10:40:27 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:27.773361 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b9741-2b74-49d6-bd01-ca1673f05fa1 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:27.815426 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:27.821064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431137a-073f-4003-b4b5-86cbb771695d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:27.826508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431137a-073f-4003-b4b5-86cbb771695d None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:27.826508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431137a-073f-4003-b4b5-86cbb771695d None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:27.826508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431137a-073f-4003-b4b5-86cbb771695d None admin] PATH_INFO: `/v3/projects/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:27.832968 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431137a-073f-4003-b4b5-86cbb771695d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:27.835076 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431137a-073f-4003-b4b5-86cbb771695d None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:27.852856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-9431137a-073f-4003-b4b5-86cbb771695d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:27.852856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:27.852856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:27.852856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:27.852856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:27.852856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:27.852856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:27.852856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:27.852856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:27.852856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:27.852856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:27.852856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:27.852856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:27.852856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:27.852856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:27.854323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:27.854323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:27.854323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:27.854323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:27.854323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:27.854323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:27.854323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:27.854323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:27.854323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:27.854323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:27.854323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:27.854323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:27.854323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:27.854323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:27.854323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:27.854323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:27.854323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:27.855227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:27.855227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:27.855227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:27.855227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:27.855227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:27.855227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:27.855227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:27.855227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:27.862604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 452/904] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:27.864320 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431137a-073f-4003-b4b5-86cbb771695d None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:27.908736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b9741-2b74-49d6-bd01-ca1673f05fa1 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:27.956852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668006d1-a50f-4257-81fa-12b5bac5cf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:27.957630 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668006d1-a50f-4257-81fa-12b5bac5cf4c None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:27.957984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668006d1-a50f-4257-81fa-12b5bac5cf4c None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:27.958335 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668006d1-a50f-4257-81fa-12b5bac5cf4c None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:27.959788 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668006d1-a50f-4257-81fa-12b5bac5cf4c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:27.960102 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668006d1-a50f-4257-81fa-12b5bac5cf4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:27.961507 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668006d1-a50f-4257-81fa-12b5bac5cf4c None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:27.972286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 453/905] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 23 10:40:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:27.973569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668006d1-a50f-4257-81fa-12b5bac5cf4c None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:27.986406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431137a-073f-4003-b4b5-86cbb771695d None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:28.005150 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:28.026182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e92b3f-b3ad-49f5-acff-5133c2b1ba20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:28.026853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e92b3f-b3ad-49f5-acff-5133c2b1ba20 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:28.027139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e92b3f-b3ad-49f5-acff-5133c2b1ba20 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:28.027413 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e92b3f-b3ad-49f5-acff-5133c2b1ba20 None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:28.028207 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e92b3f-b3ad-49f5-acff-5133c2b1ba20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:28.028519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e92b3f-b3ad-49f5-acff-5133c2b1ba20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:28.029997 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e92b3f-b3ad-49f5-acff-5133c2b1ba20 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:28.048876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 453/906] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:28.050269 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e92b3f-b3ad-49f5-acff-5133c2b1ba20 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:28.080003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668006d1-a50f-4257-81fa-12b5bac5cf4c None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:28.108107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:28.115497 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3eeff-8e6c-4eb0-bbd6-786b25979d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:28.123827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3eeff-8e6c-4eb0-bbd6-786b25979d8a None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:28.123827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3eeff-8e6c-4eb0-bbd6-786b25979d8a None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:28.123827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3eeff-8e6c-4eb0-bbd6-786b25979d8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:28.123827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3eeff-8e6c-4eb0-bbd6-786b25979d8a None admin] RBAC: Adding query filter params (interface=public, service_id=94ff9669a7504fc5b82011d26ff1ee02, region_id=RegionOne) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:28.123827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3eeff-8e6c-4eb0-bbd6-786b25979d8a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:28.123827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3eeff-8e6c-4eb0-bbd6-786b25979d8a None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:28.125037 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 454/907] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jun 23 10:40:27 2022] GET /identity/v3/endpoints?service_id=94ff9669a7504fc5b82011d26ff1ee02&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:28.130776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3eeff-8e6c-4eb0-bbd6-786b25979d8a None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:28.163608 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e92b3f-b3ad-49f5-acff-5133c2b1ba20 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:28.206635 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27b615-65b6-449b-99ba-2353ddb9b915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:28.207711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27b615-65b6-449b-99ba-2353ddb9b915 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:28.208204 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27b615-65b6-449b-99ba-2353ddb9b915 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:28.208708 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27b615-65b6-449b-99ba-2353ddb9b915 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:28.209749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27b615-65b6-449b-99ba-2353ddb9b915 None admin] RBAC: Adding query filter params (role.id=ee4d134c98a24de99a5426a2ad83b147, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=1b03d940626a449dbe904f02f3d70854) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:28.210260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27b615-65b6-449b-99ba-2353ddb9b915 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:28.212713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27b615-65b6-449b-99ba-2353ddb9b915 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:28.219366 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 454/908] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:28 2022] GET /identity/v3/role_assignments?user.id=1b03d940626a449dbe904f02f3d70854&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=ee4d134c98a24de99a5426a2ad83b147 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:28.241174 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:28.249527 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3eeff-8e6c-4eb0-bbd6-786b25979d8a None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:28.288398 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f6aec-8e93-45ce-8175-cbf3dd7d8d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:28.289134 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f6aec-8e93-45ce-8175-cbf3dd7d8d98 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:28.289424 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f6aec-8e93-45ce-8175-cbf3dd7d8d98 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:28.289705 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f6aec-8e93-45ce-8175-cbf3dd7d8d98 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:28.291051 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f6aec-8e93-45ce-8175-cbf3dd7d8d98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:28.292474 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f6aec-8e93-45ce-8175-cbf3dd7d8d98 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:28.299493 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 455/909] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jun 23 10:40:28 2022] GET /identity/v3/services => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:40:29.545192 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479852da-4680-4a7b-b414-32775a7f8423 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:29.545704 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479852da-4680-4a7b-b414-32775a7f8423 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:29.545974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479852da-4680-4a7b-b414-32775a7f8423 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:29.547515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 455/910] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:29.552616 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c1f85-d553-4a30-a3f7-38a7354cd433 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:29.553018 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c1f85-d553-4a30-a3f7-38a7354cd433 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:29.553210 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c1f85-d553-4a30-a3f7-38a7354cd433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:29.570236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-093c1f85-d553-4a30-a3f7-38a7354cd433 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:29.571575 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-093c1f85-d553-4a30-a3f7-38a7354cd433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:29.640671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 456/911] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:29.665551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479852da-4680-4a7b-b414-32775a7f8423 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:29.771012 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479852da-4680-4a7b-b414-32775a7f8423 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:29.787655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:29.810816 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60021642-6b66-42e9-ada4-200dd9f82934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:29.810816 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60021642-6b66-42e9-ada4-200dd9f82934 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:29.810816 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60021642-6b66-42e9-ada4-200dd9f82934 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:29.810816 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60021642-6b66-42e9-ada4-200dd9f82934 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:29.811289 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60021642-6b66-42e9-ada4-200dd9f82934 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:29.811289 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60021642-6b66-42e9-ada4-200dd9f82934 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:29.823007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-60021642-6b66-42e9-ada4-200dd9f82934 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:40:29.823007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:29.823007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:29.823007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:29.823007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:29.823007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:29.823007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:29.823007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:29.823007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:40:29.823007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:29.823007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:29.823007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:29.823007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:29.823007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:29.823007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:29.823007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:29.823007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:29.823971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:29.823971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:29.823971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:29.823971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:29.823971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:29.823971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:29.823971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:29.823971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:29.823971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:29.823971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:29.823971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:29.823971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:29.823971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:29.823971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:29.823971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:29.823971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:29.824840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:29.824840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:29.824840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:29.824840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:29.824840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:29.824840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:29.824840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:29.824840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:29.824840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:29.824840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:29.824840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:29.824840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:29.824840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:40:29.824840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:29.824840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 456/912] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:40:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:29.830325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c1f85-d553-4a30-a3f7-38a7354cd433 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:29.921023 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:29.933211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c1f85-d553-4a30-a3f7-38a7354cd433 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:29.949660 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c088fc-1e01-4991-a29e-a21b8ca840f4 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:29.950300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c088fc-1e01-4991-a29e-a21b8ca840f4 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:29.950797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c088fc-1e01-4991-a29e-a21b8ca840f4 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:29.952591 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 457/913] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:40:29.957974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69031b9-518f-4395-b008-9a78bbb6d140 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:29.958503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69031b9-518f-4395-b008-9a78bbb6d140 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:29.958995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69031b9-518f-4395-b008-9a78bbb6d140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:29.969678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f7ebd-78d1-4e71-9851-bfed7f2cccc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:29.970399 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7ebd-78d1-4e71-9851-bfed7f2cccc3 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:29.970686 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7ebd-78d1-4e71-9851-bfed7f2cccc3 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:29.970966 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7ebd-78d1-4e71-9851-bfed7f2cccc3 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:29.971683 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f7ebd-78d1-4e71-9851-bfed7f2cccc3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:29.971994 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f7ebd-78d1-4e71-9851-bfed7f2cccc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:29.973551 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f7ebd-78d1-4e71-9851-bfed7f2cccc3 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:29.980615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-c69031b9-518f-4395-b008-9a78bbb6d140 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:29.981556 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 457/914] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:40:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:29.982297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c69031b9-518f-4395-b008-9a78bbb6d140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:29.986998 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f7ebd-78d1-4e71-9851-bfed7f2cccc3 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:30.061046 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 458/915] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:30.085326 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69031b9-518f-4395-b008-9a78bbb6d140 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:30.099562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f7ebd-78d1-4e71-9851-bfed7f2cccc3 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:30.145963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3b3a6-df42-4ace-84c2-b01ba85cde7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:30.147466 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3b3a6-df42-4ace-84c2-b01ba85cde7a None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:30.148227 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3b3a6-df42-4ace-84c2-b01ba85cde7a None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:30.148736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3b3a6-df42-4ace-84c2-b01ba85cde7a None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:30.149896 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3b3a6-df42-4ace-84c2-b01ba85cde7a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:30.150407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3b3a6-df42-4ace-84c2-b01ba85cde7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:30.152596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3b3a6-df42-4ace-84c2-b01ba85cde7a None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:30.159472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 458/916] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 23 10:40:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:30.165447 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3b3a6-df42-4ace-84c2-b01ba85cde7a None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:30.189278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:30.190208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69031b9-518f-4395-b008-9a78bbb6d140 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:30.213030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:30.229869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d54571-5d39-43e0-9b10-709bdd12c7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:30.230387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d54571-5d39-43e0-9b10-709bdd12c7ff None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:30.230672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d54571-5d39-43e0-9b10-709bdd12c7ff None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:30.230950 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d54571-5d39-43e0-9b10-709bdd12c7ff None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:30.231737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d54571-5d39-43e0-9b10-709bdd12c7ff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:30.233235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d54571-5d39-43e0-9b10-709bdd12c7ff None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:30.286455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3b3a6-df42-4ace-84c2-b01ba85cde7a None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:30.300687 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 459/917] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 23 10:40:30 2022] POST /identity/v3/services => generated 241 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:40:30.326399 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddcac8-736f-439e-bda6-9a27dd55ac30 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:30.326789 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddcac8-736f-439e-bda6-9a27dd55ac30 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:30.327162 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddcac8-736f-439e-bda6-9a27dd55ac30 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:30.329043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 460/918] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:40:30.334511 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f1558-ca7b-4369-9178-8b173a80b5be None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:30.334954 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f1558-ca7b-4369-9178-8b173a80b5be None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:30.335264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f1558-ca7b-4369-9178-8b173a80b5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:30.354428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-005f1558-ca7b-4369-9178-8b173a80b5be None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:30.355633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-005f1558-ca7b-4369-9178-8b173a80b5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:30.355738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca85cf-9b86-4f7b-b8ce-df52e401bec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:30.356445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca85cf-9b86-4f7b-b8ce-df52e401bec3 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:30.356831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca85cf-9b86-4f7b-b8ce-df52e401bec3 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:30.357223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca85cf-9b86-4f7b-b8ce-df52e401bec3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:30.358048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca85cf-9b86-4f7b-b8ce-df52e401bec3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:30.359551 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca85cf-9b86-4f7b-b8ce-df52e401bec3 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:30.429834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 461/919] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:30.431629 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f00bf-d6a4-4e12-9296-a738ee7e4232 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:30.431921 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f00bf-d6a4-4e12-9296-a738ee7e4232 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:30.432215 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f00bf-d6a4-4e12-9296-a738ee7e4232 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:30.433937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 462/920] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:30.437226 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 459/921] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jun 23 10:40:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:40:30.439305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188bf50-efec-43fd-b079-52c8237dde07 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:30.439599 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188bf50-efec-43fd-b079-52c8237dde07 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:30.439878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188bf50-efec-43fd-b079-52c8237dde07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:30.454574 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca85cf-9b86-4f7b-b8ce-df52e401bec3 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:30.464056 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-9188bf50-efec-43fd-b079-52c8237dde07 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:30.465416 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-9188bf50-efec-43fd-b079-52c8237dde07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:30.553375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:30.567701 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 463/922] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:30.594399 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188bf50-efec-43fd-b079-52c8237dde07 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:30.600530 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca85cf-9b86-4f7b-b8ce-df52e401bec3 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:30.627276 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:30.653397 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e35ab-044a-48da-81c4-43e95e00109e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:30.654309 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e35ab-044a-48da-81c4-43e95e00109e None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:30.654605 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e35ab-044a-48da-81c4-43e95e00109e None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:30.654890 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e35ab-044a-48da-81c4-43e95e00109e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:30.670203 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e35ab-044a-48da-81c4-43e95e00109e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:30.679494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-6e5e35ab-044a-48da-81c4-43e95e00109e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:40:30.679494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:30.679494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:30.679494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:30.679494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:30.679494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:30.679494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:30.679494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:30.679494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:30.679494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:30.679494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:30.679494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:30.679494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:30.679494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:30.679494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:30.679494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:30.681310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:30.681310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:30.681310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:30.681310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:30.681310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:30.681310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:30.681310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:30.681310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:30.681310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:30.681310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:30.681310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:30.681310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:30.681310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:30.681310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:30.681310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:30.681310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:30.682170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:30.682170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:30.682170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:30.682170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:30.682170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:30.682170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:30.682170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:30.682170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:30.682170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:30.682170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:30.682170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:40:30.682170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:30.682170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 460/923] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jun 23 10:40:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:30.690652 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e35ab-044a-48da-81c4-43e95e00109e None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:30.717551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188bf50-efec-43fd-b079-52c8237dde07 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:30.762799 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a2435-68f5-4707-983f-79c44c6fc07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:30.763630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a2435-68f5-4707-983f-79c44c6fc07a None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:30.763920 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a2435-68f5-4707-983f-79c44c6fc07a None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:30.764453 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a2435-68f5-4707-983f-79c44c6fc07a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:30.765162 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a2435-68f5-4707-983f-79c44c6fc07a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:30.767159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a2435-68f5-4707-983f-79c44c6fc07a None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:30.783504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-4c6a2435-68f5-4707-983f-79c44c6fc07a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:40:30.783504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:30.783504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:30.783504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:30.783504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:30.783504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:30.783504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:30.783504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:30.783504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:40:30.783504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:30.783504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:30.783504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:30.783504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:30.783504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:30.783504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:30.783504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:30.784497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:30.784497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:30.784497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:30.784497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:30.784497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:30.784497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:30.784497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:30.784497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:30.784497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:30.784497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:30.784497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:30.784497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:30.784497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:30.784497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:30.784497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:30.784497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:30.785358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:30.785358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:30.785358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:30.785358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:30.785358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:30.785358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:30.785358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:30.785358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:30.785358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:30.785358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:30.785358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:30.785358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:30.785358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:30.785358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:40:30.785358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:30.785358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 464/924] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Jun 23 10:40:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:30.790905 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a2435-68f5-4707-983f-79c44c6fc07a None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:30.807747 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e35ab-044a-48da-81c4-43e95e00109e None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:30.837386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:30.851121 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1ace2-1813-4ade-867c-4c144d336d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:30.851382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1ace2-1813-4ade-867c-4c144d336d16 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:30.851672 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1ace2-1813-4ade-867c-4c144d336d16 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:30.851945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1ace2-1813-4ade-867c-4c144d336d16 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:30.852776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1ace2-1813-4ade-867c-4c144d336d16 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:30.853093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1ace2-1813-4ade-867c-4c144d336d16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:30.854453 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1ace2-1813-4ade-867c-4c144d336d16 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:30.864603 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 461/925] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jun 23 10:40:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:30.870767 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1ace2-1813-4ade-867c-4c144d336d16 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:30.897973 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:30.909075 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a2435-68f5-4707-983f-79c44c6fc07a None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:30.947291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48998706-b981-433f-b3b5-1f490e77c358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:30.948335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48998706-b981-433f-b3b5-1f490e77c358 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:30.948909 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48998706-b981-433f-b3b5-1f490e77c358 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:30.949400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48998706-b981-433f-b3b5-1f490e77c358 None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:30.950313 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48998706-b981-433f-b3b5-1f490e77c358 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:30.950830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48998706-b981-433f-b3b5-1f490e77c358 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:30.952472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48998706-b981-433f-b3b5-1f490e77c358 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:30.963207 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 465/926] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 23 10:40:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:30.964390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48998706-b981-433f-b3b5-1f490e77c358 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:30.977341 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1ace2-1813-4ade-867c-4c144d336d16 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:31.013586 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aaea16-0e39-4b11-ae16-4f40655ddcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:31.014598 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaea16-0e39-4b11-ae16-4f40655ddcce None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:31.014810 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaea16-0e39-4b11-ae16-4f40655ddcce None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:31.015210 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaea16-0e39-4b11-ae16-4f40655ddcce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:31.026308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aaea16-0e39-4b11-ae16-4f40655ddcce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:31.027812 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aaea16-0e39-4b11-ae16-4f40655ddcce None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:31.047022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-56aaea16-0e39-4b11-ae16-4f40655ddcce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:31.047022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:31.047022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:31.047022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:31.047022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:31.047022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:31.047022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:31.047022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:31.047022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:31.047022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:31.047022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:31.047022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:31.047022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:31.047022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:31.047022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:31.047969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:31.047969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:31.047969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:31.047969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:31.047969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:31.047969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:31.047969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:31.047969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:31.047969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:31.047969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:31.047969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:31.047969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:31.047969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:31.047969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:31.047969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:31.047969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:31.047969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:31.048911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:31.048911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:31.048911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:31.048911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:31.053005 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 462/927] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:31.053912 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aaea16-0e39-4b11-ae16-4f40655ddcce None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:31.080166 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48998706-b981-433f-b3b5-1f490e77c358 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:31.099821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:31.120258 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a03b6-2368-498b-8dc8-e084d7e8e60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:31.120258 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a03b6-2368-498b-8dc8-e084d7e8e60a None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:31.120871 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a03b6-2368-498b-8dc8-e084d7e8e60a None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:31.121369 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a03b6-2368-498b-8dc8-e084d7e8e60a None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:31.122295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a03b6-2368-498b-8dc8-e084d7e8e60a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:31.122807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a03b6-2368-498b-8dc8-e084d7e8e60a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:31.124380 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a03b6-2368-498b-8dc8-e084d7e8e60a None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:31.134953 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 466/928] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 23 10:40:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:31.136077 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a03b6-2368-498b-8dc8-e084d7e8e60a None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:31.157796 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:31.160814 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aaea16-0e39-4b11-ae16-4f40655ddcce None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:31.199000 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c85821-57b5-4df4-8975-073b5ad4e734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:31.199850 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c85821-57b5-4df4-8975-073b5ad4e734 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:31.200137 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c85821-57b5-4df4-8975-073b5ad4e734 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:31.200410 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c85821-57b5-4df4-8975-073b5ad4e734 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:31.201264 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c85821-57b5-4df4-8975-073b5ad4e734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:31.201574 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c85821-57b5-4df4-8975-073b5ad4e734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:31.202933 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c85821-57b5-4df4-8975-073b5ad4e734 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:31.220162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 463/929] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:31.221075 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c85821-57b5-4df4-8975-073b5ad4e734 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:31.250240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a03b6-2368-498b-8dc8-e084d7e8e60a None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:31.294046 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba402919-dcf6-4b0c-868d-9f356baf1f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:31.294979 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba402919-dcf6-4b0c-868d-9f356baf1f04 None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:31.295282 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba402919-dcf6-4b0c-868d-9f356baf1f04 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:31.295544 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba402919-dcf6-4b0c-868d-9f356baf1f04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:31.296294 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba402919-dcf6-4b0c-868d-9f356baf1f04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:31.298501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba402919-dcf6-4b0c-868d-9f356baf1f04 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:31.337823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c85821-57b5-4df4-8975-073b5ad4e734 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:31.339652 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:31.372840 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11de46-b577-462f-9908-a52e47f2809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:31.373586 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11de46-b577-462f-9908-a52e47f2809a None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:31.373874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11de46-b577-462f-9908-a52e47f2809a None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:31.374153 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11de46-b577-462f-9908-a52e47f2809a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:31.383249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11de46-b577-462f-9908-a52e47f2809a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:31.384818 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11de46-b577-462f-9908-a52e47f2809a None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:31.388082 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 467/930] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jun 23 10:40:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:40:31.414064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-0c11de46-b577-462f-9908-a52e47f2809a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:40:31.414064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:31.414064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:31.414064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:31.414064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:31.414064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:31.414064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:31.414064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:31.414064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:31.414064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:31.414064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:31.414064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:31.414064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:31.414064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:31.414064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:31.414064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:31.415748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:31.415748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:31.415748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:31.415748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:31.415748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:31.415748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:31.415748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:31.415748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:31.415748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:31.415748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:31.415748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:31.415748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:31.415748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:31.415748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:31.415748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:31.415748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:31.415748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:31.415748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:31.416751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:31.416751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:31.416751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:31.416751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:31.416751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:31.416751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:31.416751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:31.416751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:31.416751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:40:31.416751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:31.416751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 464/931] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 23 10:40:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:31.422210 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba402919-dcf6-4b0c-868d-9f356baf1f04 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:31.509726 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:31.553294 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba402919-dcf6-4b0c-868d-9f356baf1f04 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:31.596126 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641479e-ed5e-4900-9b4a-eca2e9e9a015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:31.597039 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641479e-ed5e-4900-9b4a-eca2e9e9a015 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:31.597213 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641479e-ed5e-4900-9b4a-eca2e9e9a015 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:31.597545 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641479e-ed5e-4900-9b4a-eca2e9e9a015 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:31.598291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641479e-ed5e-4900-9b4a-eca2e9e9a015 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:31.598606 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641479e-ed5e-4900-9b4a-eca2e9e9a015 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:31.602790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641479e-ed5e-4900-9b4a-eca2e9e9a015 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:31.630423 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 468/932] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jun 23 10:40:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:31.637391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11de46-b577-462f-9908-a52e47f2809a None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:31.749437 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11de46-b577-462f-9908-a52e47f2809a None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:31.785162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200fcb3-ca6c-48eb-8bec-22d904cb8484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:31.785959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200fcb3-ca6c-48eb-8bec-22d904cb8484 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:31.786244 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200fcb3-ca6c-48eb-8bec-22d904cb8484 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:31.786524 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200fcb3-ca6c-48eb-8bec-22d904cb8484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:31.797735 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200fcb3-ca6c-48eb-8bec-22d904cb8484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:31.799189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200fcb3-ca6c-48eb-8bec-22d904cb8484 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:31.817632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-7200fcb3-ca6c-48eb-8bec-22d904cb8484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:31.817632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:31.817632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:31.817632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:31.817632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:31.817632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:31.817632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:31.817632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:31.817632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:31.817632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:31.817632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:31.817632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:31.817632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:31.817632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:31.817632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:31.818695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:31.818695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:31.818695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:31.818695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:31.818695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:31.818695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:31.818695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:31.818695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:31.818695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:31.818695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:31.818695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:31.818695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:31.818695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:31.818695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:31.818695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:31.818695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:31.818695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:31.819653 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:31.819653 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:31.819653 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:31.819653 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:31.819653 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 465/933] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:31.826565 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641479e-ed5e-4900-9b4a-eca2e9e9a015 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:31.935433 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641479e-ed5e-4900-9b4a-eca2e9e9a015 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:31.962245 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:31.971104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23aed44-6295-4538-a9e5-5ca409a49667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:31.971773 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23aed44-6295-4538-a9e5-5ca409a49667 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:31.972070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23aed44-6295-4538-a9e5-5ca409a49667 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:31.972338 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23aed44-6295-4538-a9e5-5ca409a49667 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:31.973093 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23aed44-6295-4538-a9e5-5ca409a49667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:31.980799 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23aed44-6295-4538-a9e5-5ca409a49667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:31.980799 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23aed44-6295-4538-a9e5-5ca409a49667 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:31.987510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 469/934] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:31.994807 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200fcb3-ca6c-48eb-8bec-22d904cb8484 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:32.012031 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:32.105269 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200fcb3-ca6c-48eb-8bec-22d904cb8484 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:32.142999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a126e-d3d4-4534-a010-5fed4a74ab89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:32.144225 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a126e-d3d4-4534-a010-5fed4a74ab89 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:32.144750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a126e-d3d4-4534-a010-5fed4a74ab89 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:32.145246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a126e-d3d4-4534-a010-5fed4a74ab89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:32.153465 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a126e-d3d4-4534-a010-5fed4a74ab89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:32.155197 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a126e-d3d4-4534-a010-5fed4a74ab89 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:32.170845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-157a126e-d3d4-4534-a010-5fed4a74ab89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:32.170845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:32.170845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:32.170845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:32.170845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:32.170845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:32.170845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:32.170845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:32.170845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:32.170845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:32.170845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:32.170845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:32.170845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:32.170845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:32.170845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:32.171804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:32.171804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:32.171804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:32.171804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:32.171804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:32.171804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:32.171804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:32.171804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:32.171804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:32.171804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:32.171804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:32.171804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:32.171804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:32.171804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:32.171804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:32.171804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:32.171804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:32.172717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:32.172717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:32.172717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:32.172717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:32.172717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:32.172717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:32.172717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:32.172717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:32.175267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 466/935] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:32.181553 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23aed44-6295-4538-a9e5-5ca409a49667 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:32.291226 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23aed44-6295-4538-a9e5-5ca409a49667 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:32.328720 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb13a16-cfeb-45e3-914d-454c7f7bd5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:32.329787 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb13a16-cfeb-45e3-914d-454c7f7bd5c3 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:32.330290 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb13a16-cfeb-45e3-914d-454c7f7bd5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:32.330846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb13a16-cfeb-45e3-914d-454c7f7bd5c3 None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:32.331855 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb13a16-cfeb-45e3-914d-454c7f7bd5c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:32.332384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb13a16-cfeb-45e3-914d-454c7f7bd5c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:32.334048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb13a16-cfeb-45e3-914d-454c7f7bd5c3 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:32.348319 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 470/936] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:32.354937 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a126e-d3d4-4534-a010-5fed4a74ab89 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:32.435384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:32.461867 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a126e-d3d4-4534-a010-5fed4a74ab89 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:32.491339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df5ee4-def7-4641-bd40-0de40e457566 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:32.491674 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df5ee4-def7-4641-bd40-0de40e457566 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:32.491905 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df5ee4-def7-4641-bd40-0de40e457566 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:32.497919 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 471/937] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:32.498144 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70e901-b402-47e4-9473-3dbf556381d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:32.498992 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70e901-b402-47e4-9473-3dbf556381d3 None admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:32.499274 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70e901-b402-47e4-9473-3dbf556381d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:32.499527 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c691e-91a4-4c5e-a411-5b59d73ae1bb None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:32.499643 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70e901-b402-47e4-9473-3dbf556381d3 None admin] PATH_INFO: `/v3/projects/d7a9c82a62044db884e547da9a523927/users/1b03d940626a449dbe904f02f3d70854/roles/ee4d134c98a24de99a5426a2ad83b147` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:32.500073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c691e-91a4-4c5e-a411-5b59d73ae1bb None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:32.500359 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c691e-91a4-4c5e-a411-5b59d73ae1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:32.502240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70e901-b402-47e4-9473-3dbf556381d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7a9c82a62044db884e547da9a523927, user_id=1b03d940626a449dbe904f02f3d70854, role_id=ee4d134c98a24de99a5426a2ad83b147)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:32.503823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70e901-b402-47e4-9473-3dbf556381d3 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:32.517720 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-e69c691e-91a4-4c5e-a411-5b59d73ae1bb None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:32.523875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e69c691e-91a4-4c5e-a411-5b59d73ae1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:32.564896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:32.575409 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 467/938] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:40:32 2022] PUT /identity/v3/projects/d7a9c82a62044db884e547da9a523927/users/1b03d940626a449dbe904f02f3d70854/roles/ee4d134c98a24de99a5426a2ad83b147 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:40:32.602678 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 472/939] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:32.624118 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70e901-b402-47e4-9473-3dbf556381d3 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:32.650753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d341e7-8057-43f2-b6c1-6a28c3b0f96c None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:32.651435 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d341e7-8057-43f2-b6c1-6a28c3b0f96c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:32.651898 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d341e7-8057-43f2-b6c1-6a28c3b0f96c None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:32.654499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 473/940] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:32.660592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2375dc8-a9c4-43f2-887d-8ec95a2832f9 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:32.660941 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2375dc8-a9c4-43f2-887d-8ec95a2832f9 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:32.661222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2375dc8-a9c4-43f2-887d-8ec95a2832f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:32.679209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-d2375dc8-a9c4-43f2-887d-8ec95a2832f9 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:32.680724 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-d2375dc8-a9c4-43f2-887d-8ec95a2832f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:32.762902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 474/941] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:40:32.766461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70e901-b402-47e4-9473-3dbf556381d3 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:32.793534 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2375dc8-a9c4-43f2-887d-8ec95a2832f9 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:32.809196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a150c7-04b1-427a-befb-7139fae9482d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:32.810469 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a150c7-04b1-427a-befb-7139fae9482d None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:32.810832 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a150c7-04b1-427a-befb-7139fae9482d None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:32.811180 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a150c7-04b1-427a-befb-7139fae9482d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:32.811970 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a150c7-04b1-427a-befb-7139fae9482d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:32.813998 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a150c7-04b1-427a-befb-7139fae9482d None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:32.829886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-a9a150c7-04b1-427a-befb-7139fae9482d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:40:32.829886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:32.829886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:32.829886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:32.829886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:32.829886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:32.829886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:32.829886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:32.829886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:40:32.829886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:32.829886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:32.829886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:32.829886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:32.829886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:32.829886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:32.829886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:32.829886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:32.830953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:32.830953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:32.830953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:32.830953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:32.830953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:32.830953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:32.830953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:32.830953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:32.830953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:32.830953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:32.830953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:32.830953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:32.830953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:32.830953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:32.830953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:32.830953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:32.831816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:32.831816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:32.831816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:32.831816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:32.831816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:32.831816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:32.831816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:32.831816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:32.831816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:32.831816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:32.831816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:32.831816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:32.831816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:40:32.831816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:32.832559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:32.836515 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 468/942] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 23 10:40:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:32.840095 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a150c7-04b1-427a-befb-7139fae9482d None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:32.912704 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2375dc8-a9c4-43f2-887d-8ec95a2832f9 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:32.922923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:32.948509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128da89-1e66-4d83-a311-b04b8a043b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:32.949261 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128da89-1e66-4d83-a311-b04b8a043b2e None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:32.949546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128da89-1e66-4d83-a311-b04b8a043b2e None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:32.949862 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128da89-1e66-4d83-a311-b04b8a043b2e None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:32.950528 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128da89-1e66-4d83-a311-b04b8a043b2e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:32.952039 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128da89-1e66-4d83-a311-b04b8a043b2e None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:32.953361 dv-cinder-846146-4-smb devstack@keystone.service[92004]: WARNING keystone.server.flask.common [None req-8128da89-1e66-4d83-a311-b04b8a043b2e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 10:40:32.954363 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a150c7-04b1-427a-befb-7139fae9482d None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:32.992263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce480743-0bd6-49b1-b362-76004958f003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:32.993247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce480743-0bd6-49b1-b362-76004958f003 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:32.993548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce480743-0bd6-49b1-b362-76004958f003 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:32.993830 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce480743-0bd6-49b1-b362-76004958f003 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:32.994547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce480743-0bd6-49b1-b362-76004958f003 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:32.994861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce480743-0bd6-49b1-b362-76004958f003 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:32.996228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce480743-0bd6-49b1-b362-76004958f003 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:32.999984 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.sql.core [None req-8128da89-1e66-4d83-a311-b04b8a043b2e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 10:40:32.999984 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 10:40:32.999984 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [parameters: {'id': 'cb19da5c947844468ca0d34ab9bc5ad2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 10:40:32.999984 dv-cinder-846146-4-smb devstack@keystone.service[92004]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92004) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 10:40:33.001691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 469/943] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 23 10:40:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:33.009597 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce480743-0bd6-49b1-b362-76004958f003 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:33.022571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-8128da89-1e66-4d83-a311-b04b8a043b2e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cb19da5c947844468ca0d34ab9bc5ad2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cb19da5c947844468ca0d34ab9bc5ad2. Jun 23 10:40:33.022571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:33.022571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 10:40:33.022571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 10:40:33.022571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 10:40:33.022571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 10:40:33.022571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 10:40:33.022571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 10:40:33.022571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 10:40:33.022571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application conn.query(q) Jun 23 10:40:33.022571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 10:40:33.022571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 10:40:33.022571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 10:40:33.023458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application result.read() Jun 23 10:40:33.023458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 10:40:33.023458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 10:40:33.023458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 10:40:33.023458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 10:40:33.023458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 10:40:33.023458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 10:40:33.023458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 10:40:33.023458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 10:40:33.023458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 10:40:33.023458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:33.023458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 10:40:33.023458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:33.023458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:33.023458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 10:40:33.023458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 10:40:33.023458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 23 10:40:33.023458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 23 10:40:33.025208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 10:40:33.025208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application next(self.gen) Jun 23 10:40:33.025208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 10:40:33.025208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application yield resource Jun 23 10:40:33.025208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 10:40:33.025208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application next(self.gen) Jun 23 10:40:33.025208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 10:40:33.025208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 10:40:33.025208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 10:40:33.025208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 10:40:33.025208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 10:40:33.025208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise self.value Jun 23 10:40:33.025208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 10:40:33.025208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 10:40:33.025208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 10:40:33.025208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application session.commit() Jun 23 10:40:33.025208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 10:40:33.026103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 10:40:33.026103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 10:40:33.026103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 10:40:33.026103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 10:40:33.026103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self.session.flush() Jun 23 10:40:33.026103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 10:40:33.026103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 10:40:33.026103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 10:40:33.026103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 10:40:33.026103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 10:40:33.026103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application compat.raise_( Jun 23 10:40:33.026103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 10:40:33.026103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception Jun 23 10:40:33.026103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 10:40:33.026103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 10:40:33.026103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 10:40:33.026103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 10:40:33.028742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 10:40:33.028742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 10:40:33.028742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 10:40:33.028742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 10:40:33.028742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 10:40:33.028742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 10:40:33.028742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 10:40:33.028742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 10:40:33.028742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 10:40:33.028742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 10:40:33.028742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 10:40:33.028742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 10:40:33.028742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 10:40:33.028742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 10:40:33.028742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 10:40:33.030895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 10:40:33.030895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 10:40:33.030895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception Jun 23 10:40:33.030895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 10:40:33.030895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 10:40:33.030895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 10:40:33.030895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 10:40:33.030895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 10:40:33.030895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 10:40:33.030895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 10:40:33.030895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application conn.query(q) Jun 23 10:40:33.030895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 10:40:33.030895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 10:40:33.030895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 10:40:33.030895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application result.read() Jun 23 10:40:33.030895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 10:40:33.030895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 10:40:33.033109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 10:40:33.033109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 10:40:33.033109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 10:40:33.033109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 10:40:33.033109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 10:40:33.033109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 10:40:33.033109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 10:40:33.033109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 10:40:33.033109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [parameters: {'id': 'cb19da5c947844468ca0d34ab9bc5ad2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 10:40:33.033109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 10:40:33.033109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:33.033109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:33.033109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:33.033109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:33.033109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 23 10:40:33.035073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 23 10:40:33.035073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 10:40:33.035073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 10:40:33.035073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 23 10:40:33.035073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:33.035073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:33.035073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:33.035073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:33.035073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:33.035073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:33.035073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:33.035073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:33.035073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:33.035073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:33.035073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:33.035073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:33.035073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:33.037718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:33.037718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 23 10:40:33.037718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 23 10:40:33.037718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:33.037718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:33.037718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 23 10:40:33.037718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 23 10:40:33.037718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cb19da5c947844468ca0d34ab9bc5ad2. Jun 23 10:40:33.037718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:33.041290 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 475/944] 10.222.0.20 () {60 vars in 1140 bytes} [Thu Jun 23 10:40:32 2022] POST /identity/v3/projects => generated 262 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:33.047016 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128da89-1e66-4d83-a311-b04b8a043b2e None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:33.087264 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:33.142589 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce480743-0bd6-49b1-b362-76004958f003 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:33.162843 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128da89-1e66-4d83-a311-b04b8a043b2e None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:33.188344 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757fbeb-b7d5-46ab-a19b-84a0ff2480d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:33.189810 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757fbeb-b7d5-46ab-a19b-84a0ff2480d3 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:33.190304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757fbeb-b7d5-46ab-a19b-84a0ff2480d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:33.190997 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757fbeb-b7d5-46ab-a19b-84a0ff2480d3 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:33.192105 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757fbeb-b7d5-46ab-a19b-84a0ff2480d3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:33.192908 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757fbeb-b7d5-46ab-a19b-84a0ff2480d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:33.194751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757fbeb-b7d5-46ab-a19b-84a0ff2480d3 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:33.201499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 470/945] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 23 10:40:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:33.201826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29835e71-21a6-4a0a-8154-6fe2b6efdf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:33.202776 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29835e71-21a6-4a0a-8154-6fe2b6efdf66 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:33.203130 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29835e71-21a6-4a0a-8154-6fe2b6efdf66 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:33.203479 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29835e71-21a6-4a0a-8154-6fe2b6efdf66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:33.208735 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757fbeb-b7d5-46ab-a19b-84a0ff2480d3 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:33.212286 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29835e71-21a6-4a0a-8154-6fe2b6efdf66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:33.214451 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29835e71-21a6-4a0a-8154-6fe2b6efdf66 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:33.231208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-29835e71-21a6-4a0a-8154-6fe2b6efdf66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:33.231208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:33.231208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:33.231208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:33.231208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:33.231208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:33.231208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:33.231208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:33.231208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:33.231208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:33.231208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:33.231208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:33.231208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:33.231208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:33.231208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:33.232331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:33.232331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:33.232331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:33.232331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:33.232331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:33.232331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:33.232331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:33.232331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:33.232331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:33.232331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:33.232331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:33.232331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:33.232331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:33.232331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:33.232331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:33.232331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:33.232331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:33.233436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:33.233436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:33.233436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:33.233436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:33.233436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:33.233436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:33.233436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:33.233436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:33.235217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 476/946] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:33.241835 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29835e71-21a6-4a0a-8154-6fe2b6efdf66 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:33.277999 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:33.319615 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757fbeb-b7d5-46ab-a19b-84a0ff2480d3 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:33.352113 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:33.361491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5658c3-6279-4155-8103-94824ccb142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:33.363245 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5658c3-6279-4155-8103-94824ccb142c None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:33.363245 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5658c3-6279-4155-8103-94824ccb142c None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:33.363245 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5658c3-6279-4155-8103-94824ccb142c None admin] PATH_INFO: `/v3/endpoints` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:33.363493 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5658c3-6279-4155-8103-94824ccb142c None admin] RBAC: Adding query filter params (interface=public, service_id=24800a05353b49a1ba570a9a303a0631, region_id=RegionOne) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:33.363784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5658c3-6279-4155-8103-94824ccb142c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:33.365189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5658c3-6279-4155-8103-94824ccb142c None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:33.369459 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29835e71-21a6-4a0a-8154-6fe2b6efdf66 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:33.370846 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 471/947] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jun 23 10:40:33 2022] GET /identity/v3/endpoints?service_id=24800a05353b49a1ba570a9a303a0631&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:33.376502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5658c3-6279-4155-8103-94824ccb142c None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:33.406413 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0de7d-7706-427a-a98f-eb6d64fd2a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:33.407301 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0de7d-7706-427a-a98f-eb6d64fd2a75 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:33.407781 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0de7d-7706-427a-a98f-eb6d64fd2a75 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:33.408064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0de7d-7706-427a-a98f-eb6d64fd2a75 None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:33.409026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0de7d-7706-427a-a98f-eb6d64fd2a75 None admin] RBAC: Adding query filter params (name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:33.409417 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0de7d-7706-427a-a98f-eb6d64fd2a75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:33.411022 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0de7d-7706-427a-a98f-eb6d64fd2a75 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:33.443463 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 477/948] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 23 10:40:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:33.490654 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5658c3-6279-4155-8103-94824ccb142c None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:33.538941 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97e83c-42d5-4cd7-81d3-d64d7018c578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:33.540569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97e83c-42d5-4cd7-81d3-d64d7018c578 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:33.541236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97e83c-42d5-4cd7-81d3-d64d7018c578 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:33.541701 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97e83c-42d5-4cd7-81d3-d64d7018c578 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:33.542561 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97e83c-42d5-4cd7-81d3-d64d7018c578 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:33.544123 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97e83c-42d5-4cd7-81d3-d64d7018c578 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:33.551474 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 472/949] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jun 23 10:40:33 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:40:33.681846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd7bc0-988d-46e1-9d76-9778b7686c4c None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:33.682403 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd7bc0-988d-46e1-9d76-9778b7686c4c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:33.682403 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd7bc0-988d-46e1-9d76-9778b7686c4c None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:33.683860 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 478/950] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:33.689654 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f7842-ef44-43a0-bc18-382d630f1008 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:33.689945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f7842-ef44-43a0-bc18-382d630f1008 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:33.690237 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f7842-ef44-43a0-bc18-382d630f1008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:33.710343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-e76f7842-ef44-43a0-bc18-382d630f1008 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:33.712094 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e76f7842-ef44-43a0-bc18-382d630f1008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:33.768918 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:33.788308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 473/951] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:40:33.811296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd7bc0-988d-46e1-9d76-9778b7686c4c None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:33.904680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:33.922233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd7bc0-988d-46e1-9d76-9778b7686c4c None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:33.958110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2284de-0a72-490d-ad65-763bd4397c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:33.959223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2284de-0a72-490d-ad65-763bd4397c15 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:33.959684 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2284de-0a72-490d-ad65-763bd4397c15 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:33.960363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2284de-0a72-490d-ad65-763bd4397c15 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:33.961056 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2284de-0a72-490d-ad65-763bd4397c15 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:33.962913 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2284de-0a72-490d-ad65-763bd4397c15 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:33.974935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-2b2284de-0a72-490d-ad65-763bd4397c15 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:40:33.974935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:33.974935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:33.974935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:33.974935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:33.974935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:33.974935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:33.974935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:33.974935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:40:33.974935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:33.974935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:33.974935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:33.974935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:33.974935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:33.974935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:33.974935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:33.974935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:33.976137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:33.976137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:33.976137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:33.976137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:33.976137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:33.976137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:33.976137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:33.976137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:33.976137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:33.976137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:33.976137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:33.976137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:33.976137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:33.976137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:33.976137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:33.976137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:33.977268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:33.977268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:33.977268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:33.977268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:33.977268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:33.977268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:33.977268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:33.977268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:33.977268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:33.977268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:33.977268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:33.977268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:33.977268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:40:33.977268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:33.977268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 479/952] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:33.982403 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f7842-ef44-43a0-bc18-382d630f1008 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:34.090873 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f7842-ef44-43a0-bc18-382d630f1008 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:34.126441 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f764bb2-db40-42c9-a2a6-5c5ab563cf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:34.127111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f764bb2-db40-42c9-a2a6-5c5ab563cf9e None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:34.127394 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f764bb2-db40-42c9-a2a6-5c5ab563cf9e None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:34.127726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f764bb2-db40-42c9-a2a6-5c5ab563cf9e None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:34.128443 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f764bb2-db40-42c9-a2a6-5c5ab563cf9e None admin] RBAC: Adding query filter params (name=compute) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:34.128778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f764bb2-db40-42c9-a2a6-5c5ab563cf9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:34.130143 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f764bb2-db40-42c9-a2a6-5c5ab563cf9e None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:34.135411 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 474/953] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 23 10:40:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:34.140735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2284de-0a72-490d-ad65-763bd4397c15 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:34.246882 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2284de-0a72-490d-ad65-763bd4397c15 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:34.282454 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb9945-40b0-4e25-b0d5-5784f953fe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:34.283131 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb9945-40b0-4e25-b0d5-5784f953fe45 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:34.283417 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb9945-40b0-4e25-b0d5-5784f953fe45 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:34.283697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb9945-40b0-4e25-b0d5-5784f953fe45 None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:34.284410 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb9945-40b0-4e25-b0d5-5784f953fe45 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:34.284748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb9945-40b0-4e25-b0d5-5784f953fe45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:34.286125 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb9945-40b0-4e25-b0d5-5784f953fe45 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:34.291980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 480/954] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 23 10:40:34 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:34.786436 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514f2df-95f4-4cac-8b0d-aadc8f8fa9cd None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:34.786997 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514f2df-95f4-4cac-8b0d-aadc8f8fa9cd None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:34.786997 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514f2df-95f4-4cac-8b0d-aadc8f8fa9cd None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:34.788779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 475/955] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:34.795194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f23907-b607-45fd-a9c0-016612097f27 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:34.795727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f23907-b607-45fd-a9c0-016612097f27 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:34.795727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f23907-b607-45fd-a9c0-016612097f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:34.814868 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-25f23907-b607-45fd-a9c0-016612097f27 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:34.816872 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-25f23907-b607-45fd-a9c0-016612097f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:34.825794 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:34.890777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 481/956] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:34.914383 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514f2df-95f4-4cac-8b0d-aadc8f8fa9cd None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:34.969175 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:35.032354 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514f2df-95f4-4cac-8b0d-aadc8f8fa9cd None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:35.071673 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce235fa0-1cdc-44fe-9370-9bf1f500ce95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:35.073013 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce235fa0-1cdc-44fe-9370-9bf1f500ce95 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:35.073495 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce235fa0-1cdc-44fe-9370-9bf1f500ce95 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:35.073964 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce235fa0-1cdc-44fe-9370-9bf1f500ce95 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:35.086679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce235fa0-1cdc-44fe-9370-9bf1f500ce95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:35.094760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-ce235fa0-1cdc-44fe-9370-9bf1f500ce95 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:40:35.094760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:35.094760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:35.094760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:35.094760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:35.094760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:35.094760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:35.094760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:35.094760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:35.094760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:35.094760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:35.094760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:35.094760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:35.094760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:35.094760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:35.094760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:35.095743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:35.095743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:35.095743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:35.095743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:35.095743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:35.095743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:35.095743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:35.095743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:35.095743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:35.095743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:35.095743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:35.095743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:35.095743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:35.095743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:35.095743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:35.095743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:35.097152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:35.097152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:35.097152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:35.097152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:35.097152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:35.097152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:35.097152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:35.097152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:35.097152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:35.097152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:35.097152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:40:35.097152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:35.100828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 476/957] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jun 23 10:40:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:35.105762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f23907-b607-45fd-a9c0-016612097f27 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:35.218371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f23907-b607-45fd-a9c0-016612097f27 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:35.262859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b314a-9359-439d-a31e-7019cf23e035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:35.263556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b314a-9359-439d-a31e-7019cf23e035 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:35.263853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b314a-9359-439d-a31e-7019cf23e035 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:35.264109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b314a-9359-439d-a31e-7019cf23e035 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:35.265110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b314a-9359-439d-a31e-7019cf23e035 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:35.265677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b314a-9359-439d-a31e-7019cf23e035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:35.267453 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b314a-9359-439d-a31e-7019cf23e035 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:35.280590 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 482/958] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jun 23 10:40:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:35.286672 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce235fa0-1cdc-44fe-9370-9bf1f500ce95 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:35.391257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce235fa0-1cdc-44fe-9370-9bf1f500ce95 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:35.405912 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:35.427231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624a927-e03b-4c90-bcbf-e78733d4c07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:35.428026 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624a927-e03b-4c90-bcbf-e78733d4c07d None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:35.428305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624a927-e03b-4c90-bcbf-e78733d4c07d None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:35.428578 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624a927-e03b-4c90-bcbf-e78733d4c07d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:35.439598 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624a927-e03b-4c90-bcbf-e78733d4c07d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:35.441077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624a927-e03b-4c90-bcbf-e78733d4c07d None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:35.458549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-d624a927-e03b-4c90-bcbf-e78733d4c07d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:35.458549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:35.458549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:35.458549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:35.458549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:35.458549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:35.458549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:35.458549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:35.458549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:35.458549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:35.458549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:35.458549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:35.458549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:35.458549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:35.458549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:35.459504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:35.459504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:35.459504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:35.459504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:35.459504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:35.459504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:35.459504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:35.459504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:35.459504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:35.459504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:35.459504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:35.459504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:35.459504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:35.459504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:35.459504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:35.459504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:35.459504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:35.460391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:35.460391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:35.460391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:35.460391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:35.464742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 477/959] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:35.466642 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b314a-9359-439d-a31e-7019cf23e035 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:35.470784 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:35.581439 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b314a-9359-439d-a31e-7019cf23e035 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:35.650874 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79b824-7a14-4440-9a64-bc3911ecab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:35.651803 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79b824-7a14-4440-9a64-bc3911ecab1c None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:35.652242 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79b824-7a14-4440-9a64-bc3911ecab1c None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:35.652699 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79b824-7a14-4440-9a64-bc3911ecab1c None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:35.653612 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79b824-7a14-4440-9a64-bc3911ecab1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:35.654077 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79b824-7a14-4440-9a64-bc3911ecab1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:35.655804 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79b824-7a14-4440-9a64-bc3911ecab1c None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:35.673955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 483/960] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:35.680757 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624a927-e03b-4c90-bcbf-e78733d4c07d None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:35.698691 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89894e31-aa91-4fcb-b459-40c9a8c7c40c None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:35.698987 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89894e31-aa91-4fcb-b459-40c9a8c7c40c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:35.699241 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89894e31-aa91-4fcb-b459-40c9a8c7c40c None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:35.700875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 484/961] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:40:35.705924 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7506615-141b-48b6-96d3-f4a5fc3fa1e6 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:35.706217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7506615-141b-48b6-96d3-f4a5fc3fa1e6 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:35.706498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7506615-141b-48b6-96d3-f4a5fc3fa1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:35.726741 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-c7506615-141b-48b6-96d3-f4a5fc3fa1e6 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:35.727860 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c7506615-141b-48b6-96d3-f4a5fc3fa1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:35.792997 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624a927-e03b-4c90-bcbf-e78733d4c07d None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:35.806196 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:35.819229 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 485/962] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:40:35.834942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266892d-9c66-44ee-99ef-a3bc4c655a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:35.836885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266892d-9c66-44ee-99ef-a3bc4c655a80 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:35.837666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266892d-9c66-44ee-99ef-a3bc4c655a80 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:35.838278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266892d-9c66-44ee-99ef-a3bc4c655a80 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:35.845363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7506615-141b-48b6-96d3-f4a5fc3fa1e6 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:35.855936 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266892d-9c66-44ee-99ef-a3bc4c655a80 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:35.857613 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266892d-9c66-44ee-99ef-a3bc4c655a80 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:35.874668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-6266892d-9c66-44ee-99ef-a3bc4c655a80 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:40:35.874668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:35.874668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:35.874668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:35.874668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:35.874668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:35.874668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:35.874668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:35.874668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:35.874668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:35.874668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:35.874668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:35.874668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:35.874668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:35.874668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:35.874668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:35.875682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:35.875682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:35.875682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:35.875682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:35.875682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:35.875682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:35.875682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:35.875682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:35.875682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:35.875682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:35.875682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:35.875682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:35.875682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:35.875682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:35.875682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:35.875682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:35.875682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:35.875682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:35.876655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:35.876655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:35.876655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:35.876655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:35.876655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:35.876655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:35.876655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:35.876655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:35.876655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:40:35.876655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:35.880708 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 478/963] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 23 10:40:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:35.881796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266892d-9c66-44ee-99ef-a3bc4c655a80 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:35.907773 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:35.975653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7506615-141b-48b6-96d3-f4a5fc3fa1e6 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:36.002896 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266892d-9c66-44ee-99ef-a3bc4c655a80 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:36.013072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3cb6b-3966-49af-a5e9-93dad14176d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:36.013752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3cb6b-3966-49af-a5e9-93dad14176d3 None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:36.014332 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3cb6b-3966-49af-a5e9-93dad14176d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:36.014332 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3cb6b-3966-49af-a5e9-93dad14176d3 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:36.015012 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3cb6b-3966-49af-a5e9-93dad14176d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:36.016626 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3cb6b-3966-49af-a5e9-93dad14176d3 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:36.042326 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc0478-87f5-4bb0-a3ee-20f486b482dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:36.043007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc0478-87f5-4bb0-a3ee-20f486b482dc None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:36.043288 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc0478-87f5-4bb0-a3ee-20f486b482dc None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:36.043566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc0478-87f5-4bb0-a3ee-20f486b482dc None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:36.044411 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc0478-87f5-4bb0-a3ee-20f486b482dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:36.044750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc0478-87f5-4bb0-a3ee-20f486b482dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:36.046293 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc0478-87f5-4bb0-a3ee-20f486b482dc None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:36.062379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.sql.core [None req-b8a3cb6b-3966-49af-a5e9-93dad14176d3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 10:40:36.062379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 10:40:36.062379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [parameters: {'user_id': '9fe0699dc51047c8bb3361eb443a4448', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 10:40:36.062379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92004) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 10:40:36.063833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 479/964] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jun 23 10:40:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:36.069400 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2417a-3b05-4f37-b250-c8485258e598 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:36.069692 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2417a-3b05-4f37-b250-c8485258e598 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:36.069795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-b8a3cb6b-3966-49af-a5e9-93dad14176d3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 10:40:36.069795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:36.069795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 10:40:36.069795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 10:40:36.069795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 10:40:36.069795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 10:40:36.069795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 10:40:36.069795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 10:40:36.069795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 10:40:36.069795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application conn.query(q) Jun 23 10:40:36.069795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 10:40:36.069795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 10:40:36.069795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 10:40:36.069795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application result.read() Jun 23 10:40:36.069795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 10:40:36.070857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 10:40:36.070857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 10:40:36.070857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 10:40:36.070857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 10:40:36.070857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 10:40:36.070857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 10:40:36.070857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 10:40:36.070857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 10:40:36.070857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:36.070857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 10:40:36.070857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:36.070857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:36.070857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 10:40:36.070857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 10:40:36.070857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 23 10:40:36.070857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 23 10:40:36.070857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 10:40:36.070857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application next(self.gen) Jun 23 10:40:36.072222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 10:40:36.072222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application yield resource Jun 23 10:40:36.072222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 10:40:36.072222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application next(self.gen) Jun 23 10:40:36.072222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 10:40:36.072222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 10:40:36.072222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 10:40:36.072222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 10:40:36.072222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 10:40:36.072222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise self.value Jun 23 10:40:36.072222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 10:40:36.072222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 10:40:36.072222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 10:40:36.072222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application session.commit() Jun 23 10:40:36.072222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 10:40:36.072222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 10:40:36.072222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 10:40:36.073457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 10:40:36.073457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 10:40:36.073457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self.session.flush() Jun 23 10:40:36.073457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 10:40:36.073457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 10:40:36.073457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 10:40:36.073457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 10:40:36.073457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 10:40:36.073457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application compat.raise_( Jun 23 10:40:36.073457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 10:40:36.073457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception Jun 23 10:40:36.073457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 10:40:36.073457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 10:40:36.073457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 10:40:36.073457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 10:40:36.073457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 10:40:36.073457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 10:40:36.074324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 10:40:36.074324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 10:40:36.074324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 23 10:40:36.074324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 23 10:40:36.074324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 10:40:36.074324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 10:40:36.074324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 10:40:36.074324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 10:40:36.074324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 10:40:36.074324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 10:40:36.074324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 10:40:36.074324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 10:40:36.074324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 10:40:36.074324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 10:40:36.074324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 10:40:36.074324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception Jun 23 10:40:36.076260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 10:40:36.076260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 10:40:36.076260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 10:40:36.076260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 10:40:36.076260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 10:40:36.076260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 10:40:36.076260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 10:40:36.076260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application conn.query(q) Jun 23 10:40:36.076260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 10:40:36.076260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 10:40:36.076260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 10:40:36.076260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application result.read() Jun 23 10:40:36.076260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 10:40:36.076260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 10:40:36.076260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 10:40:36.076260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 10:40:36.078456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 10:40:36.078456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 10:40:36.078456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 10:40:36.078456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 10:40:36.078456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 10:40:36.078456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 10:40:36.078456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [parameters: {'user_id': '9fe0699dc51047c8bb3361eb443a4448', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 10:40:36.078456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 10:40:36.078456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:36.078456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:36.078456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:36.078456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:36.078456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:36.078456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:36.078456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:36.080477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:36.080477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:36.080477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:36.080477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:36.080477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:36.080477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:36.080477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:36.080477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 23 10:40:36.080477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 23 10:40:36.080477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:36.080477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:36.080477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:36.080477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:36.080477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:36.080477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:36.080477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 23 10:40:36.080477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 23 10:40:36.081635 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 23 10:40:36.081635 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 23 10:40:36.081635 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 10:40:36.081635 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 10:40:36.081635 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 10:40:36.081635 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:36.083022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2417a-3b05-4f37-b250-c8485258e598 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:36.083022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 480/965] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:36.083022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2417a-3b05-4f37-b250-c8485258e598 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:36.083270 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 486/966] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jun 23 10:40:35 2022] POST /identity/v3/users => generated 160 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:36.083270 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52029e3-dc6c-4519-bb64-757336176b8a None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:36.083270 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52029e3-dc6c-4519-bb64-757336176b8a None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:36.083270 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52029e3-dc6c-4519-bb64-757336176b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:36.098877 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-c52029e3-dc6c-4519-bb64-757336176b8a None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:36.100398 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c52029e3-dc6c-4519-bb64-757336176b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:36.154501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:36.165096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:36.180965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 487/967] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:36.180965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52029e3-dc6c-4519-bb64-757336176b8a None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:36.197886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2417a-3b05-4f37-b250-c8485258e598 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:36.235064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae2323-3b1a-4759-8394-7f281ae86d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:36.235714 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae2323-3b1a-4759-8394-7f281ae86d25 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:36.236002 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae2323-3b1a-4759-8394-7f281ae86d25 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:36.236282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae2323-3b1a-4759-8394-7f281ae86d25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:36.280976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52029e3-dc6c-4519-bb64-757336176b8a None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:36.307975 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae2323-3b1a-4759-8394-7f281ae86d25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:36.309445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae2323-3b1a-4759-8394-7f281ae86d25 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:36.315127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631e9de-0daa-4ccc-a8c7-43b7fb927ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:36.315931 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631e9de-0daa-4ccc-a8c7-43b7fb927ac2 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:36.316218 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631e9de-0daa-4ccc-a8c7-43b7fb927ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:36.316496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631e9de-0daa-4ccc-a8c7-43b7fb927ac2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:36.325750 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631e9de-0daa-4ccc-a8c7-43b7fb927ac2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:36.327404 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631e9de-0daa-4ccc-a8c7-43b7fb927ac2 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:36.342329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-8631e9de-0daa-4ccc-a8c7-43b7fb927ac2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:40:36.342329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:36.342329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:36.342329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:36.342329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:36.342329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:36.342329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:36.342329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:36.342329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:36.342329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:36.342329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:36.342329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:36.342329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:36.342329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:36.342329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:36.342329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:36.343287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:36.343287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:36.343287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:36.343287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:36.343287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:36.343287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:36.343287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:36.343287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:36.343287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:36.343287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:36.343287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:36.343287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:36.343287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:36.343287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:36.343287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:36.343287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:36.343287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:36.343287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:36.344236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:36.344236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:36.344236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:36.344236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:36.344236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:36.344236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:36.344236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:36.344236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:36.344236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:40:36.344236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:36.344236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 488/968] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:40:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:36.345239 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631e9de-0daa-4ccc-a8c7-43b7fb927ac2 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:36.391552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:36.400114 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:36.423134 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 481/969] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:36 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:40:36.424742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae2323-3b1a-4759-8394-7f281ae86d25 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:36.448349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631e9de-0daa-4ccc-a8c7-43b7fb927ac2 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:36.482095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c82a4-bea0-4a26-bea5-9fcb4e19b46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:36.482889 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c82a4-bea0-4a26-bea5-9fcb4e19b46f None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:36.483172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c82a4-bea0-4a26-bea5-9fcb4e19b46f None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:36.483451 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c82a4-bea0-4a26-bea5-9fcb4e19b46f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:36.484118 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c82a4-bea0-4a26-bea5-9fcb4e19b46f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:36.485500 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c82a4-bea0-4a26-bea5-9fcb4e19b46f None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:36.497363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-013c82a4-bea0-4a26-bea5-9fcb4e19b46f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:40:36.497363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:36.497363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:36.497363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:36.497363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:36.497363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:36.497363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:36.497363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:36.497363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:40:36.497363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:36.497363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:36.497363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:36.497363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:36.497363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:36.497363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:36.497363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:36.497363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:36.498491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:36.498491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:36.498491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:36.498491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:36.498491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:36.498491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:36.498491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:36.498491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:36.498491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:36.498491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:36.498491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:36.498491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:36.498491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:36.498491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:36.498491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:36.498491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:36.499598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:36.499598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:36.499598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:36.499598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:36.499598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:36.499598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:36.499598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:36.499598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:36.499598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:36.499598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:36.499598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:36.499598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:36.499598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:40:36.499598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:36.499598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 489/970] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 23 10:40:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:36.500391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c82a4-bea0-4a26-bea5-9fcb4e19b46f None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:36.527605 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae2323-3b1a-4759-8394-7f281ae86d25 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:36.560921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125465d-a742-48d5-bd6d-e6457a5360ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:36.561518 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125465d-a742-48d5-bd6d-e6457a5360ca None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:36.561808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125465d-a742-48d5-bd6d-e6457a5360ca None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:36.562090 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125465d-a742-48d5-bd6d-e6457a5360ca None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:36.562901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125465d-a742-48d5-bd6d-e6457a5360ca None admin] RBAC: Adding query filter params (name=cinder) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:36.563211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125465d-a742-48d5-bd6d-e6457a5360ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:36.564631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125465d-a742-48d5-bd6d-e6457a5360ca None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:36.598815 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c82a4-bea0-4a26-bea5-9fcb4e19b46f None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:36.599438 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 482/971] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 23 10:40:36 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:36.600836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca0272-20ef-4c07-ab34-f29a7cfef535 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:36.601127 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca0272-20ef-4c07-ab34-f29a7cfef535 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:36.601438 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca0272-20ef-4c07-ab34-f29a7cfef535 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:36.602932 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 483/972] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:36.603570 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca0272-20ef-4c07-ab34-f29a7cfef535 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:36.623602 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:36.646500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:36.651747 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2833372-9c89-44e9-a4ad-b89a34886085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:36.652575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2833372-9c89-44e9-a4ad-b89a34886085 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:36.652891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2833372-9c89-44e9-a4ad-b89a34886085 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:36.653170 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2833372-9c89-44e9-a4ad-b89a34886085 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:36.665258 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2833372-9c89-44e9-a4ad-b89a34886085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:36.666805 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2833372-9c89-44e9-a4ad-b89a34886085 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:36.686982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-f2833372-9c89-44e9-a4ad-b89a34886085 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:36.686982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:36.686982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:36.686982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:36.686982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:36.686982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:36.686982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:36.686982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:36.686982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:36.686982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:36.686982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:36.686982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:36.686982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:36.686982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:36.686982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:36.688143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:36.688143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:36.688143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:36.688143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:36.688143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:36.688143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:36.688143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:36.688143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:36.688143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:36.688143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:36.688143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:36.688143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:36.688143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:36.688143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:36.688143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:36.688143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:36.688143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:36.689645 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:36.689645 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:36.689645 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:36.689645 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:36.689645 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 490/973] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:36.689645 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933fdc1-f442-4dc0-a856-c4cdb5f1117b None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:36.689990 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933fdc1-f442-4dc0-a856-c4cdb5f1117b None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:36.690072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933fdc1-f442-4dc0-a856-c4cdb5f1117b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:36.708242 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-2933fdc1-f442-4dc0-a856-c4cdb5f1117b None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:36.709502 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-2933fdc1-f442-4dc0-a856-c4cdb5f1117b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:36.728158 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca0272-20ef-4c07-ab34-f29a7cfef535 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:36.768103 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f60e5-39b9-4d95-bfd9-eb2564f0af67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:36.768821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f60e5-39b9-4d95-bfd9-eb2564f0af67 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:36.770830 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f60e5-39b9-4d95-bfd9-eb2564f0af67 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:36.770830 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f60e5-39b9-4d95-bfd9-eb2564f0af67 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:36.770830 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f60e5-39b9-4d95-bfd9-eb2564f0af67 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:36.770830 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f60e5-39b9-4d95-bfd9-eb2564f0af67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:36.771763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f60e5-39b9-4d95-bfd9-eb2564f0af67 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:36.777392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 484/974] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 23 10:40:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:36.778050 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f60e5-39b9-4d95-bfd9-eb2564f0af67 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:36.793196 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 491/975] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:36.794464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933fdc1-f442-4dc0-a856-c4cdb5f1117b None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:36.884999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:36.888373 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f60e5-39b9-4d95-bfd9-eb2564f0af67 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:36.894807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:36.904030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933fdc1-f442-4dc0-a856-c4cdb5f1117b None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:36.922787 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5652d7-197a-4236-abff-7db8aaaaa702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:36.923449 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5652d7-197a-4236-abff-7db8aaaaa702 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:36.923738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5652d7-197a-4236-abff-7db8aaaaa702 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:36.924028 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5652d7-197a-4236-abff-7db8aaaaa702 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:36.924784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5652d7-197a-4236-abff-7db8aaaaa702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:36.925096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5652d7-197a-4236-abff-7db8aaaaa702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:36.926455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5652d7-197a-4236-abff-7db8aaaaa702 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:36.937216 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f15620-3a4f-49cb-a053-f67cfeff2bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:36.937515 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 485/976] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:36.937888 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f15620-3a4f-49cb-a053-f67cfeff2bff None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:36.938171 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f15620-3a4f-49cb-a053-f67cfeff2bff None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:36.938330 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5652d7-197a-4236-abff-7db8aaaaa702 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:36.938485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f15620-3a4f-49cb-a053-f67cfeff2bff None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:36.939146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f15620-3a4f-49cb-a053-f67cfeff2bff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:36.939452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f15620-3a4f-49cb-a053-f67cfeff2bff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:36.940873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f15620-3a4f-49cb-a053-f67cfeff2bff None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:36.949007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 492/977] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 23 10:40:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:36.949794 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f15620-3a4f-49cb-a053-f67cfeff2bff None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:37.040646 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5652d7-197a-4236-abff-7db8aaaaa702 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:37.047402 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f15620-3a4f-49cb-a053-f67cfeff2bff None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:37.073790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a9b5a-7217-4ea7-b834-fcffe96fa316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:37.074646 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a9b5a-7217-4ea7-b834-fcffe96fa316 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:37.074928 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a9b5a-7217-4ea7-b834-fcffe96fa316 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:37.075205 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a9b5a-7217-4ea7-b834-fcffe96fa316 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:37.075926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a9b5a-7217-4ea7-b834-fcffe96fa316 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:37.077323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a9b5a-7217-4ea7-b834-fcffe96fa316 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:37.080488 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c328b-c613-4ab8-89a2-89b018c53c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:37.081316 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c328b-c613-4ab8-89a2-89b018c53c2b None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:37.081602 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c328b-c613-4ab8-89a2-89b018c53c2b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:37.081883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c328b-c613-4ab8-89a2-89b018c53c2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:37.089057 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c328b-c613-4ab8-89a2-89b018c53c2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:37.090505 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c328b-c613-4ab8-89a2-89b018c53c2b None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:37.104420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-464c328b-c613-4ab8-89a2-89b018c53c2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:37.104420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:37.104420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:37.104420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:37.104420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:37.104420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:37.104420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:37.104420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:37.104420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:37.104420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:37.104420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:37.104420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:37.104420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:37.104420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:37.104420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:37.105508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:37.105508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:37.105508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:37.105508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:37.105508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:37.105508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:37.105508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:37.105508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:37.105508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:37.105508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:37.105508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:37.105508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:37.105508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:37.105508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:37.105508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:37.105508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:37.105508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:37.106587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:37.106587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:37.106587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:37.106587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:37.106587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:37.106587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:37.106587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:37.106587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:37.106587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 493/978] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:37.106587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c328b-c613-4ab8-89a2-89b018c53c2b None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:37.125484 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:37.165649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 486/979] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 23 10:40:36 2022] POST /identity/v3/services => generated 242 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:40:37.166457 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a9b5a-7217-4ea7-b834-fcffe96fa316 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:37.202220 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:37.214153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c328b-c613-4ab8-89a2-89b018c53c2b None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:37.259395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c9ece-96dc-45c4-bb8e-03cfe60a25d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:37.260069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c9ece-96dc-45c4-bb8e-03cfe60a25d3 None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:37.260353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c9ece-96dc-45c4-bb8e-03cfe60a25d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:37.260626 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c9ece-96dc-45c4-bb8e-03cfe60a25d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:37.261406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c9ece-96dc-45c4-bb8e-03cfe60a25d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:37.262793 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c9ece-96dc-45c4-bb8e-03cfe60a25d3 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:37.292466 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a9b5a-7217-4ea7-b834-fcffe96fa316 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:37.328919 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766da3fa-3e3f-4393-b066-de65c25a6cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:37.329640 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766da3fa-3e3f-4393-b066-de65c25a6cbd None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:37.329934 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766da3fa-3e3f-4393-b066-de65c25a6cbd None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:37.330206 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766da3fa-3e3f-4393-b066-de65c25a6cbd None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:37.331006 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766da3fa-3e3f-4393-b066-de65c25a6cbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:37.331406 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766da3fa-3e3f-4393-b066-de65c25a6cbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:37.332889 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766da3fa-3e3f-4393-b066-de65c25a6cbd None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:37.338910 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 494/980] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jun 23 10:40:37 2022] POST /identity/v3/endpoints => generated 349 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:40:37.350657 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 487/981] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:37.353062 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c9ece-96dc-45c4-bb8e-03cfe60a25d3 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:37.428675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:37.474862 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c9ece-96dc-45c4-bb8e-03cfe60a25d3 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:37.514198 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231420e-9ffd-41d2-aee8-ae2400cf3799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:37.514869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231420e-9ffd-41d2-aee8-ae2400cf3799 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:37.515149 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231420e-9ffd-41d2-aee8-ae2400cf3799 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:37.515430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231420e-9ffd-41d2-aee8-ae2400cf3799 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:37.516276 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231420e-9ffd-41d2-aee8-ae2400cf3799 None admin] RBAC: Adding query filter params (role.id=ee4d134c98a24de99a5426a2ad83b147, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=1b03d940626a449dbe904f02f3d70854) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:37.516626 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231420e-9ffd-41d2-aee8-ae2400cf3799 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:37.518217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231420e-9ffd-41d2-aee8-ae2400cf3799 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:37.525673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 495/982] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:37 2022] GET /identity/v3/role_assignments?user.id=1b03d940626a449dbe904f02f3d70854&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=ee4d134c98a24de99a5426a2ad83b147 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:39.235269 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c2ffc-04ac-48bb-be2a-0027e581b5f7 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:39.235789 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c2ffc-04ac-48bb-be2a-0027e581b5f7 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:39.235895 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c2ffc-04ac-48bb-be2a-0027e581b5f7 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:39.237366 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 488/983] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:39.242518 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba290b-5f7b-4d09-926e-c3f54b5d6d4d None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:39.242923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba290b-5f7b-4d09-926e-c3f54b5d6d4d None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:39.243137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba290b-5f7b-4d09-926e-c3f54b5d6d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:39.259911 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-67ba290b-5f7b-4d09-926e-c3f54b5d6d4d None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:39.261140 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-67ba290b-5f7b-4d09-926e-c3f54b5d6d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:39.328672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 496/984] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:39.352065 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c2ffc-04ac-48bb-be2a-0027e581b5f7 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:39.434990 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:39.448722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba3861-dd78-47da-8d79-b133f4c9321e None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:39.449039 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba3861-dd78-47da-8d79-b133f4c9321e None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:39.457549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba3861-dd78-47da-8d79-b133f4c9321e None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:39.457549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 497/985] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:39.457549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b5728-1386-47d5-8507-d14ed9462abc None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:39.457549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b5728-1386-47d5-8507-d14ed9462abc None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:39.457549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b5728-1386-47d5-8507-d14ed9462abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:39.458566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c2ffc-04ac-48bb-be2a-0027e581b5f7 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:39.473970 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-170b5728-1386-47d5-8507-d14ed9462abc None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:39.475326 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-170b5728-1386-47d5-8507-d14ed9462abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:39.498146 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d01695-673b-4934-95e3-6c0c7763a579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:39.499275 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d01695-673b-4934-95e3-6c0c7763a579 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:39.499563 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d01695-673b-4934-95e3-6c0c7763a579 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:39.500158 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d01695-673b-4934-95e3-6c0c7763a579 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:39.501110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d01695-673b-4934-95e3-6c0c7763a579 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:39.502935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d01695-673b-4934-95e3-6c0c7763a579 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:39.517223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-77d01695-673b-4934-95e3-6c0c7763a579 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:40:39.517223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:39.517223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:39.517223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:39.517223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:39.517223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:39.517223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:39.517223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:39.517223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:40:39.517223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:39.517223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:39.517223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:39.517223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:39.517223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:39.517223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:39.517223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:39.517223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:39.518254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:39.518254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:39.518254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:39.518254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:39.518254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:39.518254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:39.518254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:39.518254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:39.518254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:39.518254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:39.518254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:39.518254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:39.518254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:39.518254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:39.518254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:39.518254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:39.519246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:39.519246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:39.519246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:39.519246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:39.519246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:39.519246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:39.519246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:39.519246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:39.519246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:39.519246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:39.519246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:39.519246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:39.519246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:40:39.519246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:39.519246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 489/986] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:39.525058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d01695-673b-4934-95e3-6c0c7763a579 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:39.537773 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:39.552271 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 498/987] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:40:39.575635 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b5728-1386-47d5-8507-d14ed9462abc None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:39.630082 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d01695-673b-4934-95e3-6c0c7763a579 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:39.664398 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb7be5-08e0-458f-9098-8949b3f5b16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:39.665130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb7be5-08e0-458f-9098-8949b3f5b16f None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:39.665423 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb7be5-08e0-458f-9098-8949b3f5b16f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:39.665697 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb7be5-08e0-458f-9098-8949b3f5b16f None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:39.666405 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb7be5-08e0-458f-9098-8949b3f5b16f None admin] RBAC: Adding query filter params (name=compute) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:39.666718 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb7be5-08e0-458f-9098-8949b3f5b16f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:39.668090 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb7be5-08e0-458f-9098-8949b3f5b16f None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:39.672863 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 490/988] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 23 10:40:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:39.674153 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfc353-90ff-4fc6-8c7b-303d2d97f584 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:39.674448 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfc353-90ff-4fc6-8c7b-303d2d97f584 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:39.674728 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfc353-90ff-4fc6-8c7b-303d2d97f584 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:39.675953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 491/989] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:39.681491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfc353-90ff-4fc6-8c7b-303d2d97f584 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:39.681746 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b5728-1386-47d5-8507-d14ed9462abc None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:39.692167 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:39.716503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf0d87-d817-457d-8e74-2255add6d71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:39.717469 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf0d87-d817-457d-8e74-2255add6d71d None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:39.717761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf0d87-d817-457d-8e74-2255add6d71d None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:39.718038 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf0d87-d817-457d-8e74-2255add6d71d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:39.718706 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf0d87-d817-457d-8e74-2255add6d71d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:39.720079 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf0d87-d817-457d-8e74-2255add6d71d None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:39.732217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-77bf0d87-d817-457d-8e74-2255add6d71d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:40:39.732217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:39.732217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:39.732217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:39.732217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:39.732217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:39.732217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:39.732217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:39.732217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:40:39.732217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:39.732217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:39.732217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:39.732217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:39.732217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:39.732217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:39.732217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:39.732217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:39.737212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:39.737212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:39.737212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:39.737212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:39.737212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:39.737212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:39.737212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:39.737212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:39.737212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:39.737212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:39.737212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:39.737212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:39.737212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:39.737212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:39.737212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:39.737212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:39.738051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:39.738051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:39.738051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:39.738051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:39.738051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:39.738051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:39.738051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:39.738051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:39.738051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:39.738051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:39.738051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:39.738051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:39.738051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:40:39.738051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:39.738051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 499/990] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 23 10:40:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:39.738836 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d49c20-4f5b-4c89-a434-df3f695de502 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:39.738836 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d49c20-4f5b-4c89-a434-df3f695de502 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:39.738836 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d49c20-4f5b-4c89-a434-df3f695de502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:39.754984 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-d8d49c20-4f5b-4c89-a434-df3f695de502 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:39.756103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-d8d49c20-4f5b-4c89-a434-df3f695de502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:39.785458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfc353-90ff-4fc6-8c7b-303d2d97f584 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:39.802565 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:39.820286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f1276-58c9-41c8-b574-1f84996df6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:39.821111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f1276-58c9-41c8-b574-1f84996df6df None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:39.821391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f1276-58c9-41c8-b574-1f84996df6df None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:39.821671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f1276-58c9-41c8-b574-1f84996df6df None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:39.822375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f1276-58c9-41c8-b574-1f84996df6df None admin] RBAC: Adding query filter params (type=compute) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:39.822686 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f1276-58c9-41c8-b574-1f84996df6df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:39.823183 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 500/991] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:39.824087 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d49c20-4f5b-4c89-a434-df3f695de502 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:39.824195 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f1276-58c9-41c8-b574-1f84996df6df None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:39.840362 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 492/992] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 23 10:40:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:39.841737 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f1276-58c9-41c8-b574-1f84996df6df None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:39.912244 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:39.922242 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d49c20-4f5b-4c89-a434-df3f695de502 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:39.941793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f1276-58c9-41c8-b574-1f84996df6df None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:39.956950 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad641d-876a-4e7d-9870-ed0fc9a74a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:39.957617 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad641d-876a-4e7d-9870-ed0fc9a74a58 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:39.957904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad641d-876a-4e7d-9870-ed0fc9a74a58 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:39.958180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad641d-876a-4e7d-9870-ed0fc9a74a58 None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:39.958883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad641d-876a-4e7d-9870-ed0fc9a74a58 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:39.959194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad641d-876a-4e7d-9870-ed0fc9a74a58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:39.960703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad641d-876a-4e7d-9870-ed0fc9a74a58 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:39.965407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 501/993] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 23 10:40:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:39.966174 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad641d-876a-4e7d-9870-ed0fc9a74a58 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:39.980797 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3554b2a-86c0-4ff2-ab69-a4fc1635a9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:39.981455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3554b2a-86c0-4ff2-ab69-a4fc1635a9f2 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:39.981744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3554b2a-86c0-4ff2-ab69-a4fc1635a9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:39.982022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3554b2a-86c0-4ff2-ab69-a4fc1635a9f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:39.982850 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3554b2a-86c0-4ff2-ab69-a4fc1635a9f2 None admin] RBAC: Adding query filter params (interface=public, service_id=f23bcb6ac6b746f1a3a17f054621f3f4, region_id=RegionOne) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:39.983174 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3554b2a-86c0-4ff2-ab69-a4fc1635a9f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:39.984536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3554b2a-86c0-4ff2-ab69-a4fc1635a9f2 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:39.994388 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 493/994] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jun 23 10:40:39 2022] GET /identity/v3/endpoints?service_id=f23bcb6ac6b746f1a3a17f054621f3f4&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:39.994388 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3554b2a-86c0-4ff2-ab69-a4fc1635a9f2 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:40.012275 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:40.064928 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad641d-876a-4e7d-9870-ed0fc9a74a58 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:40.090651 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3554b2a-86c0-4ff2-ab69-a4fc1635a9f2 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:40.099285 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f329f04-d047-4550-a031-879bb43e73e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:40.100077 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f329f04-d047-4550-a031-879bb43e73e8 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:40.100371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f329f04-d047-4550-a031-879bb43e73e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:40.100659 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f329f04-d047-4550-a031-879bb43e73e8 None admin] PATH_INFO: `/v3/services/image` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:40.102113 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f329f04-d047-4550-a031-879bb43e73e8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:40.103522 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f329f04-d047-4550-a031-879bb43e73e8 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:40.115041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-0f329f04-d047-4550-a031-879bb43e73e8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:40:40.115041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:40.115041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:40.115041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:40.115041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:40.115041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:40.115041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:40.115041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:40.115041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:40:40.115041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:40.115041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:40.115041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:40.115041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:40.115041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:40.115041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:40.115041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:40.115041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:40.116095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:40.116095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:40.116095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:40.116095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:40.116095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:40.116095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:40.116095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:40.116095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:40.116095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:40.116095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:40.116095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:40.116095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:40.116095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:40.116095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:40.116095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:40.116095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:40.118175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:40.118175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:40.118175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:40.118175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:40.118175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:40.118175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:40.118175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:40.118175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:40.118175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:40.118175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:40.118175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:40.118175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:40.118175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:40:40.118175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:40.118175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 502/995] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Jun 23 10:40:39 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:40.119034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f329f04-d047-4550-a031-879bb43e73e8 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:40.129276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb018b0-0281-4b58-b567-fa8cd56f834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:40.129941 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb018b0-0281-4b58-b567-fa8cd56f834b None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:40.130228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb018b0-0281-4b58-b567-fa8cd56f834b None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:40.130517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb018b0-0281-4b58-b567-fa8cd56f834b None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:40.131226 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb018b0-0281-4b58-b567-fa8cd56f834b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:40.131536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb018b0-0281-4b58-b567-fa8cd56f834b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:40.132965 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb018b0-0281-4b58-b567-fa8cd56f834b None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:40.134959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:40.138111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 494/996] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 23 10:40:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:40.138869 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb018b0-0281-4b58-b567-fa8cd56f834b None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:40.221498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f329f04-d047-4550-a031-879bb43e73e8 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:40.232233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:40.236851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb018b0-0281-4b58-b567-fa8cd56f834b None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:40.256063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b3552-7f56-4c8c-aec1-097320eac6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:40.256771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b3552-7f56-4c8c-aec1-097320eac6d3 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:40.257064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b3552-7f56-4c8c-aec1-097320eac6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:40.257378 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b3552-7f56-4c8c-aec1-097320eac6d3 None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:40.258099 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b3552-7f56-4c8c-aec1-097320eac6d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:40.259485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b3552-7f56-4c8c-aec1-097320eac6d3 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:40.266878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 503/997] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jun 23 10:40:40 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:40:40.267740 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b3552-7f56-4c8c-aec1-097320eac6d3 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:40.280396 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa45d03-83fa-46c4-ace3-f3f86cceed3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:40.281127 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa45d03-83fa-46c4-ace3-f3f86cceed3c None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:40.281415 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa45d03-83fa-46c4-ace3-f3f86cceed3c None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:40.281698 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa45d03-83fa-46c4-ace3-f3f86cceed3c None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:40.282439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa45d03-83fa-46c4-ace3-f3f86cceed3c None admin] RBAC: Adding query filter params (name=image) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:40.282762 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa45d03-83fa-46c4-ace3-f3f86cceed3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:40.284324 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa45d03-83fa-46c4-ace3-f3f86cceed3c None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:40.295155 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 495/998] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:40.296428 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa45d03-83fa-46c4-ace3-f3f86cceed3c None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:40.362845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:40.386822 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b3552-7f56-4c8c-aec1-097320eac6d3 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:40.404216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa45d03-83fa-46c4-ace3-f3f86cceed3c None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:40.427052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5aeb5b-d713-4453-a49a-b0446cbe4dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:40.427052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5aeb5b-d713-4453-a49a-b0446cbe4dd5 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:40.427363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5aeb5b-d713-4453-a49a-b0446cbe4dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:40.427500 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5aeb5b-d713-4453-a49a-b0446cbe4dd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:40.428295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5aeb5b-d713-4453-a49a-b0446cbe4dd5 None admin] RBAC: Adding query filter params (interface=admin, service_id=24800a05353b49a1ba570a9a303a0631, region_id=RegionOne) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:40.428607 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5aeb5b-d713-4453-a49a-b0446cbe4dd5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:40.430933 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5aeb5b-d713-4453-a49a-b0446cbe4dd5 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:40.438051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 504/999] 10.222.0.20 () {56 vars in 1249 bytes} [Thu Jun 23 10:40:40 2022] GET /identity/v3/endpoints?service_id=24800a05353b49a1ba570a9a303a0631&interface=admin®ion_id=RegionOne => generated 193 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:40.443196 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5aeb5b-d713-4453-a49a-b0446cbe4dd5 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:40.447600 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584ba8a-6c12-48f0-99f8-72d43dabc128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:40.448279 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584ba8a-6c12-48f0-99f8-72d43dabc128 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:40.448570 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584ba8a-6c12-48f0-99f8-72d43dabc128 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:40.448911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584ba8a-6c12-48f0-99f8-72d43dabc128 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:40.449629 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584ba8a-6c12-48f0-99f8-72d43dabc128 None admin] RBAC: Adding query filter params (type=image) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:40.449946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584ba8a-6c12-48f0-99f8-72d43dabc128 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:40.451329 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584ba8a-6c12-48f0-99f8-72d43dabc128 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:40.461225 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 496/1000] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:40.493996 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:40.561571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5aeb5b-d713-4453-a49a-b0446cbe4dd5 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:40.598247 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6e24d-0c19-4c19-9c08-6d2aaa1dd317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:40.598938 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6e24d-0c19-4c19-9c08-6d2aaa1dd317 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:40.599226 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6e24d-0c19-4c19-9c08-6d2aaa1dd317 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:40.599499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6e24d-0c19-4c19-9c08-6d2aaa1dd317 None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:40.600200 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6e24d-0c19-4c19-9c08-6d2aaa1dd317 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:40.602194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6e24d-0c19-4c19-9c08-6d2aaa1dd317 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:40.611927 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 505/1001] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jun 23 10:40:40 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:40:42.312387 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4732f-39d2-404d-bc5a-110961b5b2f4 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:42.312930 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4732f-39d2-404d-bc5a-110961b5b2f4 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:42.313009 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4732f-39d2-404d-bc5a-110961b5b2f4 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:42.314499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 497/1002] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:42.319968 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea1e0f-fb3b-4f03-b727-a217847baed9 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:42.320984 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea1e0f-fb3b-4f03-b727-a217847baed9 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:42.320984 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea1e0f-fb3b-4f03-b727-a217847baed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:42.338008 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-0eea1e0f-fb3b-4f03-b727-a217847baed9 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:42.339194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-0eea1e0f-fb3b-4f03-b727-a217847baed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:42.408363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 506/1003] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:42.431305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4732f-39d2-404d-bc5a-110961b5b2f4 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:42.506604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09666e7-b7fd-4f94-a062-73bc8644a2c3 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:42.506956 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09666e7-b7fd-4f94-a062-73bc8644a2c3 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:42.507256 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09666e7-b7fd-4f94-a062-73bc8644a2c3 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:42.509112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 507/1004] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:40:42.513867 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fe056-28ae-45b6-b1a1-3a5b48ca8cef None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:42.514156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fe056-28ae-45b6-b1a1-3a5b48ca8cef None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:42.514432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fe056-28ae-45b6-b1a1-3a5b48ca8cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:42.531166 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-592fe056-28ae-45b6-b1a1-3a5b48ca8cef None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:42.532476 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-592fe056-28ae-45b6-b1a1-3a5b48ca8cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:42.540243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4732f-39d2-404d-bc5a-110961b5b2f4 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:42.560710 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:42.569937 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:42.577846 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f012b0-a276-4ca3-84e6-4983fe2be535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:42.578643 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f012b0-a276-4ca3-84e6-4983fe2be535 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:42.578930 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f012b0-a276-4ca3-84e6-4983fe2be535 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:42.579219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f012b0-a276-4ca3-84e6-4983fe2be535 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:42.579874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f012b0-a276-4ca3-84e6-4983fe2be535 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:42.581274 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f012b0-a276-4ca3-84e6-4983fe2be535 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:42.593278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-13f012b0-a276-4ca3-84e6-4983fe2be535 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:40:42.593278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:42.593278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:42.593278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:42.593278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:42.593278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:42.593278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:42.593278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:42.593278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:40:42.593278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:42.593278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:42.593278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:42.593278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:42.593278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:42.593278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:42.593278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:42.593278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:42.594511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:42.594511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:42.594511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:42.594511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:42.594511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:42.594511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:42.594511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:42.594511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:42.594511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:42.594511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:42.594511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:42.594511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:42.594511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:42.594511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:42.594511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:42.594511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:42.595803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:42.595803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:42.595803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:42.595803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:42.595803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:42.595803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:42.595803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:42.595803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:42.595803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:42.595803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:42.595803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:42.595803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:42.595803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:40:42.595803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:42.595803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 498/1005] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:42.600214 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f012b0-a276-4ca3-84e6-4983fe2be535 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:42.617050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 508/1006] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:40:42.633231 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fe056-28ae-45b6-b1a1-3a5b48ca8cef None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:42.710207 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f012b0-a276-4ca3-84e6-4983fe2be535 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:42.735854 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fe056-28ae-45b6-b1a1-3a5b48ca8cef None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:42.743166 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f260ac-6521-4c25-888e-c5abc6866c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:42.743839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f260ac-6521-4c25-888e-c5abc6866c8b None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:42.744129 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f260ac-6521-4c25-888e-c5abc6866c8b None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:42.744420 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f260ac-6521-4c25-888e-c5abc6866c8b None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:42.745161 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f260ac-6521-4c25-888e-c5abc6866c8b None admin] RBAC: Adding query filter params (name=compute) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:42.745503 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f260ac-6521-4c25-888e-c5abc6866c8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:42.746879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f260ac-6521-4c25-888e-c5abc6866c8b None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:42.752161 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 499/1007] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 23 10:40:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:42.753453 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b4b0c-794c-40cb-b3d5-989b0831b705 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:42.753752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b4b0c-794c-40cb-b3d5-989b0831b705 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:42.754042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b4b0c-794c-40cb-b3d5-989b0831b705 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:42.755393 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 500/1008] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:42.760939 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b4b0c-794c-40cb-b3d5-989b0831b705 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:42.771814 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedcbf2-e2d4-4b66-8bd9-1f4a1ac26799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:42.772525 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedcbf2-e2d4-4b66-8bd9-1f4a1ac26799 None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:42.772930 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedcbf2-e2d4-4b66-8bd9-1f4a1ac26799 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:42.773299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedcbf2-e2d4-4b66-8bd9-1f4a1ac26799 None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:42.774019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedcbf2-e2d4-4b66-8bd9-1f4a1ac26799 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:42.775393 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedcbf2-e2d4-4b66-8bd9-1f4a1ac26799 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:42.816153 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:42.859056 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b4b0c-794c-40cb-b3d5-989b0831b705 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:42.874549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 509/1009] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 23 10:40:42 2022] POST /identity/v3/services => generated 242 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:40:42.876026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b86851-edb5-4e3c-a97c-6119fbc17637 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:42.876370 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b86851-edb5-4e3c-a97c-6119fbc17637 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:42.876763 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b86851-edb5-4e3c-a97c-6119fbc17637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:42.895841 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-49b86851-edb5-4e3c-a97c-6119fbc17637 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:42.898105 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-49b86851-edb5-4e3c-a97c-6119fbc17637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:42.902894 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7061b6-2e0d-40e6-bb38-f2a08310bd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:42.903580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7061b6-2e0d-40e6-bb38-f2a08310bd7c None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:42.903865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7061b6-2e0d-40e6-bb38-f2a08310bd7c None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:42.904272 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7061b6-2e0d-40e6-bb38-f2a08310bd7c None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:42.905057 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7061b6-2e0d-40e6-bb38-f2a08310bd7c None admin] RBAC: Adding query filter params (type=compute) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:42.905335 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7061b6-2e0d-40e6-bb38-f2a08310bd7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:42.906729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7061b6-2e0d-40e6-bb38-f2a08310bd7c None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:42.917364 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 501/1010] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 23 10:40:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:42.918493 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7061b6-2e0d-40e6-bb38-f2a08310bd7c None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:42.921839 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:42.984943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 510/1011] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:42 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:43.006317 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b86851-edb5-4e3c-a97c-6119fbc17637 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:43.037242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7061b6-2e0d-40e6-bb38-f2a08310bd7c None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:43.057331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:43.077629 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f93e89-3284-404c-b312-4a4ee791e556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:43.078296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f93e89-3284-404c-b312-4a4ee791e556 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:43.078582 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f93e89-3284-404c-b312-4a4ee791e556 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:43.078861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f93e89-3284-404c-b312-4a4ee791e556 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:43.079606 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f93e89-3284-404c-b312-4a4ee791e556 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:43.081038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f93e89-3284-404c-b312-4a4ee791e556 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:43.113590 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b86851-edb5-4e3c-a97c-6119fbc17637 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:43.148309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c568e8-d7cf-4f17-88a8-1fbcc98c2bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:43.149223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c568e8-d7cf-4f17-88a8-1fbcc98c2bfb None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:43.149506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c568e8-d7cf-4f17-88a8-1fbcc98c2bfb None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:43.149780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c568e8-d7cf-4f17-88a8-1fbcc98c2bfb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:43.150429 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c568e8-d7cf-4f17-88a8-1fbcc98c2bfb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:43.151824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c568e8-d7cf-4f17-88a8-1fbcc98c2bfb None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:43.168662 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 502/1012] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jun 23 10:40:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:40:43.168876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-e5c568e8-d7cf-4f17-88a8-1fbcc98c2bfb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:40:43.168876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:43.168876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:43.168876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:43.168876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:43.168876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:43.168876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:43.168876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:43.168876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:40:43.168876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:43.168876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:43.168876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:43.168876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:43.168876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:43.168876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:43.168876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:43.168876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:43.170043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:43.170043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:43.170043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:43.170043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:43.170043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:43.170043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:43.170043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:43.170043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:43.170043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:43.170043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:43.170043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:43.170043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:43.170043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:43.170043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:43.170043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:43.170043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:43.171051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:43.171051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:43.171051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:43.171051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:43.171051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:43.171051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:43.171051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:43.171051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:43.171051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:43.171051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:43.171051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:43.171051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:43.171051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:40:43.171051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:43.171051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 511/1013] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 23 10:40:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:43.173019 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f93e89-3284-404c-b312-4a4ee791e556 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:43.292793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f93e89-3284-404c-b312-4a4ee791e556 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:43.329216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56370ac-a472-4ab9-9820-3a8565ff259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:43.329976 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56370ac-a472-4ab9-9820-3a8565ff259d None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:43.330327 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56370ac-a472-4ab9-9820-3a8565ff259d None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:43.330679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56370ac-a472-4ab9-9820-3a8565ff259d None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:43.331389 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56370ac-a472-4ab9-9820-3a8565ff259d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:43.331698 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56370ac-a472-4ab9-9820-3a8565ff259d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:43.333091 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56370ac-a472-4ab9-9820-3a8565ff259d None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:43.338522 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 503/1014] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 23 10:40:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:43.344267 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c568e8-d7cf-4f17-88a8-1fbcc98c2bfb None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:43.364089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:43.455038 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c568e8-d7cf-4f17-88a8-1fbcc98c2bfb None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:43.489212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc9dad-7526-43b8-851b-792f9f377f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:43.489883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc9dad-7526-43b8-851b-792f9f377f70 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:43.490167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc9dad-7526-43b8-851b-792f9f377f70 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:43.490444 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc9dad-7526-43b8-851b-792f9f377f70 None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:43.491695 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc9dad-7526-43b8-851b-792f9f377f70 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:43.492006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc9dad-7526-43b8-851b-792f9f377f70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:43.493398 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc9dad-7526-43b8-851b-792f9f377f70 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:43.498589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 512/1015] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 23 10:40:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:43.504397 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56370ac-a472-4ab9-9820-3a8565ff259d None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:43.537366 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:43.605617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56370ac-a472-4ab9-9820-3a8565ff259d None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:43.647741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07e519-fd1a-4956-82bb-fa406ca0e4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:43.648405 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07e519-fd1a-4956-82bb-fa406ca0e4a9 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:43.648735 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07e519-fd1a-4956-82bb-fa406ca0e4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:43.649014 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07e519-fd1a-4956-82bb-fa406ca0e4a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:43.649749 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07e519-fd1a-4956-82bb-fa406ca0e4a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:43.651110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07e519-fd1a-4956-82bb-fa406ca0e4a9 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:43.724673 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 504/1016] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jun 23 10:40:43 2022] POST /identity/v3/endpoints => generated 325 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:40:44.954332 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752ebb1-dd85-489c-9601-34aab12a20cd None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:44.954819 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752ebb1-dd85-489c-9601-34aab12a20cd None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:44.954819 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752ebb1-dd85-489c-9601-34aab12a20cd None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:44.956354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 513/1017] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:44.961886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9493c5-e983-423a-a81b-c71feb59ad9d None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:44.962309 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9493c5-e983-423a-a81b-c71feb59ad9d None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:44.962450 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9493c5-e983-423a-a81b-c71feb59ad9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:44.979565 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-4f9493c5-e983-423a-a81b-c71feb59ad9d None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:44.980774 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-4f9493c5-e983-423a-a81b-c71feb59ad9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:45.052554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 505/1018] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:45.075564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752ebb1-dd85-489c-9601-34aab12a20cd None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:45.157642 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:45.177622 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752ebb1-dd85-489c-9601-34aab12a20cd None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:45.212132 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9342a5-2120-4367-9ce2-afdfc34b54bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:45.212872 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9342a5-2120-4367-9ce2-afdfc34b54bb None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:45.213157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9342a5-2120-4367-9ce2-afdfc34b54bb None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:45.213437 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9342a5-2120-4367-9ce2-afdfc34b54bb None admin] PATH_INFO: `/v3/services/image` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:45.214085 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9342a5-2120-4367-9ce2-afdfc34b54bb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:45.215455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9342a5-2120-4367-9ce2-afdfc34b54bb None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:45.227712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-3b9342a5-2120-4367-9ce2-afdfc34b54bb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:40:45.227712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:45.227712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:45.227712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:45.227712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:45.227712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:45.227712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:45.227712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:45.227712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:40:45.227712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:45.227712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:45.227712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:45.227712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:45.227712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:45.227712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:45.227712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:45.227712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:45.228972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:45.228972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:45.228972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:45.228972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:45.228972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:45.228972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:45.228972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:45.228972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:45.228972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:45.228972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:45.228972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:45.228972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:45.228972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:45.228972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:45.228972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:45.228972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:45.229858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:45.229858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:45.229858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:45.229858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:45.229858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:45.229858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:45.229858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:45.229858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:45.229858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:45.229858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:45.229858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:45.229858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:45.229858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:40:45.229858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:45.229858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 514/1019] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Jun 23 10:40:45 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:45.235044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9493c5-e983-423a-a81b-c71feb59ad9d None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:45.254395 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:45.312437 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f4354-8abc-4cd9-b078-f8f01425bf96 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:45.312790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f4354-8abc-4cd9-b078-f8f01425bf96 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:45.313030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f4354-8abc-4cd9-b078-f8f01425bf96 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:45.314525 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 515/1020] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:45.319765 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b8df7-dfc1-4808-bb61-4973ec1e2c39 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:45.320063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b8df7-dfc1-4808-bb61-4973ec1e2c39 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:45.320346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b8df7-dfc1-4808-bb61-4973ec1e2c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:45.338417 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-fb3b8df7-dfc1-4808-bb61-4973ec1e2c39 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:45.338632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9493c5-e983-423a-a81b-c71feb59ad9d None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:45.339588 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-fb3b8df7-dfc1-4808-bb61-4973ec1e2c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:45.377635 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cf2aa-05dd-4bd2-bdf6-991c4de394f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:45.379079 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cf2aa-05dd-4bd2-bdf6-991c4de394f8 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:45.379370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cf2aa-05dd-4bd2-bdf6-991c4de394f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:45.379651 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cf2aa-05dd-4bd2-bdf6-991c4de394f8 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:45.380364 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cf2aa-05dd-4bd2-bdf6-991c4de394f8 None admin] RBAC: Adding query filter params (name=image) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:45.380702 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cf2aa-05dd-4bd2-bdf6-991c4de394f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:45.382592 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cf2aa-05dd-4bd2-bdf6-991c4de394f8 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:45.392093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 506/1021] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:45.395296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cf2aa-05dd-4bd2-bdf6-991c4de394f8 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:45.420673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 516/1022] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:40:45.440237 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b8df7-dfc1-4808-bb61-4973ec1e2c39 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:45.484862 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:45.503814 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cf2aa-05dd-4bd2-bdf6-991c4de394f8 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:45.517188 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:45.541806 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d36afe-d0c8-4fff-b58e-8bb10fa6f26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:45.542288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b8df7-dfc1-4808-bb61-4973ec1e2c39 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:45.542483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d36afe-d0c8-4fff-b58e-8bb10fa6f26f None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:45.542766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d36afe-d0c8-4fff-b58e-8bb10fa6f26f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:45.543049 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d36afe-d0c8-4fff-b58e-8bb10fa6f26f None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:45.543765 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d36afe-d0c8-4fff-b58e-8bb10fa6f26f None admin] RBAC: Adding query filter params (type=image) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:45.544073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d36afe-d0c8-4fff-b58e-8bb10fa6f26f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:45.545521 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d36afe-d0c8-4fff-b58e-8bb10fa6f26f None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:45.555997 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 507/1023] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:45.557294 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d36afe-d0c8-4fff-b58e-8bb10fa6f26f None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:45.578959 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba2cd5-123d-48e5-a2ba-6e876125287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:45.579762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba2cd5-123d-48e5-a2ba-6e876125287d None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:45.580049 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba2cd5-123d-48e5-a2ba-6e876125287d None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:45.580324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba2cd5-123d-48e5-a2ba-6e876125287d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:45.591679 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba2cd5-123d-48e5-a2ba-6e876125287d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:45.600422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-94ba2cd5-123d-48e5-a2ba-6e876125287d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:40:45.600422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:45.600422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:45.600422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:45.600422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:45.600422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:45.600422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:45.600422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:45.600422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:45.600422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:45.600422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:45.600422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:45.600422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:45.600422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:45.600422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:45.600422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:45.601432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:45.601432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:45.601432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:45.601432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:45.601432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:45.601432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:45.601432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:45.601432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:45.601432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:45.601432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:45.601432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:45.601432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:45.601432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:45.601432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:45.601432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:45.601432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:45.607335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:45.607335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:45.607335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:45.607335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:45.607335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:45.607335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:45.607335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:45.607335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:45.607335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:45.607335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:45.607335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:40:45.607335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:45.607335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 517/1024] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jun 23 10:40:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:45.608023 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba2cd5-123d-48e5-a2ba-6e876125287d None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:45.671431 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d36afe-d0c8-4fff-b58e-8bb10fa6f26f None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:45.706680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a3b67-64fc-460a-ac41-8355d6a1301f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:45.707338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a3b67-64fc-460a-ac41-8355d6a1301f None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:45.707632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a3b67-64fc-460a-ac41-8355d6a1301f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:45.707909 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a3b67-64fc-460a-ac41-8355d6a1301f None admin] PATH_INFO: `/v3/endpoints` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:45.708724 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a3b67-64fc-460a-ac41-8355d6a1301f None admin] RBAC: Adding query filter params (interface=public, service_id=08aff299a9ae40c59f47ed933b913c0b, region_id=RegionOne) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:45.709044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a3b67-64fc-460a-ac41-8355d6a1301f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:45.710711 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a3b67-64fc-460a-ac41-8355d6a1301f None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:45.715891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 508/1025] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jun 23 10:40:45 2022] GET /identity/v3/endpoints?service_id=08aff299a9ae40c59f47ed933b913c0b&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:45.718161 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba2cd5-123d-48e5-a2ba-6e876125287d None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:45.721266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a3b67-64fc-460a-ac41-8355d6a1301f None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:45.734196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:45.754804 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11329c-c527-4ae4-bfb8-faaf6917db87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:45.755859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11329c-c527-4ae4-bfb8-faaf6917db87 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:45.756304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11329c-c527-4ae4-bfb8-faaf6917db87 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:45.757358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11329c-c527-4ae4-bfb8-faaf6917db87 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:45.758151 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11329c-c527-4ae4-bfb8-faaf6917db87 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:45.758460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11329c-c527-4ae4-bfb8-faaf6917db87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:45.759847 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11329c-c527-4ae4-bfb8-faaf6917db87 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:45.761491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:45.769717 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 518/1026] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jun 23 10:40:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:45.776264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11329c-c527-4ae4-bfb8-faaf6917db87 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:45.831564 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a3b67-64fc-460a-ac41-8355d6a1301f None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:45.864039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f416d62-4d33-4fdc-933f-49b8a3369ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:45.864728 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f416d62-4d33-4fdc-933f-49b8a3369ad3 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:45.865019 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f416d62-4d33-4fdc-933f-49b8a3369ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:45.865301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f416d62-4d33-4fdc-933f-49b8a3369ad3 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:45.866502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f416d62-4d33-4fdc-933f-49b8a3369ad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:45.867871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f416d62-4d33-4fdc-933f-49b8a3369ad3 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:45.874495 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 509/1027] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jun 23 10:40:45 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:40:45.875681 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac866a3-7566-4247-8bef-22e2b98c9e7c None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:45.875980 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac866a3-7566-4247-8bef-22e2b98c9e7c None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:45.876261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac866a3-7566-4247-8bef-22e2b98c9e7c None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:45.877687 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 510/1028] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:45.878883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11329c-c527-4ae4-bfb8-faaf6917db87 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:45.883952 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b48b2-f3d4-46fd-aa25-21ecd72a2b35 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:45.884245 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b48b2-f3d4-46fd-aa25-21ecd72a2b35 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:45.884530 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b48b2-f3d4-46fd-aa25-21ecd72a2b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:45.902323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-971b48b2-f3d4-46fd-aa25-21ecd72a2b35 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:45.903568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-971b48b2-f3d4-46fd-aa25-21ecd72a2b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:45.923943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6cf2e-aabb-4238-a638-ea89bbb2c16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:45.924826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6cf2e-aabb-4238-a638-ea89bbb2c16f None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:45.925114 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6cf2e-aabb-4238-a638-ea89bbb2c16f None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:45.925390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6cf2e-aabb-4238-a638-ea89bbb2c16f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:45.937500 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f6cf2e-aabb-4238-a638-ea89bbb2c16f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:45.938991 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f6cf2e-aabb-4238-a638-ea89bbb2c16f None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:45.958443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-19f6cf2e-aabb-4238-a638-ea89bbb2c16f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:45.958443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:45.958443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:45.958443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:45.958443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:45.958443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:45.958443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:45.958443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:45.958443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:45.958443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:45.958443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:45.958443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:45.958443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:45.958443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:45.958443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:45.965309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:45.965309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:45.965309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:45.965309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:45.965309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:45.965309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:45.965309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:45.965309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:45.965309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:45.965309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:45.965309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:45.965309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:45.965309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:45.965309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:45.965309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:45.965309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:45.965309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:45.966227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:45.966227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:45.966227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:45.966227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:45.966227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 519/1029] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:45.966227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6cf2e-aabb-4238-a638-ea89bbb2c16f None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:45.984921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 511/1030] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:40:46.010398 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b48b2-f3d4-46fd-aa25-21ecd72a2b35 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:46.013555 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:46.028612 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:46.085957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6cf2e-aabb-4238-a638-ea89bbb2c16f None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:46.120397 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af90b4-0f01-4015-8cd3-183b47a1e693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:46.121100 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af90b4-0f01-4015-8cd3-183b47a1e693 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:46.121391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af90b4-0f01-4015-8cd3-183b47a1e693 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:46.121671 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af90b4-0f01-4015-8cd3-183b47a1e693 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:46.122394 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af90b4-0f01-4015-8cd3-183b47a1e693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:46.122702 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af90b4-0f01-4015-8cd3-183b47a1e693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:46.124377 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af90b4-0f01-4015-8cd3-183b47a1e693 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:46.126123 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b48b2-f3d4-46fd-aa25-21ecd72a2b35 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:46.135740 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 520/1031] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:46.141141 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af90b4-0f01-4015-8cd3-183b47a1e693 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:46.168241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426777e9-41ba-463b-90ae-300d56912903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:46.169339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426777e9-41ba-463b-90ae-300d56912903 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:46.169928 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426777e9-41ba-463b-90ae-300d56912903 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:46.170212 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426777e9-41ba-463b-90ae-300d56912903 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:46.171402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426777e9-41ba-463b-90ae-300d56912903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:46.172864 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426777e9-41ba-463b-90ae-300d56912903 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:46.174498 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 512/1032] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:46.180707 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426777e9-41ba-463b-90ae-300d56912903 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:46.255620 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af90b4-0f01-4015-8cd3-183b47a1e693 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:46.256297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:46.271016 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:46.289623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426777e9-41ba-463b-90ae-300d56912903 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:46.297776 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde6232-bbaa-43b5-b783-e30412c1ae87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:46.298578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde6232-bbaa-43b5-b783-e30412c1ae87 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:46.298857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde6232-bbaa-43b5-b783-e30412c1ae87 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:46.299214 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde6232-bbaa-43b5-b783-e30412c1ae87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:46.308920 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde6232-bbaa-43b5-b783-e30412c1ae87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:46.310408 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde6232-bbaa-43b5-b783-e30412c1ae87 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:46.326343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-adde6232-bbaa-43b5-b783-e30412c1ae87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:40:46.326343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:46.326343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:46.326343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:46.326343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:46.326343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:46.326343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:46.326343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:46.326343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:46.326343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:46.326343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:46.326343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:46.326343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:46.326343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:46.326343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:46.326343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:46.327535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:46.327535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:46.327535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:46.327535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:46.327535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:46.327535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:46.327535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:46.327535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:46.327535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:46.327535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:46.327535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:46.327535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:46.327535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:46.327535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:46.327535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:46.327535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:46.327535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:46.327535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:46.328748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:46.328748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:46.328748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:46.328748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:46.328748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:46.328748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:46.328748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:46.328748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:46.328748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:40:46.328748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:46.329413 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2614e-e161-4755-9144-a4ecc66004d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:46.329413 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2614e-e161-4755-9144-a4ecc66004d0 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:46.329413 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2614e-e161-4755-9144-a4ecc66004d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:46.329413 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2614e-e161-4755-9144-a4ecc66004d0 None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:46.329677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2614e-e161-4755-9144-a4ecc66004d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:46.329808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2614e-e161-4755-9144-a4ecc66004d0 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:46.331878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 521/1033] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jun 23 10:40:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:46.337131 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde6232-bbaa-43b5-b783-e30412c1ae87 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:46.428911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 513/1034] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 23 10:40:46 2022] POST /identity/v3/projects => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:40:46.441336 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde6232-bbaa-43b5-b783-e30412c1ae87 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:46.480208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9590a-b5c2-4a41-8652-7215f74350a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:46.480939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9590a-b5c2-4a41-8652-7215f74350a4 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:46.481236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9590a-b5c2-4a41-8652-7215f74350a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:46.481647 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9590a-b5c2-4a41-8652-7215f74350a4 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:46.482536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9590a-b5c2-4a41-8652-7215f74350a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:46.482853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9590a-b5c2-4a41-8652-7215f74350a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:46.484311 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9590a-b5c2-4a41-8652-7215f74350a4 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:46.511025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 522/1035] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jun 23 10:40:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:46.512345 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2614e-e161-4755-9144-a4ecc66004d0 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:46.630712 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2614e-e161-4755-9144-a4ecc66004d0 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:46.656040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:46.667671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fdfece-b8c1-4bc2-a0ba-6246c91ad3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:46.668325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdfece-b8c1-4bc2-a0ba-6246c91ad3b1 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:46.668607 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdfece-b8c1-4bc2-a0ba-6246c91ad3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:46.668932 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdfece-b8c1-4bc2-a0ba-6246c91ad3b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:46.736324 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fdfece-b8c1-4bc2-a0ba-6246c91ad3b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:46.737813 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fdfece-b8c1-4bc2-a0ba-6246c91ad3b1 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:46.835650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 514/1036] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:46 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:40:46.841138 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9590a-b5c2-4a41-8652-7215f74350a4 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:46.869308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:46.944024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9590a-b5c2-4a41-8652-7215f74350a4 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:46.978413 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68b14c-c723-49d8-8c77-fcca84a57078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:46.979207 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68b14c-c723-49d8-8c77-fcca84a57078 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:46.979489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68b14c-c723-49d8-8c77-fcca84a57078 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:46.979763 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68b14c-c723-49d8-8c77-fcca84a57078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:46.990165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68b14c-c723-49d8-8c77-fcca84a57078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:46.992691 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68b14c-c723-49d8-8c77-fcca84a57078 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:47.011949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-4f68b14c-c723-49d8-8c77-fcca84a57078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:47.011949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:47.011949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:47.011949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:47.011949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:47.011949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:47.011949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:47.011949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:47.011949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:47.011949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:47.011949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:47.011949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:47.011949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:47.011949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:47.011949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:47.013144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:47.013144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:47.013144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:47.013144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:47.013144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:47.013144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:47.013144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:47.013144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:47.013144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:47.013144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:47.013144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:47.013144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:47.013144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:47.013144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:47.013144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:47.013144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:47.013144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:47.014069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:47.014069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:47.014069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:47.014069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:47.016958 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 523/1037] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:47.018787 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fdfece-b8c1-4bc2-a0ba-6246c91ad3b1 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:47.043926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:47.118166 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fdfece-b8c1-4bc2-a0ba-6246c91ad3b1 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:47.151849 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c152c-54a5-4f0a-8266-8e2285a22e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:47.152437 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c152c-54a5-4f0a-8266-8e2285a22e5f None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:47.152746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c152c-54a5-4f0a-8266-8e2285a22e5f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:47.153025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c152c-54a5-4f0a-8266-8e2285a22e5f None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:47.153742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c152c-54a5-4f0a-8266-8e2285a22e5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:47.154048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c152c-54a5-4f0a-8266-8e2285a22e5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:47.155413 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c152c-54a5-4f0a-8266-8e2285a22e5f None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:47.171784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 515/1038] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:47.172965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68b14c-c723-49d8-8c77-fcca84a57078 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:47.250073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:47.271551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68b14c-c723-49d8-8c77-fcca84a57078 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:47.307775 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27516f1c-e731-4d29-ad9b-ac58f9d0fc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:47.308808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27516f1c-e731-4d29-ad9b-ac58f9d0fc9a None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:47.309268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27516f1c-e731-4d29-ad9b-ac58f9d0fc9a None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:47.309702 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27516f1c-e731-4d29-ad9b-ac58f9d0fc9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:47.316392 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27516f1c-e731-4d29-ad9b-ac58f9d0fc9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:47.318016 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27516f1c-e731-4d29-ad9b-ac58f9d0fc9a None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:47.332312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-27516f1c-e731-4d29-ad9b-ac58f9d0fc9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:47.332312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:47.332312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:47.332312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:47.332312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:47.332312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:47.332312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:47.332312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:47.332312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:47.332312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:47.332312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:47.332312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:47.332312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:47.332312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:47.332312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:47.333293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:47.333293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:47.333293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:47.333293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:47.333293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:47.333293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:47.333293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:47.333293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:47.333293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:47.333293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:47.333293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:47.333293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:47.333293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:47.333293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:47.333293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:47.333293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:47.333293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:47.339486 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:47.339486 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:47.339486 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:47.339486 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:47.339486 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:47.339486 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:47.339486 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:47.339486 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:47.339486 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 524/1039] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:47.340129 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c152c-54a5-4f0a-8266-8e2285a22e5f None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:47.427373 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:47.443458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c152c-54a5-4f0a-8266-8e2285a22e5f None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:47.477807 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202877b-09a5-471d-99f4-152e59d39079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:47.478476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202877b-09a5-471d-99f4-152e59d39079 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:47.478764 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202877b-09a5-471d-99f4-152e59d39079 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:47.479041 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202877b-09a5-471d-99f4-152e59d39079 None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:47.479826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202877b-09a5-471d-99f4-152e59d39079 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:47.480138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202877b-09a5-471d-99f4-152e59d39079 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:47.481587 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202877b-09a5-471d-99f4-152e59d39079 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:47.498884 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 516/1040] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:47.500094 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27516f1c-e731-4d29-ad9b-ac58f9d0fc9a None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:47.604652 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27516f1c-e731-4d29-ad9b-ac58f9d0fc9a None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:47.643874 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3eb73c-e46e-4448-bd84-636496602e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:47.644533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3eb73c-e46e-4448-bd84-636496602e86 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:47.644842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3eb73c-e46e-4448-bd84-636496602e86 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:47.645123 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3eb73c-e46e-4448-bd84-636496602e86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:47.645948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3eb73c-e46e-4448-bd84-636496602e86 None admin] RBAC: Adding query filter params (role.id=ee4d134c98a24de99a5426a2ad83b147, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=39840f048d254831bdb963b38520f706) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:47.646264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3eb73c-e46e-4448-bd84-636496602e86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:47.647723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3eb73c-e46e-4448-bd84-636496602e86 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:47.655314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 525/1041] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:47 2022] GET /identity/v3/role_assignments?user.id=39840f048d254831bdb963b38520f706&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=ee4d134c98a24de99a5426a2ad83b147 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:47.934246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b9092-e7fc-48d2-a898-aee68b9da836 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:47.934639 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b9092-e7fc-48d2-a898-aee68b9da836 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:47.934833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b9092-e7fc-48d2-a898-aee68b9da836 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:47.936297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 517/1042] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:47.941389 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620996c0-f0df-4008-91db-ad21290a36e2 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:47.941687 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620996c0-f0df-4008-91db-ad21290a36e2 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:47.941965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620996c0-f0df-4008-91db-ad21290a36e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:47.947149 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:47.960003 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-620996c0-f0df-4008-91db-ad21290a36e2 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:47.961368 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-620996c0-f0df-4008-91db-ad21290a36e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:48.029366 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 526/1043] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:48.053174 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b9092-e7fc-48d2-a898-aee68b9da836 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:48.157696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b9092-e7fc-48d2-a898-aee68b9da836 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:48.191998 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4baea2-ee1e-4ba0-a707-c6660489b25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:48.192727 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4baea2-ee1e-4ba0-a707-c6660489b25a None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:48.193015 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4baea2-ee1e-4ba0-a707-c6660489b25a None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:48.193291 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4baea2-ee1e-4ba0-a707-c6660489b25a None admin] PATH_INFO: `/v3/services/image` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:48.194017 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4baea2-ee1e-4ba0-a707-c6660489b25a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:48.195517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4baea2-ee1e-4ba0-a707-c6660489b25a None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:48.206871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-7c4baea2-ee1e-4ba0-a707-c6660489b25a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:40:48.206871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:48.206871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:48.206871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:48.206871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:48.206871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:48.206871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:48.206871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:48.206871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:40:48.206871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:48.206871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:48.206871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:48.206871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:48.206871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:48.206871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:48.206871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:48.206871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:48.207826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:48.207826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:48.207826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:48.207826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:48.207826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:48.207826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:48.207826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:48.207826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:48.207826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:48.207826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:48.207826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:48.207826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:48.207826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:48.207826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:48.207826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:48.207826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:48.209060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:48.209060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:48.209060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:48.209060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:48.209060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:48.209060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:48.209060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:48.209060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:48.209060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:48.209060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:48.209060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:48.209060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:48.209060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:40:48.209060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:48.212967 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 518/1044] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Jun 23 10:40:48 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:48.214709 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620996c0-f0df-4008-91db-ad21290a36e2 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:48.313692 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620996c0-f0df-4008-91db-ad21290a36e2 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:48.343772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:48.349188 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399792e-6606-4cdf-b4a7-2e56af467415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:48.349964 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399792e-6606-4cdf-b4a7-2e56af467415 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:48.350264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399792e-6606-4cdf-b4a7-2e56af467415 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:48.350523 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399792e-6606-4cdf-b4a7-2e56af467415 None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:48.351199 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399792e-6606-4cdf-b4a7-2e56af467415 None admin] RBAC: Adding query filter params (name=image) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:48.351511 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399792e-6606-4cdf-b4a7-2e56af467415 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:48.352899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399792e-6606-4cdf-b4a7-2e56af467415 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:48.357941 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 527/1045] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:48.363409 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4baea2-ee1e-4ba0-a707-c6660489b25a None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:48.375516 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:48.465350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4baea2-ee1e-4ba0-a707-c6660489b25a None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:48.497561 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a81795-cec7-4c1f-bdc0-537656b71688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:48.498481 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a81795-cec7-4c1f-bdc0-537656b71688 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:48.498763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a81795-cec7-4c1f-bdc0-537656b71688 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:48.499039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a81795-cec7-4c1f-bdc0-537656b71688 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:48.499739 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a81795-cec7-4c1f-bdc0-537656b71688 None admin] RBAC: Adding query filter params (type=image) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:48.500044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a81795-cec7-4c1f-bdc0-537656b71688 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:48.501514 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a81795-cec7-4c1f-bdc0-537656b71688 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:48.507097 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 519/1046] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:48.512490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399792e-6606-4cdf-b4a7-2e56af467415 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:48.531982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ed91d-6290-401f-b91f-152891deadce None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:48.532271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ed91d-6290-401f-b91f-152891deadce None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:48.532554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ed91d-6290-401f-b91f-152891deadce None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:48.534046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 520/1047] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:40:48.540697 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b835ab-0ef4-4ce0-a2ee-673f3e4ace97 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:48.540994 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b835ab-0ef4-4ce0-a2ee-673f3e4ace97 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:48.541273 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b835ab-0ef4-4ce0-a2ee-673f3e4ace97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:48.557752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-98b835ab-0ef4-4ce0-a2ee-673f3e4ace97 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:48.558948 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-98b835ab-0ef4-4ce0-a2ee-673f3e4ace97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:48.630595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399792e-6606-4cdf-b4a7-2e56af467415 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:48.632317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 521/1048] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:40:48.657643 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b835ab-0ef4-4ce0-a2ee-673f3e4ace97 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:48.659787 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:48.668359 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f52d90-4a73-484f-a3dd-d2cc2915d6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:48.669245 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52d90-4a73-484f-a3dd-d2cc2915d6d4 None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:48.669673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52d90-4a73-484f-a3dd-d2cc2915d6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:48.670116 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52d90-4a73-484f-a3dd-d2cc2915d6d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:48.671021 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f52d90-4a73-484f-a3dd-d2cc2915d6d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:48.672546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f52d90-4a73-484f-a3dd-d2cc2915d6d4 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:48.725220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 528/1049] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jun 23 10:40:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:40:48.770387 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b835ab-0ef4-4ce0-a2ee-673f3e4ace97 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:48.815091 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6697f-23f6-4967-98fe-a9b50eaff2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:48.815907 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6697f-23f6-4967-98fe-a9b50eaff2d7 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:48.816188 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6697f-23f6-4967-98fe-a9b50eaff2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:48.816459 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6697f-23f6-4967-98fe-a9b50eaff2d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:48.817710 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6697f-23f6-4967-98fe-a9b50eaff2d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:48.819865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6697f-23f6-4967-98fe-a9b50eaff2d7 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:48.826406 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 522/1050] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:48.827502 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f52d90-4a73-484f-a3dd-d2cc2915d6d4 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:48.882785 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:48.930465 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f52d90-4a73-484f-a3dd-d2cc2915d6d4 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:48.964595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a925e6d-d5e5-47ed-aab8-e3d268f58af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:48.965296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a925e6d-d5e5-47ed-aab8-e3d268f58af8 None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:48.965577 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a925e6d-d5e5-47ed-aab8-e3d268f58af8 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:48.965847 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a925e6d-d5e5-47ed-aab8-e3d268f58af8 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:48.966565 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a925e6d-d5e5-47ed-aab8-e3d268f58af8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:48.967990 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a925e6d-d5e5-47ed-aab8-e3d268f58af8 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:49.031330 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 529/1051] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 23 10:40:48 2022] POST /identity/v3/users => generated 285 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:40:49.678449 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf20385-6f5f-4443-8582-f0bb2f6e76ee None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:49.678959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf20385-6f5f-4443-8582-f0bb2f6e76ee None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:49.679037 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf20385-6f5f-4443-8582-f0bb2f6e76ee None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:49.680539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 523/1052] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:49.685573 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af802-cef0-4bcd-b542-aacc6c020fa4 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:49.685874 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af802-cef0-4bcd-b542-aacc6c020fa4 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:49.686155 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af802-cef0-4bcd-b542-aacc6c020fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:49.702903 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-8c1af802-cef0-4bcd-b542-aacc6c020fa4 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:49.704083 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8c1af802-cef0-4bcd-b542-aacc6c020fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:49.770105 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 530/1053] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:49.793996 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf20385-6f5f-4443-8582-f0bb2f6e76ee None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:49.862563 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:49.904834 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf20385-6f5f-4443-8582-f0bb2f6e76ee None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:49.939281 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7d9f5-ce58-4bb6-9141-faf4ddca4228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:49.940095 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7d9f5-ce58-4bb6-9141-faf4ddca4228 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:49.940383 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7d9f5-ce58-4bb6-9141-faf4ddca4228 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:49.940673 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7d9f5-ce58-4bb6-9141-faf4ddca4228 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:49.951628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7d9f5-ce58-4bb6-9141-faf4ddca4228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:49.960623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-3db7d9f5-ce58-4bb6-9141-faf4ddca4228 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:40:49.960623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:49.960623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:49.960623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:49.960623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:49.960623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:49.960623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:49.960623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:49.960623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:49.960623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:49.960623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:49.960623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:49.960623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:49.960623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:49.960623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:49.960623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:49.961588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:49.961588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:49.961588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:49.961588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:49.961588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:49.961588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:49.961588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:49.961588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:49.961588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:49.961588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:49.961588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:49.961588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:49.961588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:49.961588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:49.961588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:49.961588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:49.962414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:49.962414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:49.962414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:49.962414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:49.962414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:49.962414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:49.962414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:49.962414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:49.962414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:49.962414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:49.962414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:40:49.962414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:49.962414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 524/1054] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jun 23 10:40:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:49.967921 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1af802-cef0-4bcd-b542-aacc6c020fa4 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:50.010612 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:50.069733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1af802-cef0-4bcd-b542-aacc6c020fa4 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:50.104060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07ae10-73bf-4acb-a0a0-3ca5de9e8f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:50.104803 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07ae10-73bf-4acb-a0a0-3ca5de9e8f88 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:50.105039 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07ae10-73bf-4acb-a0a0-3ca5de9e8f88 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:50.105316 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07ae10-73bf-4acb-a0a0-3ca5de9e8f88 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:50.106064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07ae10-73bf-4acb-a0a0-3ca5de9e8f88 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:50.106372 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07ae10-73bf-4acb-a0a0-3ca5de9e8f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:50.107738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07ae10-73bf-4acb-a0a0-3ca5de9e8f88 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:50.120661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 531/1055] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jun 23 10:40:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:50.122204 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7d9f5-ce58-4bb6-9141-faf4ddca4228 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:50.227151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7d9f5-ce58-4bb6-9141-faf4ddca4228 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:50.252303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:50.261450 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6c8ff-b8a4-4fdf-b5f2-f4998bc210b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:50.264748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6c8ff-b8a4-4fdf-b5f2-f4998bc210b7 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:50.264748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6c8ff-b8a4-4fdf-b5f2-f4998bc210b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:50.264748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6c8ff-b8a4-4fdf-b5f2-f4998bc210b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:50.273950 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6c8ff-b8a4-4fdf-b5f2-f4998bc210b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:50.275406 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6c8ff-b8a4-4fdf-b5f2-f4998bc210b7 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:50.293096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-24d6c8ff-b8a4-4fdf-b5f2-f4998bc210b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:50.293096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:50.293096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:50.293096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:50.293096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:50.293096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:50.293096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:50.293096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:50.293096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:50.293096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:50.293096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:50.293096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:50.293096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:50.293096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:50.293096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:50.294081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:50.294081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:50.294081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:50.294081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:50.294081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:50.294081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:50.294081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:50.294081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:50.294081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:50.294081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:50.294081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:50.294081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:50.294081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:50.294081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:50.294081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:50.294081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:50.294081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:50.295062 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:50.295062 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:50.295062 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:50.295062 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:50.296959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 525/1056] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:50.300108 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07ae10-73bf-4acb-a0a0-3ca5de9e8f88 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:50.401075 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:50.404887 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07ae10-73bf-4acb-a0a0-3ca5de9e8f88 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:50.438479 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e079e7-2489-4b7d-9e8b-39e7670e17b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:50.439155 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e079e7-2489-4b7d-9e8b-39e7670e17b3 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:50.439441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e079e7-2489-4b7d-9e8b-39e7670e17b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:50.439717 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e079e7-2489-4b7d-9e8b-39e7670e17b3 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:50.440435 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e079e7-2489-4b7d-9e8b-39e7670e17b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:50.440770 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e079e7-2489-4b7d-9e8b-39e7670e17b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:50.442147 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e079e7-2489-4b7d-9e8b-39e7670e17b3 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:50.459809 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 532/1057] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:50.461477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6c8ff-b8a4-4fdf-b5f2-f4998bc210b7 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:50.562758 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6c8ff-b8a4-4fdf-b5f2-f4998bc210b7 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:50.596406 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f0b94-2b24-4c68-9dd4-95180ba3b2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:50.597220 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f0b94-2b24-4c68-9dd4-95180ba3b2a1 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:50.597502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f0b94-2b24-4c68-9dd4-95180ba3b2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:50.597778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f0b94-2b24-4c68-9dd4-95180ba3b2a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:50.607796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f0b94-2b24-4c68-9dd4-95180ba3b2a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:50.607796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f0b94-2b24-4c68-9dd4-95180ba3b2a1 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:50.630624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-dd6f0b94-2b24-4c68-9dd4-95180ba3b2a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:40:50.630624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:50.630624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:50.630624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:50.630624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:50.630624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:50.630624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:50.630624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:50.630624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:50.630624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:50.630624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:50.630624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:50.630624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:50.630624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:50.630624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:50.630624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:50.635538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:50.635538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:50.635538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:50.635538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:50.635538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:50.635538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:50.635538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:50.635538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:50.635538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:50.635538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:50.635538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:50.635538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:50.635538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:50.635538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:50.635538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:50.635538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:50.635538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:50.635538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:50.636513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:50.636513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:50.636513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:50.636513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:50.636513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:50.636513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:50.636513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:50.636513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:50.636513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:40:50.636513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:50.636513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 526/1058] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jun 23 10:40:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:50.638703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e079e7-2489-4b7d-9e8b-39e7670e17b3 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:50.739520 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e079e7-2489-4b7d-9e8b-39e7670e17b3 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:50.774035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e7d5f-884d-40cd-bfa4-034675d79e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:50.774715 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e7d5f-884d-40cd-bfa4-034675d79e6b None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:50.774999 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e7d5f-884d-40cd-bfa4-034675d79e6b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:50.775274 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e7d5f-884d-40cd-bfa4-034675d79e6b None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:50.776108 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e7d5f-884d-40cd-bfa4-034675d79e6b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:50.776417 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e7d5f-884d-40cd-bfa4-034675d79e6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:50.777874 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e7d5f-884d-40cd-bfa4-034675d79e6b None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:50.800151 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 533/1059] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jun 23 10:40:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:50.801828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f0b94-2b24-4c68-9dd4-95180ba3b2a1 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:50.840865 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97a7c9-4a69-438a-93ff-7e6ff5d675e3 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:50.841142 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97a7c9-4a69-438a-93ff-7e6ff5d675e3 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:50.841349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97a7c9-4a69-438a-93ff-7e6ff5d675e3 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:50.842876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 534/1060] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:40:50.843329 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:50.847534 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe70e2-92f0-46ef-a108-097a518c0fd0 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:50.847823 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe70e2-92f0-46ef-a108-097a518c0fd0 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:50.848102 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe70e2-92f0-46ef-a108-097a518c0fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:50.865021 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-cffe70e2-92f0-46ef-a108-097a518c0fd0 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:50.866893 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-cffe70e2-92f0-46ef-a108-097a518c0fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:50.881314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:50.910312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f0b94-2b24-4c68-9dd4-95180ba3b2a1 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:50.936673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 535/1061] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:40:50.949536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf13035-6154-41fc-903a-63443a90724e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:50.950338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf13035-6154-41fc-903a-63443a90724e None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:50.950626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf13035-6154-41fc-903a-63443a90724e None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:50.950904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf13035-6154-41fc-903a-63443a90724e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:50.961400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe70e2-92f0-46ef-a108-097a518c0fd0 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:50.962414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf13035-6154-41fc-903a-63443a90724e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:50.963870 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf13035-6154-41fc-903a-63443a90724e None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:50.984040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-bdf13035-6154-41fc-903a-63443a90724e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:50.984040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:50.984040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:50.984040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:50.984040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:50.984040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:50.984040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:50.984040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:50.984040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:50.984040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:50.984040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:50.984040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:50.984040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:50.984040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:50.984040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:50.985021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:50.985021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:50.985021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:50.985021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:50.985021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:50.985021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:50.985021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:50.985021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:50.985021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:50.985021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:50.985021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:50.985021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:50.985021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:50.985021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:50.985021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:50.985021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:50.985021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:50.986622 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:50.986622 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:50.986622 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:50.986622 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:50.986622 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 527/1062] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:50.990979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf13035-6154-41fc-903a-63443a90724e None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:51.067608 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe70e2-92f0-46ef-a108-097a518c0fd0 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:51.082371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:51.092726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf13035-6154-41fc-903a-63443a90724e None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:51.106329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b997274-c82c-45a5-bab9-76a3fa115b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:51.106997 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b997274-c82c-45a5-bab9-76a3fa115b51 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:51.107281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b997274-c82c-45a5-bab9-76a3fa115b51 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:51.107557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b997274-c82c-45a5-bab9-76a3fa115b51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:51.125551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:51.127635 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4b16d-96e1-4f59-a628-2fa3a571718b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:51.128295 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4b16d-96e1-4f59-a628-2fa3a571718b None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:51.128577 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4b16d-96e1-4f59-a628-2fa3a571718b None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:51.128880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4b16d-96e1-4f59-a628-2fa3a571718b None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:51.129602 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4b16d-96e1-4f59-a628-2fa3a571718b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:51.129908 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4b16d-96e1-4f59-a628-2fa3a571718b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:51.131321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4b16d-96e1-4f59-a628-2fa3a571718b None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:51.142423 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 528/1063] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:51.143673 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4be6d6-46b3-4818-95bb-c79410245b27 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:51.143967 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4be6d6-46b3-4818-95bb-c79410245b27 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:51.144250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4be6d6-46b3-4818-95bb-c79410245b27 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:51.145909 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 529/1064] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:51.148658 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4be6d6-46b3-4818-95bb-c79410245b27 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:51.176579 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b997274-c82c-45a5-bab9-76a3fa115b51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:51.178374 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b997274-c82c-45a5-bab9-76a3fa115b51 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:51.248406 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4be6d6-46b3-4818-95bb-c79410245b27 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:51.275596 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 536/1065] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 10:40:51.276990 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe4eda-516d-4cb5-8d07-5cf6466baa78 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:51.277291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe4eda-516d-4cb5-8d07-5cf6466baa78 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:51.277568 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe4eda-516d-4cb5-8d07-5cf6466baa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:51.282149 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11ebe1-60f3-464b-9ebf-cbc6ed69b190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:51.282937 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11ebe1-60f3-464b-9ebf-cbc6ed69b190 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:51.283222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11ebe1-60f3-464b-9ebf-cbc6ed69b190 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:51.283498 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11ebe1-60f3-464b-9ebf-cbc6ed69b190 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:51.290753 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11ebe1-60f3-464b-9ebf-cbc6ed69b190 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:51.292188 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11ebe1-60f3-464b-9ebf-cbc6ed69b190 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:51.293798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-77fe4eda-516d-4cb5-8d07-5cf6466baa78 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:51.294990 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-77fe4eda-516d-4cb5-8d07-5cf6466baa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:51.305837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-2a11ebe1-60f3-464b-9ebf-cbc6ed69b190 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:51.305837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:51.305837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:51.305837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:51.305837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:51.305837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:51.305837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:51.305837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:51.305837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:51.305837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:51.305837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:51.305837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:51.305837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:51.305837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:51.305837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:51.306750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:51.306750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:51.306750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:51.306750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:51.306750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:51.306750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:51.306750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:51.306750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:51.306750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:51.306750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:51.306750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:51.306750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:51.306750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:51.306750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:51.306750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:51.306750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:51.306750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:51.307634 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:51.307634 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:51.307634 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:51.307634 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:51.307634 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:51.307634 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:51.307634 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:51.307634 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:51.307634 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 530/1066] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:51.312483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11ebe1-60f3-464b-9ebf-cbc6ed69b190 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:51.325888 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:51.340339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:51.362419 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 537/1067] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:51.363236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe4eda-516d-4cb5-8d07-5cf6466baa78 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:51.420096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11ebe1-60f3-464b-9ebf-cbc6ed69b190 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:51.452839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff9a82-907e-4237-a669-01a5ef68d923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:51.453628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff9a82-907e-4237-a669-01a5ef68d923 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:51.453916 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff9a82-907e-4237-a669-01a5ef68d923 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:51.454196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff9a82-907e-4237-a669-01a5ef68d923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:51.461953 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe4eda-516d-4cb5-8d07-5cf6466baa78 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:51.465164 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff9a82-907e-4237-a669-01a5ef68d923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:51.466604 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff9a82-907e-4237-a669-01a5ef68d923 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:51.483671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-a3ff9a82-907e-4237-a669-01a5ef68d923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:51.483671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:51.483671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:51.483671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:51.483671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:51.483671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:51.483671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:51.483671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:51.483671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:51.483671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:51.483671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:51.483671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:51.483671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:51.483671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:51.483671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:51.484568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:51.484568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:51.484568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:51.484568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:51.484568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:51.484568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:51.484568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:51.484568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:51.484568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:51.484568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:51.484568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:51.484568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:51.484568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:51.484568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:51.484568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:51.484568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:51.484568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:51.485517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:51.485517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:51.485517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:51.485517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:51.485517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 531/1068] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:51.485803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff9a82-907e-4237-a669-01a5ef68d923 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:51.499035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6d9b8-cd83-4fa4-be15-fb12fd350353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:51.499707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6d9b8-cd83-4fa4-be15-fb12fd350353 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:51.499991 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6d9b8-cd83-4fa4-be15-fb12fd350353 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:51.500270 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6d9b8-cd83-4fa4-be15-fb12fd350353 None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:51.501095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6d9b8-cd83-4fa4-be15-fb12fd350353 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:51.501410 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6d9b8-cd83-4fa4-be15-fb12fd350353 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:51.502840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6d9b8-cd83-4fa4-be15-fb12fd350353 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:51.514753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 538/1069] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:51.515530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6d9b8-cd83-4fa4-be15-fb12fd350353 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:51.545284 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:51.555653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:51.582685 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff9a82-907e-4237-a669-01a5ef68d923 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:51.614197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6d9b8-cd83-4fa4-be15-fb12fd350353 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:51.617831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c6304-e806-45ae-b0dd-06afac08fad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:51.618347 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c6304-e806-45ae-b0dd-06afac08fad8 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:51.618635 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c6304-e806-45ae-b0dd-06afac08fad8 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:51.618913 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c6304-e806-45ae-b0dd-06afac08fad8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:51.629462 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c6304-e806-45ae-b0dd-06afac08fad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:51.637261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-f50c6304-e806-45ae-b0dd-06afac08fad8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:51.637261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:51.637261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:51.637261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:51.637261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:51.637261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:51.637261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:51.637261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:51.637261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:51.637261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:51.637261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:51.637261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:51.637261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:51.637261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:51.637261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:51.637261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:51.638374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:51.638374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:51.638374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:51.638374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:51.638374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:51.638374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:51.638374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:51.638374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:51.638374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:51.638374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:51.638374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:51.638374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:51.638374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:51.638374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:51.638374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:51.638374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:51.639414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:51.639414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:51.639414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:51.639414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:51.639414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:51.639414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:51.639414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:51.639414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:51.639414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:51.639414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:51.639414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:51.639414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:51.639414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 532/1070] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:40:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:51.639414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c6304-e806-45ae-b0dd-06afac08fad8 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:51.654357 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbbf53-b4be-4250-b666-a37d3e908dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:51.655023 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbbf53-b4be-4250-b666-a37d3e908dfc None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:51.655308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbbf53-b4be-4250-b666-a37d3e908dfc None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:51.655590 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbbf53-b4be-4250-b666-a37d3e908dfc None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:51.656315 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbbf53-b4be-4250-b666-a37d3e908dfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:51.656627 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbbf53-b4be-4250-b666-a37d3e908dfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:51.658018 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbbf53-b4be-4250-b666-a37d3e908dfc None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:51.670088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 539/1071] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:51.670880 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbbf53-b4be-4250-b666-a37d3e908dfc None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:51.752298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c6304-e806-45ae-b0dd-06afac08fad8 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:51.778311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:51.781382 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:51.785461 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbbf53-b4be-4250-b666-a37d3e908dfc None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:51.791911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3c750-c7a4-45b1-83e8-3327cf726dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:51.796723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3c750-c7a4-45b1-83e8-3327cf726dcf None admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:51.796723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3c750-c7a4-45b1-83e8-3327cf726dcf None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:51.796723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3c750-c7a4-45b1-83e8-3327cf726dcf None admin] PATH_INFO: `/v3/projects/d7a9c82a62044db884e547da9a523927/users/39840f048d254831bdb963b38520f706/roles/ee4d134c98a24de99a5426a2ad83b147` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:51.796723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3c750-c7a4-45b1-83e8-3327cf726dcf None admin] RBAC: Authorizing `identity:create_grant(project_id=d7a9c82a62044db884e547da9a523927, user_id=39840f048d254831bdb963b38520f706, role_id=ee4d134c98a24de99a5426a2ad83b147)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:51.797698 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3c750-c7a4-45b1-83e8-3327cf726dcf None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:51.821942 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd971af-4c1c-42d3-a72f-4588fef9bc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:51.822620 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd971af-4c1c-42d3-a72f-4588fef9bc9b None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:51.822906 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd971af-4c1c-42d3-a72f-4588fef9bc9b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:51.823184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd971af-4c1c-42d3-a72f-4588fef9bc9b None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:51.823945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd971af-4c1c-42d3-a72f-4588fef9bc9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:51.824256 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd971af-4c1c-42d3-a72f-4588fef9bc9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:51.825667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd971af-4c1c-42d3-a72f-4588fef9bc9b None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:51.835424 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 540/1072] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:40:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:51.840794 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd971af-4c1c-42d3-a72f-4588fef9bc9b None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:51.868513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 533/1073] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:40:51 2022] PUT /identity/v3/projects/d7a9c82a62044db884e547da9a523927/users/39840f048d254831bdb963b38520f706/roles/ee4d134c98a24de99a5426a2ad83b147 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:40:51.957254 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd971af-4c1c-42d3-a72f-4588fef9bc9b None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:51.996675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1854c9e-aafb-4a4c-b0f3-019480017624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:51.997888 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1854c9e-aafb-4a4c-b0f3-019480017624 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:51.998186 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1854c9e-aafb-4a4c-b0f3-019480017624 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:51.998461 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1854c9e-aafb-4a4c-b0f3-019480017624 None admin] PATH_INFO: `/v3/users/4a9f913358ac4314a968dfbebae29b91` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:52.013826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1854c9e-aafb-4a4c-b0f3-019480017624 None admin] RBAC: Authorizing `identity:get_user(user_id=4a9f913358ac4314a968dfbebae29b91)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:52.015292 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1854c9e-aafb-4a4c-b0f3-019480017624 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:52.017086 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 541/1074] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:40:51 2022] GET /identity/v3/users/4a9f913358ac4314a968dfbebae29b91 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:52.023787 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3c750-c7a4-45b1-83e8-3327cf726dcf None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:52.127534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3c750-c7a4-45b1-83e8-3327cf726dcf None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:52.161853 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5cfa0-9624-4bd5-a17a-49062290cdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:52.162669 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5cfa0-9624-4bd5-a17a-49062290cdb0 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:52.162960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5cfa0-9624-4bd5-a17a-49062290cdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:52.163241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5cfa0-9624-4bd5-a17a-49062290cdb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:52.212145 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:52.230391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5cfa0-9624-4bd5-a17a-49062290cdb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:52.231845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5cfa0-9624-4bd5-a17a-49062290cdb0 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:52.342235 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 534/1075] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:40:52.348190 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1854c9e-aafb-4a4c-b0f3-019480017624 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:52.366577 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:52.447201 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1854c9e-aafb-4a4c-b0f3-019480017624 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:52.480143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cbc53-9304-420d-874e-af7d79b673fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:52.481024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cbc53-9304-420d-874e-af7d79b673fe None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:52.481305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cbc53-9304-420d-874e-af7d79b673fe None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:52.481577 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cbc53-9304-420d-874e-af7d79b673fe None admin] PATH_INFO: `/v3/projects/5b88af301bf146218d0685e7b06ff6d6` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:52.482739 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69cbc53-9304-420d-874e-af7d79b673fe None admin] RBAC: Authorizing `identity:get_project(project_id=5b88af301bf146218d0685e7b06ff6d6)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:52.484157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69cbc53-9304-420d-874e-af7d79b673fe None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:52.485877 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 542/1076] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:40:52 2022] GET /identity/v3/projects/5b88af301bf146218d0685e7b06ff6d6 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:52.492682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5cfa0-9624-4bd5-a17a-49062290cdb0 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:52.575321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:52.592581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5cfa0-9624-4bd5-a17a-49062290cdb0 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:52.629764 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2c8c3-978b-47c7-88a5-e437fc3fa8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:52.630421 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2c8c3-978b-47c7-88a5-e437fc3fa8be None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:52.631393 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2c8c3-978b-47c7-88a5-e437fc3fa8be None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:52.631678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2c8c3-978b-47c7-88a5-e437fc3fa8be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:52.632505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2c8c3-978b-47c7-88a5-e437fc3fa8be None admin] RBAC: Adding query filter params (role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.project.id=5b88af301bf146218d0685e7b06ff6d6, user.id=4a9f913358ac4314a968dfbebae29b91) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:52.632846 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2c8c3-978b-47c7-88a5-e437fc3fa8be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:52.634356 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2c8c3-978b-47c7-88a5-e437fc3fa8be None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:52.639735 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 535/1077] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:52 2022] GET /identity/v3/role_assignments?user.id=4a9f913358ac4314a968dfbebae29b91&scope.project.id=5b88af301bf146218d0685e7b06ff6d6&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:53.914062 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028630c-bde4-4bc7-957a-3454137c8425 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:53.914578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028630c-bde4-4bc7-957a-3454137c8425 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:53.914578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028630c-bde4-4bc7-957a-3454137c8425 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:53.915876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 543/1078] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:53.921115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b62b8d-7d9b-4a13-bf75-0f8e537a1a3d None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:53.921515 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b62b8d-7d9b-4a13-bf75-0f8e537a1a3d None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:53.921741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b62b8d-7d9b-4a13-bf75-0f8e537a1a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:53.938065 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-73b62b8d-7d9b-4a13-bf75-0f8e537a1a3d None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:53.939227 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-73b62b8d-7d9b-4a13-bf75-0f8e537a1a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:54.003538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 536/1079] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:40:54.027528 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028630c-bde4-4bc7-957a-3454137c8425 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:54.112748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:54.129049 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028630c-bde4-4bc7-957a-3454137c8425 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:54.165877 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea203fb-febc-4874-b175-9c4238c02a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:54.166621 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea203fb-febc-4874-b175-9c4238c02a6c None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:54.166905 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea203fb-febc-4874-b175-9c4238c02a6c None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:54.167177 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea203fb-febc-4874-b175-9c4238c02a6c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:54.176968 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea203fb-febc-4874-b175-9c4238c02a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:54.185790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-8ea203fb-febc-4874-b175-9c4238c02a6c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:40:54.185790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:54.185790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:54.185790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:54.185790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:54.185790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:54.185790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:54.185790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:54.185790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:54.185790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:54.185790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:54.185790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:54.185790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:54.185790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:54.185790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:54.185790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:54.186902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:54.186902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:54.186902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:54.186902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:54.186902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:54.186902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:54.186902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:54.186902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:54.186902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:54.186902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:54.186902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:54.186902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:54.186902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:54.186902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:54.186902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:54.186902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:54.187738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:54.187738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:54.187738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:54.187738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:54.187738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:54.187738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:54.187738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:54.187738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:54.187738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:54.187738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:54.187738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:40:54.187738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:54.191771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 544/1080] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jun 23 10:40:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:54.193759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b62b8d-7d9b-4a13-bf75-0f8e537a1a3d None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:54.268553 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:54.291222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b62b8d-7d9b-4a13-bf75-0f8e537a1a3d None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:54.325049 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012aa68-5f70-4818-b054-7954f4036449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:54.325748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012aa68-5f70-4818-b054-7954f4036449 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:54.326036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012aa68-5f70-4818-b054-7954f4036449 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:54.326313 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012aa68-5f70-4818-b054-7954f4036449 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:54.327059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012aa68-5f70-4818-b054-7954f4036449 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:54.327368 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012aa68-5f70-4818-b054-7954f4036449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:54.328745 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012aa68-5f70-4818-b054-7954f4036449 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:54.337184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 537/1081] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jun 23 10:40:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:54.342718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea203fb-febc-4874-b175-9c4238c02a6c None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:54.439637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea203fb-febc-4874-b175-9c4238c02a6c None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:54.472575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea0fa7-b5c8-40e2-bc24-6e38465ec19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:54.473416 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea0fa7-b5c8-40e2-bc24-6e38465ec19c None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:54.473705 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea0fa7-b5c8-40e2-bc24-6e38465ec19c None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:54.474507 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea0fa7-b5c8-40e2-bc24-6e38465ec19c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:54.484930 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea0fa7-b5c8-40e2-bc24-6e38465ec19c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:54.486377 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea0fa7-b5c8-40e2-bc24-6e38465ec19c None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:54.493127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:54.504182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-42ea0fa7-b5c8-40e2-bc24-6e38465ec19c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:54.504182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:54.504182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:54.504182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:54.504182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:54.504182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:54.504182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:54.504182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:54.504182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:54.504182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:54.504182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:54.504182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:54.504182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:54.504182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:54.504182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:54.509969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:54.509969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:54.509969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:54.509969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:54.509969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:54.509969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:54.509969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:54.509969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:54.509969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:54.509969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:54.509969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:54.509969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:54.509969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:54.509969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:54.509969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:54.509969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:54.509969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:54.510903 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:54.510903 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:54.510903 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:54.510903 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:54.510903 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 545/1082] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:54.511466 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012aa68-5f70-4818-b054-7954f4036449 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:54.609512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012aa68-5f70-4818-b054-7954f4036449 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:54.645643 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5402ea9-3bd0-40e9-ba25-3d239d417688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:54.646791 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5402ea9-3bd0-40e9-ba25-3d239d417688 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:54.647072 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5402ea9-3bd0-40e9-ba25-3d239d417688 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:54.647344 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5402ea9-3bd0-40e9-ba25-3d239d417688 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:54.648088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5402ea9-3bd0-40e9-ba25-3d239d417688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:54.648392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5402ea9-3bd0-40e9-ba25-3d239d417688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:54.649785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5402ea9-3bd0-40e9-ba25-3d239d417688 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:54.656772 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:54.662092 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 538/1083] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:54.667732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea0fa7-b5c8-40e2-bc24-6e38465ec19c None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:54.748663 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c7f94-fbc5-4541-a388-6c5f1a4f3743 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:54.748969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c7f94-fbc5-4541-a388-6c5f1a4f3743 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:54.749332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c7f94-fbc5-4541-a388-6c5f1a4f3743 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:54.750766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 539/1084] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:40:54.756232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc8d68-7cb1-459a-b92f-b0594d3dd5d5 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:54.756517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc8d68-7cb1-459a-b92f-b0594d3dd5d5 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:54.756810 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc8d68-7cb1-459a-b92f-b0594d3dd5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:54.765644 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea0fa7-b5c8-40e2-bc24-6e38465ec19c None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:54.774223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-3bdc8d68-7cb1-459a-b92f-b0594d3dd5d5 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:54.775410 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-3bdc8d68-7cb1-459a-b92f-b0594d3dd5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:54.799241 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f69e7-5340-49f8-8bed-3077e9602a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:54.800034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f69e7-5340-49f8-8bed-3077e9602a3e None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:54.800319 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f69e7-5340-49f8-8bed-3077e9602a3e None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:54.800598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f69e7-5340-49f8-8bed-3077e9602a3e None admin] PATH_INFO: `/v3/users/nova` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:54.808480 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f69e7-5340-49f8-8bed-3077e9602a3e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:54.809962 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f69e7-5340-49f8-8bed-3077e9602a3e None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:54.824761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-e63f69e7-5340-49f8-8bed-3077e9602a3e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:40:54.824761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:54.824761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:54.824761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:54.824761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:54.824761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:54.824761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:54.824761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:54.824761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:54.824761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:54.824761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:54.824761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:54.824761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:54.824761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:54.824761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:54.824761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:54.825869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:54.825869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:54.825869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:54.825869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:54.825869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:54.825869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:54.825869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:54.825869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:54.825869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:54.825869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:54.825869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:54.825869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:54.825869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:54.825869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:54.825869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:54.825869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:54.825869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:54.825869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:54.827307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:54.827307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:54.827307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:54.827307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:54.827307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:54.827307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:54.827307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:54.827307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:54.827307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:40:54.827307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:54.827307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 546/1085] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jun 23 10:40:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:54.831563 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f69e7-5340-49f8-8bed-3077e9602a3e None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:54.842280 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 540/1086] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:40:54.865088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc8d68-7cb1-459a-b92f-b0594d3dd5d5 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:54.890238 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:54.930436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f69e7-5340-49f8-8bed-3077e9602a3e None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:54.962180 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc8d68-7cb1-459a-b92f-b0594d3dd5d5 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:54.963896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385eeec-3825-4bbb-90e6-da28a1d7f025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:54.964580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385eeec-3825-4bbb-90e6-da28a1d7f025 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:54.964896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385eeec-3825-4bbb-90e6-da28a1d7f025 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:54.965177 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385eeec-3825-4bbb-90e6-da28a1d7f025 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:54.966014 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385eeec-3825-4bbb-90e6-da28a1d7f025 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:54.966330 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385eeec-3825-4bbb-90e6-da28a1d7f025 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:54.967772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385eeec-3825-4bbb-90e6-da28a1d7f025 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:54.985663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 547/1087] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jun 23 10:40:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:54.988326 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:54.992061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385eeec-3825-4bbb-90e6-da28a1d7f025 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:54.997926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c2de2-d5f9-4c3a-96cc-58431cec0fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:55.001097 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c2de2-d5f9-4c3a-96cc-58431cec0fe4 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:55.001097 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c2de2-d5f9-4c3a-96cc-58431cec0fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:55.001097 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c2de2-d5f9-4c3a-96cc-58431cec0fe4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:55.011159 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c2de2-d5f9-4c3a-96cc-58431cec0fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:55.018924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-e65c2de2-d5f9-4c3a-96cc-58431cec0fe4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:55.018924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:55.018924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:55.018924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:55.018924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:55.018924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:55.018924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:55.018924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:55.018924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:55.018924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:55.018924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:55.018924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:55.018924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:55.018924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:55.018924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:55.018924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:55.019879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:55.019879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:55.019879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:55.019879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:55.019879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:55.019879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:55.019879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:55.019879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:55.019879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:55.019879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:55.019879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:55.019879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:55.019879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:55.019879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:55.019879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:55.019879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:55.020822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:55.020822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:55.020822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:55.020822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:55.020822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:55.020822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:55.020822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:55.020822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:55.020822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:55.020822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:55.020822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:55.020822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:55.024126 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 541/1088] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:40:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:55.029485 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c2de2-d5f9-4c3a-96cc-58431cec0fe4 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:55.092949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385eeec-3825-4bbb-90e6-da28a1d7f025 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:55.109143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:55.126534 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc4d58-8dbe-4d06-ae48-f8add90e4069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:55.127189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc4d58-8dbe-4d06-ae48-f8add90e4069 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:55.127311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c2de2-d5f9-4c3a-96cc-58431cec0fe4 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:55.127472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc4d58-8dbe-4d06-ae48-f8add90e4069 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:55.127753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc4d58-8dbe-4d06-ae48-f8add90e4069 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:55.162044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4d865-67df-445f-a32a-00a2b5916892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:55.162830 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4d865-67df-445f-a32a-00a2b5916892 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:55.163117 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4d865-67df-445f-a32a-00a2b5916892 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:55.163399 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4d865-67df-445f-a32a-00a2b5916892 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:55.164147 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4d865-67df-445f-a32a-00a2b5916892 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:55.164458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4d865-67df-445f-a32a-00a2b5916892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:55.165892 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4d865-67df-445f-a32a-00a2b5916892 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:55.174007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 542/1089] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:40:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:55.180571 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4d865-67df-445f-a32a-00a2b5916892 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:55.199806 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc4d58-8dbe-4d06-ae48-f8add90e4069 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:55.201310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc4d58-8dbe-4d06-ae48-f8add90e4069 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:55.230312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:55.280944 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4d865-67df-445f-a32a-00a2b5916892 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:55.301270 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 548/1090] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 10:40:55.307150 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc4d58-8dbe-4d06-ae48-f8add90e4069 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:55.314645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ac4b9-3a17-4d84-94a4-70d6b2a0bcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:55.315523 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ac4b9-3a17-4d84-94a4-70d6b2a0bcb2 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:55.315805 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ac4b9-3a17-4d84-94a4-70d6b2a0bcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:55.316082 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ac4b9-3a17-4d84-94a4-70d6b2a0bcb2 None admin] PATH_INFO: `/v3/users/4a9f913358ac4314a968dfbebae29b91` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:55.317303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ac4b9-3a17-4d84-94a4-70d6b2a0bcb2 None admin] RBAC: Authorizing `identity:get_user(user_id=4a9f913358ac4314a968dfbebae29b91)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:55.318813 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ac4b9-3a17-4d84-94a4-70d6b2a0bcb2 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:55.321746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 543/1091] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:40:55 2022] GET /identity/v3/users/4a9f913358ac4314a968dfbebae29b91 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:55.327042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:55.327276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ac4b9-3a17-4d84-94a4-70d6b2a0bcb2 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:55.407924 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc4d58-8dbe-4d06-ae48-f8add90e4069 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:55.428613 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ac4b9-3a17-4d84-94a4-70d6b2a0bcb2 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:55.442061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90820c-f187-47aa-ae24-132e5a0d1571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:55.442893 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90820c-f187-47aa-ae24-132e5a0d1571 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:55.443182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90820c-f187-47aa-ae24-132e5a0d1571 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:55.443459 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90820c-f187-47aa-ae24-132e5a0d1571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:55.444966 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:55.453344 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90820c-f187-47aa-ae24-132e5a0d1571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:55.465140 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90820c-f187-47aa-ae24-132e5a0d1571 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:55.465249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856fe75-0671-4a27-a208-f66b9ba8a991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:55.465249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856fe75-0671-4a27-a208-f66b9ba8a991 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:55.465249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856fe75-0671-4a27-a208-f66b9ba8a991 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:55.465249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856fe75-0671-4a27-a208-f66b9ba8a991 None admin] PATH_INFO: `/v3/projects/5b88af301bf146218d0685e7b06ff6d6` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:55.465563 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856fe75-0671-4a27-a208-f66b9ba8a991 None admin] RBAC: Authorizing `identity:get_project(project_id=5b88af301bf146218d0685e7b06ff6d6)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:55.466145 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856fe75-0671-4a27-a208-f66b9ba8a991 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:55.467838 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 544/1092] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:40:55 2022] GET /identity/v3/projects/5b88af301bf146218d0685e7b06ff6d6 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:55.472555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-4f90820c-f187-47aa-ae24-132e5a0d1571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:55.472555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:55.472555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:55.472555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:55.472555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:55.472555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:55.472555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:55.472555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:55.472555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:55.472555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:55.472555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:55.472555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:55.472555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:55.472555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:55.472555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:55.474703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:55.474703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:55.474703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:55.474703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:55.474703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:55.474703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:55.474703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:55.474703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:55.474703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:55.474703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:55.474703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:55.474703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:55.474703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:55.474703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:55.474703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:55.474703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:55.474703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:55.476309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:55.476309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:55.476309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:55.476309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:55.476776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856fe75-0671-4a27-a208-f66b9ba8a991 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:55.476897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 549/1093] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:55.479805 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90820c-f187-47aa-ae24-132e5a0d1571 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:55.546182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:55.576748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856fe75-0671-4a27-a208-f66b9ba8a991 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:55.577955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90820c-f187-47aa-ae24-132e5a0d1571 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:55.616697 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323bc91-6709-4272-aa2f-e3a6010f143d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:55.617661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d7073-6b63-422f-b5bb-a61b2b8ae1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:55.617794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323bc91-6709-4272-aa2f-e3a6010f143d None admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:55.617976 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323bc91-6709-4272-aa2f-e3a6010f143d None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:55.618252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323bc91-6709-4272-aa2f-e3a6010f143d None admin] PATH_INFO: `/v3/projects/5b88af301bf146218d0685e7b06ff6d6/users/4a9f913358ac4314a968dfbebae29b91/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:55.618421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d7073-6b63-422f-b5bb-a61b2b8ae1b4 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:55.618715 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d7073-6b63-422f-b5bb-a61b2b8ae1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:55.618998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d7073-6b63-422f-b5bb-a61b2b8ae1b4 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:55.619790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d7073-6b63-422f-b5bb-a61b2b8ae1b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:55.620109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d7073-6b63-422f-b5bb-a61b2b8ae1b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:55.620320 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323bc91-6709-4272-aa2f-e3a6010f143d None admin] RBAC: Authorizing `identity:create_grant(project_id=5b88af301bf146218d0685e7b06ff6d6, user_id=4a9f913358ac4314a968dfbebae29b91, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:55.621529 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d7073-6b63-422f-b5bb-a61b2b8ae1b4 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:55.621808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323bc91-6709-4272-aa2f-e3a6010f143d None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:55.633733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 550/1094] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:55.639261 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d7073-6b63-422f-b5bb-a61b2b8ae1b4 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:55.718620 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 545/1095] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:40:55 2022] PUT /identity/v3/projects/5b88af301bf146218d0685e7b06ff6d6/users/4a9f913358ac4314a968dfbebae29b91/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:40:55.739040 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d7073-6b63-422f-b5bb-a61b2b8ae1b4 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:55.768893 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:55.777498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e10b61-91ca-48d2-add5-6d42ae558b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:55.778313 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e10b61-91ca-48d2-add5-6d42ae558b5c None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:55.778994 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e10b61-91ca-48d2-add5-6d42ae558b5c None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:55.778994 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e10b61-91ca-48d2-add5-6d42ae558b5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:55.787129 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e10b61-91ca-48d2-add5-6d42ae558b5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:55.788614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e10b61-91ca-48d2-add5-6d42ae558b5c None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:55.805146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-26e10b61-91ca-48d2-add5-6d42ae558b5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:55.805146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:55.805146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:55.805146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:55.805146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:55.805146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:55.805146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:55.805146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:55.805146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:55.805146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:55.805146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:55.805146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:55.805146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:55.805146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:55.805146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:55.806117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:55.806117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:55.806117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:55.806117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:55.806117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:55.806117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:55.806117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:55.806117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:55.806117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:55.806117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:55.806117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:55.806117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:55.806117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:55.806117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:55.806117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:55.806117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:55.806117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:55.806995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:55.806995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:55.806995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:55.806995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:55.806995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:55.806995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:55.806995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:55.806995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:40:55.806995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 551/1096] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:55.812429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323bc91-6709-4272-aa2f-e3a6010f143d None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:55.868241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:55.926068 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323bc91-6709-4272-aa2f-e3a6010f143d None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:55.965444 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f7f5d-c2f8-403c-8e2f-4ab0615d1370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:55.966172 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f7f5d-c2f8-403c-8e2f-4ab0615d1370 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:55.966398 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f7f5d-c2f8-403c-8e2f-4ab0615d1370 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:55.966673 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f7f5d-c2f8-403c-8e2f-4ab0615d1370 None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:55.967479 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f7f5d-c2f8-403c-8e2f-4ab0615d1370 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:55.967792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f7f5d-c2f8-403c-8e2f-4ab0615d1370 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:55.969253 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f7f5d-c2f8-403c-8e2f-4ab0615d1370 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:55.982305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 546/1097] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:55.988545 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e10b61-91ca-48d2-add5-6d42ae558b5c None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:56.092938 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e10b61-91ca-48d2-add5-6d42ae558b5c None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:56.128268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f09f1-10c2-4429-a2a5-ff9322211298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:56.128963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f09f1-10c2-4429-a2a5-ff9322211298 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:56.129250 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f09f1-10c2-4429-a2a5-ff9322211298 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:56.129529 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f09f1-10c2-4429-a2a5-ff9322211298 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:56.131305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f09f1-10c2-4429-a2a5-ff9322211298 None admin] RBAC: Adding query filter params (role.id=ee4d134c98a24de99a5426a2ad83b147, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=39840f048d254831bdb963b38520f706) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:56.131733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f09f1-10c2-4429-a2a5-ff9322211298 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:56.133210 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f09f1-10c2-4429-a2a5-ff9322211298 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:56.144672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 552/1098] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:55 2022] GET /identity/v3/role_assignments?user.id=39840f048d254831bdb963b38520f706&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=ee4d134c98a24de99a5426a2ad83b147 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:57.804478 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b008f-4904-4167-b4d5-48e8b54023c8 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:57.805054 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b008f-4904-4167-b4d5-48e8b54023c8 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:57.805146 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b008f-4904-4167-b4d5-48e8b54023c8 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:57.806439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 547/1099] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:57.811477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3a7d0-11b0-41e4-aafb-8c1a16082acc None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:57.811866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3a7d0-11b0-41e4-aafb-8c1a16082acc None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:57.812048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3a7d0-11b0-41e4-aafb-8c1a16082acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:57.829051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-8dc3a7d0-11b0-41e4-aafb-8c1a16082acc None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:57.830239 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8dc3a7d0-11b0-41e4-aafb-8c1a16082acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:57.876092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:57.897491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 553/1100] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:57.921182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b008f-4904-4167-b4d5-48e8b54023c8 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:58.021122 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b008f-4904-4167-b4d5-48e8b54023c8 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:58.028187 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:58.054222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07358416-9f65-4bf7-af2f-cba7ce488507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:58.055057 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07358416-9f65-4bf7-af2f-cba7ce488507 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:58.055388 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07358416-9f65-4bf7-af2f-cba7ce488507 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:58.055670 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07358416-9f65-4bf7-af2f-cba7ce488507 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:58.065879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07358416-9f65-4bf7-af2f-cba7ce488507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:58.074110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-07358416-9f65-4bf7-af2f-cba7ce488507 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:58.074110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:58.074110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:58.074110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:58.074110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:58.074110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:58.074110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:58.074110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:58.074110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:58.074110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:58.074110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:58.074110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:58.074110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:58.074110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:58.074110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:58.074110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:58.075196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:58.075196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:58.075196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:58.075196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:58.075196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:58.075196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:58.075196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:58.075196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:58.075196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:58.075196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:58.075196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:58.075196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:58.075196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:58.075196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:58.075196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:58.075196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:58.076306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:58.076306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:58.076306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:58.076306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:58.076306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:58.076306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:58.076306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:58.076306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:58.076306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:58.076306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:58.076306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:58.076306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:40:58.076306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 548/1101] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:40:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:58.081216 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3a7d0-11b0-41e4-aafb-8c1a16082acc None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:58.175941 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3a7d0-11b0-41e4-aafb-8c1a16082acc None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:58.209334 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654a13f-e6cb-430d-9ac8-602f72494977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:58.209993 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654a13f-e6cb-430d-9ac8-602f72494977 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:58.210282 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654a13f-e6cb-430d-9ac8-602f72494977 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:58.210561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654a13f-e6cb-430d-9ac8-602f72494977 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:58.211401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654a13f-e6cb-430d-9ac8-602f72494977 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:58.211719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654a13f-e6cb-430d-9ac8-602f72494977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:58.213125 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654a13f-e6cb-430d-9ac8-602f72494977 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:58.220971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 554/1102] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:40:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:58.226705 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07358416-9f65-4bf7-af2f-cba7ce488507 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:58.324119 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07358416-9f65-4bf7-af2f-cba7ce488507 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:58.356699 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cf555-cd13-4c57-99e2-25bd49a25db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:58.357560 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cf555-cd13-4c57-99e2-25bd49a25db9 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:58.357849 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cf555-cd13-4c57-99e2-25bd49a25db9 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:58.358130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cf555-cd13-4c57-99e2-25bd49a25db9 None admin] PATH_INFO: `/v3/users/4a9f913358ac4314a968dfbebae29b91` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:58.359309 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cf555-cd13-4c57-99e2-25bd49a25db9 None admin] RBAC: Authorizing `identity:get_user(user_id=4a9f913358ac4314a968dfbebae29b91)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:58.360761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cf555-cd13-4c57-99e2-25bd49a25db9 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:58.362371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 549/1103] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:40:58 2022] GET /identity/v3/users/4a9f913358ac4314a968dfbebae29b91 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:58.369067 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654a13f-e6cb-430d-9ac8-602f72494977 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:58.413957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:58.465639 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654a13f-e6cb-430d-9ac8-602f72494977 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:58.497879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48d7e0-86d2-4f27-922f-e61be422a3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:58.498515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48d7e0-86d2-4f27-922f-e61be422a3c8 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:58.498798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48d7e0-86d2-4f27-922f-e61be422a3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:58.499075 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48d7e0-86d2-4f27-922f-e61be422a3c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:58.567986 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48d7e0-86d2-4f27-922f-e61be422a3c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:58.569464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48d7e0-86d2-4f27-922f-e61be422a3c8 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:58.612530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:58.735187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 555/1104] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:40:58.741124 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cf555-cd13-4c57-99e2-25bd49a25db9 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:58.775583 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:58.839060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cf555-cd13-4c57-99e2-25bd49a25db9 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:58.872320 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8abf0-caf7-4000-b5af-77b7b9c7376d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:58.873192 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8abf0-caf7-4000-b5af-77b7b9c7376d None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:58.873476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8abf0-caf7-4000-b5af-77b7b9c7376d None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:58.873754 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8abf0-caf7-4000-b5af-77b7b9c7376d None admin] PATH_INFO: `/v3/projects/5b88af301bf146218d0685e7b06ff6d6` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:58.874914 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8abf0-caf7-4000-b5af-77b7b9c7376d None admin] RBAC: Authorizing `identity:get_project(project_id=5b88af301bf146218d0685e7b06ff6d6)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:58.876329 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8abf0-caf7-4000-b5af-77b7b9c7376d None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:58.878027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 550/1105] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:40:58 2022] GET /identity/v3/projects/5b88af301bf146218d0685e7b06ff6d6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:58.884751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48d7e0-86d2-4f27-922f-e61be422a3c8 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:58.979814 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48d7e0-86d2-4f27-922f-e61be422a3c8 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:59.012735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ddb55-dd0c-4509-8b7d-6dccdb52b58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:59.013323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ddb55-dd0c-4509-8b7d-6dccdb52b58d None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:59.013608 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ddb55-dd0c-4509-8b7d-6dccdb52b58d None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:59.013888 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ddb55-dd0c-4509-8b7d-6dccdb52b58d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:59.014703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ddb55-dd0c-4509-8b7d-6dccdb52b58d None admin] RBAC: Adding query filter params (role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.project.id=5b88af301bf146218d0685e7b06ff6d6, user.id=4a9f913358ac4314a968dfbebae29b91) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:59.015014 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ddb55-dd0c-4509-8b7d-6dccdb52b58d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:59.016426 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ddb55-dd0c-4509-8b7d-6dccdb52b58d None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:59.022826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 556/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:58 2022] GET /identity/v3/role_assignments?user.id=4a9f913358ac4314a968dfbebae29b91&scope.project.id=5b88af301bf146218d0685e7b06ff6d6&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:01.045797 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b5c2a-a400-42da-9a37-693269474620 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:01.046308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b5c2a-a400-42da-9a37-693269474620 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:01.046308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b5c2a-a400-42da-9a37-693269474620 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:01.047647 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 551/1107] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:01.053353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7650e9-7ef3-4f61-ac1c-ca4db8506eae None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:01.053749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7650e9-7ef3-4f61-ac1c-ca4db8506eae None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:01.053919 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7650e9-7ef3-4f61-ac1c-ca4db8506eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:01.070114 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-bb7650e9-7ef3-4f61-ac1c-ca4db8506eae None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:01.071288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-bb7650e9-7ef3-4f61-ac1c-ca4db8506eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:01.073214 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:01.136246 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 557/1108] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:41:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:41:01.161259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b5c2a-a400-42da-9a37-693269474620 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:01.260948 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b5c2a-a400-42da-9a37-693269474620 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:01.262447 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:01.295274 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47da92c-ff9a-4ef8-99ff-e09b58b431ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:01.296116 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47da92c-ff9a-4ef8-99ff-e09b58b431ed None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:01.296351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47da92c-ff9a-4ef8-99ff-e09b58b431ed None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:01.296659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47da92c-ff9a-4ef8-99ff-e09b58b431ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:01.297830 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47da92c-ff9a-4ef8-99ff-e09b58b431ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:01.299258 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47da92c-ff9a-4ef8-99ff-e09b58b431ed None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:01.300899 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 552/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:41:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:01.307273 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7650e9-7ef3-4f61-ac1c-ca4db8506eae None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:01.402796 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7650e9-7ef3-4f61-ac1c-ca4db8506eae None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:01.435383 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d1a0c-6c4f-4d8a-b649-da0c4c33934f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:01.436046 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d1a0c-6c4f-4d8a-b649-da0c4c33934f None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:01.436330 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d1a0c-6c4f-4d8a-b649-da0c4c33934f None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:01.436607 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d1a0c-6c4f-4d8a-b649-da0c4c33934f None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:01.437346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d1a0c-6c4f-4d8a-b649-da0c4c33934f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:01.438765 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d1a0c-6c4f-4d8a-b649-da0c4c33934f None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:01.446979 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:01.544709 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 558/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 23 10:41:01 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:41:03.604803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b70c94-9d96-4916-8710-6b9a399d8957 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:03.605400 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b70c94-9d96-4916-8710-6b9a399d8957 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:03.605400 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b70c94-9d96-4916-8710-6b9a399d8957 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:03.606699 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 553/1111] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:03.614040 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0e948-5268-44e2-809d-a64ba1ccae5a None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:03.614040 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0e948-5268-44e2-809d-a64ba1ccae5a None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:03.614717 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0e948-5268-44e2-809d-a64ba1ccae5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:03.631436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-68f0e948-5268-44e2-809d-a64ba1ccae5a None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:03.632615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-68f0e948-5268-44e2-809d-a64ba1ccae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:03.697410 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 559/1112] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:41:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:41:03.720417 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b70c94-9d96-4916-8710-6b9a399d8957 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:03.822880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b70c94-9d96-4916-8710-6b9a399d8957 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:03.854763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a616f3-1773-405c-8865-ee9eb8bad52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:03.855655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a616f3-1773-405c-8865-ee9eb8bad52c None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:03.855888 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a616f3-1773-405c-8865-ee9eb8bad52c None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:03.856176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a616f3-1773-405c-8865-ee9eb8bad52c None admin] PATH_INFO: `/v3/roles/f86a1d8dfb24430a98414eab048c4be9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:03.857654 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a616f3-1773-405c-8865-ee9eb8bad52c None admin] RBAC: Authorizing `identity:get_role(role_id=f86a1d8dfb24430a98414eab048c4be9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:03.859009 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a616f3-1773-405c-8865-ee9eb8bad52c None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:03.860351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 554/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:41:03 2022] GET /identity/v3/roles/f86a1d8dfb24430a98414eab048c4be9 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:03.866682 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0e948-5268-44e2-809d-a64ba1ccae5a None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:03.960221 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0e948-5268-44e2-809d-a64ba1ccae5a None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:03.982058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:03.992424 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b3977-1741-4d34-8295-c63d9a7a53e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:03.996602 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b3977-1741-4d34-8295-c63d9a7a53e3 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:03.996602 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b3977-1741-4d34-8295-c63d9a7a53e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:03.996602 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b3977-1741-4d34-8295-c63d9a7a53e3 None admin] PATH_INFO: `/v3/users/c1a16afa20bf4ef093fcb18c04c615a8` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:04.007122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b3977-1741-4d34-8295-c63d9a7a53e3 None admin] RBAC: Authorizing `identity:get_user(user_id=c1a16afa20bf4ef093fcb18c04c615a8)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:04.008928 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b3977-1741-4d34-8295-c63d9a7a53e3 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:04.011059 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 560/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:41:03 2022] GET /identity/v3/users/c1a16afa20bf4ef093fcb18c04c615a8 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:04.016604 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a616f3-1773-405c-8865-ee9eb8bad52c None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:04.056909 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:04.115637 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a616f3-1773-405c-8865-ee9eb8bad52c None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:04.149294 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdcf68-afb7-4802-810e-eb9251bcc12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:04.149934 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdcf68-afb7-4802-810e-eb9251bcc12c None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:04.150219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdcf68-afb7-4802-810e-eb9251bcc12c None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:04.150499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdcf68-afb7-4802-810e-eb9251bcc12c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:04.214561 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdcf68-afb7-4802-810e-eb9251bcc12c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:04.215990 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdcf68-afb7-4802-810e-eb9251bcc12c None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:04.251905 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:04.310122 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 555/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:41:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:41:04.315881 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b3977-1741-4d34-8295-c63d9a7a53e3 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:04.412071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b3977-1741-4d34-8295-c63d9a7a53e3 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:04.445155 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c78574-1b13-41d4-8d5b-849d43857c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:04.446003 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c78574-1b13-41d4-8d5b-849d43857c40 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:04.446287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c78574-1b13-41d4-8d5b-849d43857c40 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:04.446563 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c78574-1b13-41d4-8d5b-849d43857c40 None admin] PATH_INFO: `/v3/projects/5b88af301bf146218d0685e7b06ff6d6` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:04.447737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c78574-1b13-41d4-8d5b-849d43857c40 None admin] RBAC: Authorizing `identity:get_project(project_id=5b88af301bf146218d0685e7b06ff6d6)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:04.449197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c78574-1b13-41d4-8d5b-849d43857c40 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:04.450884 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 561/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:41:04 2022] GET /identity/v3/projects/5b88af301bf146218d0685e7b06ff6d6 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:04.456799 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdcf68-afb7-4802-810e-eb9251bcc12c None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:04.551545 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdcf68-afb7-4802-810e-eb9251bcc12c None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:04.583652 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cd766-1217-46fc-9c12-33edcfd69e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:04.584289 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cd766-1217-46fc-9c12-33edcfd69e6d None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:04.584572 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cd766-1217-46fc-9c12-33edcfd69e6d None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:04.584873 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cd766-1217-46fc-9c12-33edcfd69e6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:04.585688 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30cd766-1217-46fc-9c12-33edcfd69e6d None admin] RBAC: Adding query filter params (role.id=f86a1d8dfb24430a98414eab048c4be9, scope.project.id=5b88af301bf146218d0685e7b06ff6d6, user.id=c1a16afa20bf4ef093fcb18c04c615a8) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:41:04.585998 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30cd766-1217-46fc-9c12-33edcfd69e6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:04.587394 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30cd766-1217-46fc-9c12-33edcfd69e6d None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:04.592762 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 556/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:41:04 2022] GET /identity/v3/role_assignments?user.id=c1a16afa20bf4ef093fcb18c04c615a8&scope.project.id=5b88af301bf146218d0685e7b06ff6d6&role.id=f86a1d8dfb24430a98414eab048c4be9 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:06.574159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c62c9-5cca-44f7-9c64-3fd10ae05474 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:06.574656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c62c9-5cca-44f7-9c64-3fd10ae05474 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:06.574656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c62c9-5cca-44f7-9c64-3fd10ae05474 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:06.576004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 562/1118] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:06.581404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb43e3d-597d-4b9b-a20b-8fa7d7c6e343 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:06.581802 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb43e3d-597d-4b9b-a20b-8fa7d7c6e343 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:06.582598 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb43e3d-597d-4b9b-a20b-8fa7d7c6e343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:06.587535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:06.599232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-3cb43e3d-597d-4b9b-a20b-8fa7d7c6e343 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:06.600577 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-3cb43e3d-597d-4b9b-a20b-8fa7d7c6e343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:06.666695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 557/1119] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:41:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:41:06.689769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c62c9-5cca-44f7-9c64-3fd10ae05474 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:06.739826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:06.788525 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c62c9-5cca-44f7-9c64-3fd10ae05474 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:06.821735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3c31a-4f17-42c1-9501-275f1e59f6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:06.822581 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3c31a-4f17-42c1-9501-275f1e59f6ef None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:06.822866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3c31a-4f17-42c1-9501-275f1e59f6ef None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:06.823143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3c31a-4f17-42c1-9501-275f1e59f6ef None admin] PATH_INFO: `/v3/roles/f86a1d8dfb24430a98414eab048c4be9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:06.824676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3c31a-4f17-42c1-9501-275f1e59f6ef None admin] RBAC: Authorizing `identity:get_role(role_id=f86a1d8dfb24430a98414eab048c4be9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:06.825990 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3c31a-4f17-42c1-9501-275f1e59f6ef None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:06.827340 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 563/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:41:06 2022] GET /identity/v3/roles/f86a1d8dfb24430a98414eab048c4be9 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:06.833503 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb43e3d-597d-4b9b-a20b-8fa7d7c6e343 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:06.927892 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb43e3d-597d-4b9b-a20b-8fa7d7c6e343 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:06.956003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:06.960914 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016f6d6-1c7f-4767-8328-eddee8e3a597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:06.965538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016f6d6-1c7f-4767-8328-eddee8e3a597 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:06.965538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016f6d6-1c7f-4767-8328-eddee8e3a597 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:06.965538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016f6d6-1c7f-4767-8328-eddee8e3a597 None admin] PATH_INFO: `/v3/users/c1a16afa20bf4ef093fcb18c04c615a8` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:06.965538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016f6d6-1c7f-4767-8328-eddee8e3a597 None admin] RBAC: Authorizing `identity:get_user(user_id=c1a16afa20bf4ef093fcb18c04c615a8)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:06.965538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016f6d6-1c7f-4767-8328-eddee8e3a597 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:06.966553 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 558/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:41:06 2022] GET /identity/v3/users/c1a16afa20bf4ef093fcb18c04c615a8 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:06.972253 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3c31a-4f17-42c1-9501-275f1e59f6ef None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:07.068785 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3c31a-4f17-42c1-9501-275f1e59f6ef None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:07.085367 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:07.101660 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47dbde-eb03-4238-955f-38b65379b3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:07.102514 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47dbde-eb03-4238-955f-38b65379b3c9 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:07.102801 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47dbde-eb03-4238-955f-38b65379b3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:07.103133 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47dbde-eb03-4238-955f-38b65379b3c9 None admin] PATH_INFO: `/v3/projects/5b88af301bf146218d0685e7b06ff6d6` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:07.104301 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47dbde-eb03-4238-955f-38b65379b3c9 None admin] RBAC: Authorizing `identity:get_project(project_id=5b88af301bf146218d0685e7b06ff6d6)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:07.105764 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47dbde-eb03-4238-955f-38b65379b3c9 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:07.107438 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 564/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:41:06 2022] GET /identity/v3/projects/5b88af301bf146218d0685e7b06ff6d6 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:07.113859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016f6d6-1c7f-4767-8328-eddee8e3a597 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:07.208910 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016f6d6-1c7f-4767-8328-eddee8e3a597 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:07.242162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbffe1-3bcc-48a8-a156-189404ad1d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:07.243029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbffe1-3bcc-48a8-a156-189404ad1d6f None admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:07.243312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbffe1-3bcc-48a8-a156-189404ad1d6f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:07.243588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbffe1-3bcc-48a8-a156-189404ad1d6f None admin] PATH_INFO: `/v3/projects/5b88af301bf146218d0685e7b06ff6d6/users/c1a16afa20bf4ef093fcb18c04c615a8/roles/f86a1d8dfb24430a98414eab048c4be9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:07.246044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbffe1-3bcc-48a8-a156-189404ad1d6f None admin] RBAC: Authorizing `identity:create_grant(project_id=5b88af301bf146218d0685e7b06ff6d6, user_id=c1a16afa20bf4ef093fcb18c04c615a8, role_id=f86a1d8dfb24430a98414eab048c4be9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:07.247452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbffe1-3bcc-48a8-a156-189404ad1d6f None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:07.321044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 559/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:41:07 2022] PUT /identity/v3/projects/5b88af301bf146218d0685e7b06ff6d6/users/c1a16afa20bf4ef093fcb18c04c615a8/roles/f86a1d8dfb24430a98414eab048c4be9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:41:09.300060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24c522-a43a-4de9-8860-00198b78ea09 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:09.300720 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24c522-a43a-4de9-8860-00198b78ea09 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:09.300874 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24c522-a43a-4de9-8860-00198b78ea09 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:09.302421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 565/1124] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:09.307894 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7f137-c9ec-44c4-9d9b-b47e14901fae None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:09.308318 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7f137-c9ec-44c4-9d9b-b47e14901fae None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:09.308450 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7f137-c9ec-44c4-9d9b-b47e14901fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:09.325451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-b5b7f137-c9ec-44c4-9d9b-b47e14901fae None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:09.326629 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b5b7f137-c9ec-44c4-9d9b-b47e14901fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:09.381547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:09.392230 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 560/1125] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:41:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:41:09.416139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24c522-a43a-4de9-8860-00198b78ea09 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:09.513022 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24c522-a43a-4de9-8860-00198b78ea09 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:09.545223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccb5d8-9fd3-4036-8785-8e6b15d94f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:09.546070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccb5d8-9fd3-4036-8785-8e6b15d94f08 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:09.546352 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccb5d8-9fd3-4036-8785-8e6b15d94f08 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:09.546626 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccb5d8-9fd3-4036-8785-8e6b15d94f08 None admin] PATH_INFO: `/v3/roles/f86a1d8dfb24430a98414eab048c4be9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:09.548076 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ccb5d8-9fd3-4036-8785-8e6b15d94f08 None admin] RBAC: Authorizing `identity:get_role(role_id=f86a1d8dfb24430a98414eab048c4be9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:09.549457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ccb5d8-9fd3-4036-8785-8e6b15d94f08 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:09.551003 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 566/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:41:09 2022] GET /identity/v3/roles/f86a1d8dfb24430a98414eab048c4be9 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:09.556538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7f137-c9ec-44c4-9d9b-b47e14901fae None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:09.652478 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7f137-c9ec-44c4-9d9b-b47e14901fae None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:09.684971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b9031-8c9c-48a1-924c-66736ae614df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:09.685832 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b9031-8c9c-48a1-924c-66736ae614df None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:09.686117 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b9031-8c9c-48a1-924c-66736ae614df None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:09.686397 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b9031-8c9c-48a1-924c-66736ae614df None admin] PATH_INFO: `/v3/users/c1a16afa20bf4ef093fcb18c04c615a8` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:09.687576 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b9031-8c9c-48a1-924c-66736ae614df None admin] RBAC: Authorizing `identity:get_user(user_id=c1a16afa20bf4ef093fcb18c04c615a8)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:09.689028 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b9031-8c9c-48a1-924c-66736ae614df None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:09.690649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 561/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:41:09 2022] GET /identity/v3/users/c1a16afa20bf4ef093fcb18c04c615a8 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:09.697209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccb5d8-9fd3-4036-8785-8e6b15d94f08 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:09.750609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:09.792844 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccb5d8-9fd3-4036-8785-8e6b15d94f08 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:09.825883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbc8fa-010a-4486-92a2-cdf7c999dba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:09.826401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbc8fa-010a-4486-92a2-cdf7c999dba5 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:09.826682 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbc8fa-010a-4486-92a2-cdf7c999dba5 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:09.826957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbc8fa-010a-4486-92a2-cdf7c999dba5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:09.890594 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbc8fa-010a-4486-92a2-cdf7c999dba5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:09.892010 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbc8fa-010a-4486-92a2-cdf7c999dba5 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:09.942424 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:09.986537 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 567/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:41:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:41:09.992957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b9031-8c9c-48a1-924c-66736ae614df None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:10.050027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:10.090382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b9031-8c9c-48a1-924c-66736ae614df None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:10.123720 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ea4bf-c492-4d9f-a856-d323215a27f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:10.124563 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ea4bf-c492-4d9f-a856-d323215a27f7 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:10.124876 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ea4bf-c492-4d9f-a856-d323215a27f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:10.125157 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ea4bf-c492-4d9f-a856-d323215a27f7 None admin] PATH_INFO: `/v3/projects/5b88af301bf146218d0685e7b06ff6d6` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:10.126324 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ea4bf-c492-4d9f-a856-d323215a27f7 None admin] RBAC: Authorizing `identity:get_project(project_id=5b88af301bf146218d0685e7b06ff6d6)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:10.127749 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ea4bf-c492-4d9f-a856-d323215a27f7 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:10.129562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 562/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:41:09 2022] GET /identity/v3/projects/5b88af301bf146218d0685e7b06ff6d6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:10.135453 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbc8fa-010a-4486-92a2-cdf7c999dba5 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:10.231179 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbc8fa-010a-4486-92a2-cdf7c999dba5 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:10.264332 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c62b6-1f34-4596-ab9b-b4414b2b5510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:10.265011 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c62b6-1f34-4596-ab9b-b4414b2b5510 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:10.265298 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c62b6-1f34-4596-ab9b-b4414b2b5510 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:10.265578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c62b6-1f34-4596-ab9b-b4414b2b5510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:10.266401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c62b6-1f34-4596-ab9b-b4414b2b5510 None admin] RBAC: Adding query filter params (role.id=f86a1d8dfb24430a98414eab048c4be9, scope.project.id=5b88af301bf146218d0685e7b06ff6d6, user.id=c1a16afa20bf4ef093fcb18c04c615a8) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:41:10.266717 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c62b6-1f34-4596-ab9b-b4414b2b5510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:10.268140 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c62b6-1f34-4596-ab9b-b4414b2b5510 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:10.273904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 568/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:41:10 2022] GET /identity/v3/role_assignments?user.id=c1a16afa20bf4ef093fcb18c04c615a8&scope.project.id=5b88af301bf146218d0685e7b06ff6d6&role.id=f86a1d8dfb24430a98414eab048c4be9 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:12.303298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abbecb-3e17-4249-a8b1-1c7c59f6d80b None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:12.303847 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abbecb-3e17-4249-a8b1-1c7c59f6d80b None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:12.303847 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abbecb-3e17-4249-a8b1-1c7c59f6d80b None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:12.305244 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 563/1131] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:12.310392 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab1eee-c6aa-46ef-97b4-b4d83ab1e666 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:12.310811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab1eee-c6aa-46ef-97b4-b4d83ab1e666 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:12.310948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab1eee-c6aa-46ef-97b4-b4d83ab1e666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:12.327804 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-35ab1eee-c6aa-46ef-97b4-b4d83ab1e666 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:12.329003 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-35ab1eee-c6aa-46ef-97b4-b4d83ab1e666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:12.342271 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:12.394642 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 569/1132] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:41:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:41:12.417911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abbecb-3e17-4249-a8b1-1c7c59f6d80b None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:12.515239 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abbecb-3e17-4249-a8b1-1c7c59f6d80b None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:12.540839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:12.549066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bf176-1623-4194-aaa4-b147d54a3095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:12.552006 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bf176-1623-4194-aaa4-b147d54a3095 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:12.552006 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bf176-1623-4194-aaa4-b147d54a3095 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:12.552006 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bf176-1623-4194-aaa4-b147d54a3095 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:12.552264 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bf176-1623-4194-aaa4-b147d54a3095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:12.553747 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bf176-1623-4194-aaa4-b147d54a3095 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:12.555272 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 564/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:41:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:12.561147 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab1eee-c6aa-46ef-97b4-b4d83ab1e666 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:12.658610 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab1eee-c6aa-46ef-97b4-b4d83ab1e666 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:12.692075 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205e1d2-3f7d-4f8f-a9d7-91e01bd9eab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:12.692766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205e1d2-3f7d-4f8f-a9d7-91e01bd9eab8 None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:12.693055 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205e1d2-3f7d-4f8f-a9d7-91e01bd9eab8 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:12.693335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205e1d2-3f7d-4f8f-a9d7-91e01bd9eab8 None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:12.694050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205e1d2-3f7d-4f8f-a9d7-91e01bd9eab8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:12.695481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205e1d2-3f7d-4f8f-a9d7-91e01bd9eab8 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:12.777501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:12.783458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 570/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 23 10:41:12 2022] POST /identity/v3/projects => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:41:14.806108 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d89d6-541c-4ae5-9470-aad8434c2a8a None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:14.806638 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d89d6-541c-4ae5-9470-aad8434c2a8a None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:14.806638 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d89d6-541c-4ae5-9470-aad8434c2a8a None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:14.808006 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 565/1135] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:14.813179 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fc473-a353-49d7-af6f-3153ca4539b0 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:14.813588 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fc473-a353-49d7-af6f-3153ca4539b0 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:14.813730 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fc473-a353-49d7-af6f-3153ca4539b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:14.830054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-eb8fc473-a353-49d7-af6f-3153ca4539b0 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:14.831264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-eb8fc473-a353-49d7-af6f-3153ca4539b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:14.895425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 571/1136] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:41:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:41:14.920012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d89d6-541c-4ae5-9470-aad8434c2a8a None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:15.017043 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d89d6-541c-4ae5-9470-aad8434c2a8a None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:15.050152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c5166-4056-452b-8ab8-072a369d7ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:15.051009 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c5166-4056-452b-8ab8-072a369d7ec6 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:15.051293 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c5166-4056-452b-8ab8-072a369d7ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:15.051566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c5166-4056-452b-8ab8-072a369d7ec6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:15.052765 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c5166-4056-452b-8ab8-072a369d7ec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:15.054184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c5166-4056-452b-8ab8-072a369d7ec6 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:15.055759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 566/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:41:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:15.061265 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fc473-a353-49d7-af6f-3153ca4539b0 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:15.154780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fc473-a353-49d7-af6f-3153ca4539b0 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:15.181833 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:15.187284 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62415fba-d1ea-42ac-a405-676a7a38cc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:15.187941 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62415fba-d1ea-42ac-a405-676a7a38cc3e None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:15.188222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62415fba-d1ea-42ac-a405-676a7a38cc3e None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:15.188494 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62415fba-d1ea-42ac-a405-676a7a38cc3e None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:15.189229 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62415fba-d1ea-42ac-a405-676a7a38cc3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:15.190675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62415fba-d1ea-42ac-a405-676a7a38cc3e None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:15.280869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 572/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 23 10:41:15 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:41:17.333073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495232a1-aaa1-44d5-812f-fb329e6f2b32 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:17.333600 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495232a1-aaa1-44d5-812f-fb329e6f2b32 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:17.333600 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495232a1-aaa1-44d5-812f-fb329e6f2b32 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:17.334981 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 567/1139] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:17.340453 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ad90-cbcb-44ad-92d4-7f108f5132e3 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:17.340893 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ad90-cbcb-44ad-92d4-7f108f5132e3 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:17.341043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ad90-cbcb-44ad-92d4-7f108f5132e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:17.358150 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-d4e0ad90-cbcb-44ad-92d4-7f108f5132e3 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:17.359340 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-d4e0ad90-cbcb-44ad-92d4-7f108f5132e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:17.425322 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 573/1140] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:41:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:41:17.448661 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495232a1-aaa1-44d5-812f-fb329e6f2b32 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:17.510074 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:17.547063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495232a1-aaa1-44d5-812f-fb329e6f2b32 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:17.579935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a99c3c-3ae7-40fa-9c7c-7958fb3accc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:17.580796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a99c3c-3ae7-40fa-9c7c-7958fb3accc9 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:17.581084 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a99c3c-3ae7-40fa-9c7c-7958fb3accc9 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:17.581351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a99c3c-3ae7-40fa-9c7c-7958fb3accc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:17.591268 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a99c3c-3ae7-40fa-9c7c-7958fb3accc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:41:17.599136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-c6a99c3c-3ae7-40fa-9c7c-7958fb3accc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:41:17.599136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:41:17.599136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:41:17.599136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:41:17.599136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:41:17.599136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:41:17.599136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:41:17.599136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:41:17.599136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:41:17.599136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:41:17.599136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:41:17.599136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:41:17.599136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:41:17.599136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:41:17.599136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:41:17.599136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:41:17.600342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:41:17.600342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:41:17.600342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:41:17.600342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:41:17.600342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:41:17.600342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:41:17.600342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:41:17.600342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:41:17.600342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:41:17.600342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:41:17.600342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:41:17.600342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:41:17.600342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:41:17.600342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:41:17.600342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:41:17.600342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:41:17.601337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:41:17.601337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:41:17.601337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:41:17.601337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:41:17.601337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:41:17.601337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:41:17.601337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:41:17.601337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:41:17.601337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:41:17.601337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:41:17.601337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:41:17.601337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:41:17.601337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 568/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:41:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:41:17.606237 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0ad90-cbcb-44ad-92d4-7f108f5132e3 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:17.708012 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0ad90-cbcb-44ad-92d4-7f108f5132e3 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:17.723950 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:17.741092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da76f5c-af75-4dcb-a49e-c593409ad774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:17.741760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da76f5c-af75-4dcb-a49e-c593409ad774 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:17.742050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da76f5c-af75-4dcb-a49e-c593409ad774 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:17.742331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da76f5c-af75-4dcb-a49e-c593409ad774 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:17.743082 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da76f5c-af75-4dcb-a49e-c593409ad774 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:41:17.743396 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da76f5c-af75-4dcb-a49e-c593409ad774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:17.745046 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da76f5c-af75-4dcb-a49e-c593409ad774 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:17.753470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 574/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:41:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:17.759143 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a99c3c-3ae7-40fa-9c7c-7958fb3accc9 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:17.855073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a99c3c-3ae7-40fa-9c7c-7958fb3accc9 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:17.876605 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:17.888248 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08dd91-209e-496d-a505-e5a33ce2e4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:17.889134 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08dd91-209e-496d-a505-e5a33ce2e4e3 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:17.891517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08dd91-209e-496d-a505-e5a33ce2e4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:17.891517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08dd91-209e-496d-a505-e5a33ce2e4e3 None admin] PATH_INFO: `/v3/users/d4993bc69b9941aa952e241c7225b0bc` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:17.903217 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08dd91-209e-496d-a505-e5a33ce2e4e3 None admin] RBAC: Authorizing `identity:get_user(user_id=d4993bc69b9941aa952e241c7225b0bc)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:17.904680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08dd91-209e-496d-a505-e5a33ce2e4e3 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:17.906766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 569/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:41:17 2022] GET /identity/v3/users/d4993bc69b9941aa952e241c7225b0bc => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:17.912162 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da76f5c-af75-4dcb-a49e-c593409ad774 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:18.009064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da76f5c-af75-4dcb-a49e-c593409ad774 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:18.040958 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04295411-c58e-4c79-aff1-7e5af751c340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:18.041591 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04295411-c58e-4c79-aff1-7e5af751c340 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:18.041876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04295411-c58e-4c79-aff1-7e5af751c340 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:18.042154 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04295411-c58e-4c79-aff1-7e5af751c340 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:18.087839 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:18.108521 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04295411-c58e-4c79-aff1-7e5af751c340 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:18.109946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04295411-c58e-4c79-aff1-7e5af751c340 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:18.204712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 575/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:41:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:41:18.210729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08dd91-209e-496d-a505-e5a33ce2e4e3 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:18.307471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08dd91-209e-496d-a505-e5a33ce2e4e3 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:18.339568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc38c0a-e518-4b82-a9b8-4453ac02e1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:18.340416 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc38c0a-e518-4b82-a9b8-4453ac02e1e6 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:18.340731 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc38c0a-e518-4b82-a9b8-4453ac02e1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:18.341013 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc38c0a-e518-4b82-a9b8-4453ac02e1e6 None admin] PATH_INFO: `/v3/projects/9a67b5c8290f4d24aa5d146f3b82eba5` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:18.342185 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc38c0a-e518-4b82-a9b8-4453ac02e1e6 None admin] RBAC: Authorizing `identity:get_project(project_id=9a67b5c8290f4d24aa5d146f3b82eba5)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:18.343619 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc38c0a-e518-4b82-a9b8-4453ac02e1e6 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:18.345321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 570/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:41:18 2022] GET /identity/v3/projects/9a67b5c8290f4d24aa5d146f3b82eba5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:18.351820 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04295411-c58e-4c79-aff1-7e5af751c340 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:18.428149 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:18.448805 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04295411-c58e-4c79-aff1-7e5af751c340 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:18.481465 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2fdd3-d842-4fc4-965a-3ca2a4d7475d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:18.482107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2fdd3-d842-4fc4-965a-3ca2a4d7475d None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:18.482391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2fdd3-d842-4fc4-965a-3ca2a4d7475d None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:18.482667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2fdd3-d842-4fc4-965a-3ca2a4d7475d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:18.483480 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2fdd3-d842-4fc4-965a-3ca2a4d7475d None admin] RBAC: Adding query filter params (role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.project.id=9a67b5c8290f4d24aa5d146f3b82eba5, user.id=d4993bc69b9941aa952e241c7225b0bc) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:41:18.483791 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2fdd3-d842-4fc4-965a-3ca2a4d7475d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:18.485236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2fdd3-d842-4fc4-965a-3ca2a4d7475d None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:18.491085 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 576/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:41:18 2022] GET /identity/v3/role_assignments?user.id=d4993bc69b9941aa952e241c7225b0bc&scope.project.id=9a67b5c8290f4d24aa5d146f3b82eba5&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:20.457147 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1d090-136b-4c81-9619-faf7201dfd00 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:20.457698 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1d090-136b-4c81-9619-faf7201dfd00 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:20.457698 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1d090-136b-4c81-9619-faf7201dfd00 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:20.459184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 571/1147] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:20.464294 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078b53e-8ff0-4841-9097-c33eda87325b None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:20.464715 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078b53e-8ff0-4841-9097-c33eda87325b None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:20.464877 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078b53e-8ff0-4841-9097-c33eda87325b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:20.481863 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-1078b53e-8ff0-4841-9097-c33eda87325b None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:20.483045 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-1078b53e-8ff0-4841-9097-c33eda87325b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:20.547490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 577/1148] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:41:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:41:20.570282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1d090-136b-4c81-9619-faf7201dfd00 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:20.619370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:20.669606 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1d090-136b-4c81-9619-faf7201dfd00 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:20.702191 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c243c1a-d535-43d2-9a44-fab1100fe43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:20.702969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c243c1a-d535-43d2-9a44-fab1100fe43d None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:20.703254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c243c1a-d535-43d2-9a44-fab1100fe43d None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:20.703529 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c243c1a-d535-43d2-9a44-fab1100fe43d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:20.714213 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c243c1a-d535-43d2-9a44-fab1100fe43d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:41:20.721880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-9c243c1a-d535-43d2-9a44-fab1100fe43d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:41:20.721880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:41:20.721880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:41:20.721880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:41:20.721880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:41:20.721880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:41:20.721880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:41:20.721880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:41:20.721880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:41:20.721880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:41:20.721880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:41:20.721880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:41:20.721880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:41:20.721880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:41:20.721880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:41:20.721880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:41:20.722985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:41:20.722985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:41:20.722985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:41:20.722985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:41:20.722985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:41:20.722985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:41:20.722985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:41:20.722985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:41:20.722985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:41:20.722985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:41:20.722985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:41:20.722985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:41:20.722985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:41:20.722985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:41:20.722985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:41:20.722985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:41:20.728999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:41:20.728999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:41:20.728999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:41:20.728999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:41:20.728999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:41:20.728999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:41:20.728999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:41:20.728999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:41:20.728999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:41:20.728999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:41:20.728999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:41:20.728999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:41:20.728999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 572/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:41:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:41:20.729896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078b53e-8ff0-4841-9097-c33eda87325b None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:20.796889 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:20.825710 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078b53e-8ff0-4841-9097-c33eda87325b None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:20.859377 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a413e6-31e6-4943-973f-36ce7eade6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:20.860044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a413e6-31e6-4943-973f-36ce7eade6dd None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:20.860335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a413e6-31e6-4943-973f-36ce7eade6dd None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:20.860611 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a413e6-31e6-4943-973f-36ce7eade6dd None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:20.861386 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a413e6-31e6-4943-973f-36ce7eade6dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:41:20.861801 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a413e6-31e6-4943-973f-36ce7eade6dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:20.863412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a413e6-31e6-4943-973f-36ce7eade6dd None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:20.871490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 578/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:41:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:20.877146 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c243c1a-d535-43d2-9a44-fab1100fe43d None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:20.973876 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c243c1a-d535-43d2-9a44-fab1100fe43d None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:20.982173 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:21.007688 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2d207-c13c-40af-9dc5-c7455c6a748c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:21.008535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2d207-c13c-40af-9dc5-c7455c6a748c None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:21.008850 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2d207-c13c-40af-9dc5-c7455c6a748c None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:21.009127 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2d207-c13c-40af-9dc5-c7455c6a748c None admin] PATH_INFO: `/v3/users/d4993bc69b9941aa952e241c7225b0bc` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:21.010371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2d207-c13c-40af-9dc5-c7455c6a748c None admin] RBAC: Authorizing `identity:get_user(user_id=d4993bc69b9941aa952e241c7225b0bc)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:21.012133 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2d207-c13c-40af-9dc5-c7455c6a748c None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:21.014051 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 573/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:41:20 2022] GET /identity/v3/users/d4993bc69b9941aa952e241c7225b0bc => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:21.019670 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a413e6-31e6-4943-973f-36ce7eade6dd None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:21.116928 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a413e6-31e6-4943-973f-36ce7eade6dd None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:21.149947 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46015f98-ab7a-4430-b9e6-4f18dd8faa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:21.150797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46015f98-ab7a-4430-b9e6-4f18dd8faa6f None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:21.151084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46015f98-ab7a-4430-b9e6-4f18dd8faa6f None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:21.151364 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46015f98-ab7a-4430-b9e6-4f18dd8faa6f None admin] PATH_INFO: `/v3/projects/9a67b5c8290f4d24aa5d146f3b82eba5` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:21.152539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46015f98-ab7a-4430-b9e6-4f18dd8faa6f None admin] RBAC: Authorizing `identity:get_project(project_id=9a67b5c8290f4d24aa5d146f3b82eba5)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:21.153992 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46015f98-ab7a-4430-b9e6-4f18dd8faa6f None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:21.155662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 579/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:41:21 2022] GET /identity/v3/projects/9a67b5c8290f4d24aa5d146f3b82eba5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:21.161392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2d207-c13c-40af-9dc5-c7455c6a748c None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:21.257209 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2d207-c13c-40af-9dc5-c7455c6a748c None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:21.289932 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740aa10-78cd-4529-9bd4-c5c40f045a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:21.290798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740aa10-78cd-4529-9bd4-c5c40f045a0f None admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:21.291079 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740aa10-78cd-4529-9bd4-c5c40f045a0f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:21.291352 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740aa10-78cd-4529-9bd4-c5c40f045a0f None admin] PATH_INFO: `/v3/projects/9a67b5c8290f4d24aa5d146f3b82eba5/users/d4993bc69b9941aa952e241c7225b0bc/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:21.293278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740aa10-78cd-4529-9bd4-c5c40f045a0f None admin] RBAC: Authorizing `identity:create_grant(project_id=9a67b5c8290f4d24aa5d146f3b82eba5, user_id=d4993bc69b9941aa952e241c7225b0bc, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:21.294684 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740aa10-78cd-4529-9bd4-c5c40f045a0f None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:21.389055 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 574/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:41:21 2022] PUT /identity/v3/projects/9a67b5c8290f4d24aa5d146f3b82eba5/users/d4993bc69b9941aa952e241c7225b0bc/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:41:23.393867 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91650a-d501-4fe3-afd4-67d1934bf141 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:23.394408 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91650a-d501-4fe3-afd4-67d1934bf141 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:23.394408 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91650a-d501-4fe3-afd4-67d1934bf141 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:23.395777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 580/1154] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:23.401007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953396b3-a83f-4568-8c65-af1bfa6bf3b6 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:23.401392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953396b3-a83f-4568-8c65-af1bfa6bf3b6 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:23.401578 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953396b3-a83f-4568-8c65-af1bfa6bf3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:23.418297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-953396b3-a83f-4568-8c65-af1bfa6bf3b6 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:23.419489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-953396b3-a83f-4568-8c65-af1bfa6bf3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:23.448715 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:23.484147 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 575/1155] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:41:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:41:23.509216 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91650a-d501-4fe3-afd4-67d1934bf141 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:23.512104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:23.609549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91650a-d501-4fe3-afd4-67d1934bf141 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:23.644231 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566112be-f8b3-4318-9ee5-c6862743c502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:23.645049 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566112be-f8b3-4318-9ee5-c6862743c502 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:23.645335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566112be-f8b3-4318-9ee5-c6862743c502 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:23.645645 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566112be-f8b3-4318-9ee5-c6862743c502 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:23.656036 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566112be-f8b3-4318-9ee5-c6862743c502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:41:23.664412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-566112be-f8b3-4318-9ee5-c6862743c502 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:41:23.664412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:41:23.664412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:41:23.664412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:41:23.664412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:41:23.664412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:41:23.664412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:41:23.664412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:41:23.664412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:41:23.664412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:41:23.664412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:41:23.664412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:41:23.664412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:41:23.664412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:41:23.664412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:41:23.664412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:41:23.665543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:41:23.665543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:41:23.665543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:41:23.665543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:41:23.665543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:41:23.665543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:41:23.665543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:41:23.665543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:41:23.665543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:41:23.665543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:41:23.665543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:41:23.665543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:41:23.665543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:41:23.665543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:41:23.665543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:41:23.665543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:41:23.666441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:41:23.666441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:41:23.666441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:41:23.666441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:41:23.666441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:41:23.666441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:41:23.666441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:41:23.666441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:41:23.666441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:41:23.666441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:41:23.666441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:41:23.666441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:41:23.666441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 581/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:41:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:41:23.671615 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953396b3-a83f-4568-8c65-af1bfa6bf3b6 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:23.768009 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953396b3-a83f-4568-8c65-af1bfa6bf3b6 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:23.801455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc2add-83fd-41d5-8510-7f76f6349c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:23.802111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc2add-83fd-41d5-8510-7f76f6349c02 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:23.802400 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc2add-83fd-41d5-8510-7f76f6349c02 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:23.802682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc2add-83fd-41d5-8510-7f76f6349c02 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:23.803430 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc2add-83fd-41d5-8510-7f76f6349c02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:41:23.803742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc2add-83fd-41d5-8510-7f76f6349c02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:23.805141 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc2add-83fd-41d5-8510-7f76f6349c02 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:23.812929 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 576/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:41:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:23.818503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566112be-f8b3-4318-9ee5-c6862743c502 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:23.879058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:23.917090 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566112be-f8b3-4318-9ee5-c6862743c502 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:23.949663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a5ef9-53fe-4b97-8471-90ca94413755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:23.950524 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a5ef9-53fe-4b97-8471-90ca94413755 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:23.950811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a5ef9-53fe-4b97-8471-90ca94413755 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:23.951091 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a5ef9-53fe-4b97-8471-90ca94413755 None admin] PATH_INFO: `/v3/users/d4993bc69b9941aa952e241c7225b0bc` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:23.952263 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a5ef9-53fe-4b97-8471-90ca94413755 None admin] RBAC: Authorizing `identity:get_user(user_id=d4993bc69b9941aa952e241c7225b0bc)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:23.953729 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a5ef9-53fe-4b97-8471-90ca94413755 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:23.956062 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 582/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:41:23 2022] GET /identity/v3/users/d4993bc69b9941aa952e241c7225b0bc => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:23.961683 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc2add-83fd-41d5-8510-7f76f6349c02 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:23.989469 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:24.058171 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc2add-83fd-41d5-8510-7f76f6349c02 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:24.090387 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8198e1-f33c-4056-b3c1-b6edd97867a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:24.091017 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8198e1-f33c-4056-b3c1-b6edd97867a2 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:24.091300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8198e1-f33c-4056-b3c1-b6edd97867a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:24.091577 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8198e1-f33c-4056-b3c1-b6edd97867a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:24.155549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8198e1-f33c-4056-b3c1-b6edd97867a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:24.156991 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8198e1-f33c-4056-b3c1-b6edd97867a2 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:24.183029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:24.251096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 577/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:41:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:41:24.257125 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a5ef9-53fe-4b97-8471-90ca94413755 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:24.352188 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a5ef9-53fe-4b97-8471-90ca94413755 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:24.379684 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:24.385188 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9b3e3-61a5-4094-a7e6-0fe2cb314aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:24.386039 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9b3e3-61a5-4094-a7e6-0fe2cb314aeb None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:24.386346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9b3e3-61a5-4094-a7e6-0fe2cb314aeb None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:24.386622 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9b3e3-61a5-4094-a7e6-0fe2cb314aeb None admin] PATH_INFO: `/v3/projects/9a67b5c8290f4d24aa5d146f3b82eba5` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:24.387776 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9b3e3-61a5-4094-a7e6-0fe2cb314aeb None admin] RBAC: Authorizing `identity:get_project(project_id=9a67b5c8290f4d24aa5d146f3b82eba5)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:24.389250 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9b3e3-61a5-4094-a7e6-0fe2cb314aeb None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:24.390917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 583/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:41:24 2022] GET /identity/v3/projects/9a67b5c8290f4d24aa5d146f3b82eba5 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:24.397596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8198e1-f33c-4056-b3c1-b6edd97867a2 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:24.491215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8198e1-f33c-4056-b3c1-b6edd97867a2 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:24.516568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:24.524429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ceb1f-3c5e-4bf5-8ddf-c822d00b8396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:24.525097 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ceb1f-3c5e-4bf5-8ddf-c822d00b8396 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:24.528708 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ceb1f-3c5e-4bf5-8ddf-c822d00b8396 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:24.528708 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ceb1f-3c5e-4bf5-8ddf-c822d00b8396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:24.528708 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ceb1f-3c5e-4bf5-8ddf-c822d00b8396 None admin] RBAC: Adding query filter params (role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.project.id=9a67b5c8290f4d24aa5d146f3b82eba5, user.id=d4993bc69b9941aa952e241c7225b0bc) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:41:24.528708 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ceb1f-3c5e-4bf5-8ddf-c822d00b8396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:24.528708 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ceb1f-3c5e-4bf5-8ddf-c822d00b8396 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:24.533833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 578/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:41:24 2022] GET /identity/v3/role_assignments?user.id=d4993bc69b9941aa952e241c7225b0bc&scope.project.id=9a67b5c8290f4d24aa5d146f3b82eba5&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:26.569275 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2531f-612d-404b-acf3-3d499f299e85 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:26.569778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2531f-612d-404b-acf3-3d499f299e85 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:26.569857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2531f-612d-404b-acf3-3d499f299e85 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:26.571203 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 584/1162] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:26.576507 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24270702-f54a-4db7-87b8-8348acb5df66 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:26.576959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24270702-f54a-4db7-87b8-8348acb5df66 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:26.577128 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24270702-f54a-4db7-87b8-8348acb5df66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:26.594132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-24270702-f54a-4db7-87b8-8348acb5df66 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:26.595331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-24270702-f54a-4db7-87b8-8348acb5df66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:26.665545 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 579/1163] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:41:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:41:26.688946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2531f-612d-404b-acf3-3d499f299e85 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:26.787845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2531f-612d-404b-acf3-3d499f299e85 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:26.821568 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99652aa-4166-47c4-a49c-bd003b3692a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:26.822146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99652aa-4166-47c4-a49c-bd003b3692a1 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:26.822435 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99652aa-4166-47c4-a49c-bd003b3692a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:26.822717 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99652aa-4166-47c4-a49c-bd003b3692a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:26.883976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:26.887225 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99652aa-4166-47c4-a49c-bd003b3692a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:26.888674 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99652aa-4166-47c4-a49c-bd003b3692a1 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:26.981773 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 585/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:41:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:41:26.987800 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24270702-f54a-4db7-87b8-8348acb5df66 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:27.082641 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24270702-f54a-4db7-87b8-8348acb5df66 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:27.104521 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:27.115556 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fe6a3-0e04-4e6f-bfc3-44145bbfe094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:27.117782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fe6a3-0e04-4e6f-bfc3-44145bbfe094 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:27.117782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fe6a3-0e04-4e6f-bfc3-44145bbfe094 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:27.117782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fe6a3-0e04-4e6f-bfc3-44145bbfe094 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:27.123781 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fe6a3-0e04-4e6f-bfc3-44145bbfe094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:27.125306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fe6a3-0e04-4e6f-bfc3-44145bbfe094 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:27.140198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-d63fe6a3-0e04-4e6f-bfc3-44145bbfe094 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 10:41:27.140198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:41:27.140198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 23 10:41:27.140198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 23 10:41:27.140198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:41:27.140198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:41:27.140198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:41:27.140198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:41:27.140198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 23 10:41:27.140198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:41:27.140198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:41:27.140198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:41:27.140198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:41:27.140198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:41:27.140198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:41:27.140198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:41:27.140198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:41:27.141429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:41:27.141429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:41:27.141429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:41:27.141429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:41:27.141429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:41:27.141429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:41:27.141429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:41:27.141429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:41:27.141429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:41:27.141429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:41:27.141429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:41:27.141429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:41:27.141429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:41:27.141429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:41:27.141429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:41:27.141429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:41:27.143222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:41:27.143222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:41:27.143222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:41:27.143222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:41:27.143222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:41:27.143222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:41:27.143222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:41:27.143222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:41:27.143222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:41:27.143222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:41:27.143222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 23 10:41:27.143222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:41:27.143222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 10:41:27.143222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:41:27.143222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 580/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 23 10:41:26 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:41:27.147871 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99652aa-4166-47c4-a49c-bd003b3692a1 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:27.239374 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:27.242806 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99652aa-4166-47c4-a49c-bd003b3692a1 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:27.275714 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70392fd5-0ba2-4faa-824a-4b5fb2475ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:27.276367 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392fd5-0ba2-4faa-824a-4b5fb2475ece None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:27.276669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392fd5-0ba2-4faa-824a-4b5fb2475ece None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:27.276948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392fd5-0ba2-4faa-824a-4b5fb2475ece None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:27.277659 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70392fd5-0ba2-4faa-824a-4b5fb2475ece None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:41:27.277965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70392fd5-0ba2-4faa-824a-4b5fb2475ece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:27.279318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70392fd5-0ba2-4faa-824a-4b5fb2475ece None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:27.287050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 586/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jun 23 10:41:27 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:29.275739 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc15de-6ef0-45e0-be5f-a61ee0a9955a None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:29.276282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc15de-6ef0-45e0-be5f-a61ee0a9955a None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:29.276282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc15de-6ef0-45e0-be5f-a61ee0a9955a None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:29.277670 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 581/1167] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:29.283606 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6033347-3f18-4276-97da-40312807133e None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:29.283981 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6033347-3f18-4276-97da-40312807133e None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:29.284159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6033347-3f18-4276-97da-40312807133e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:29.300472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-f6033347-3f18-4276-97da-40312807133e None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:29.301677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f6033347-3f18-4276-97da-40312807133e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:29.365905 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 587/1168] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:41:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:41:29.389342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc15de-6ef0-45e0-be5f-a61ee0a9955a None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:29.488649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc15de-6ef0-45e0-be5f-a61ee0a9955a None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:29.521461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3897d-c8b3-4d3a-a02b-2d7787e7f5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:29.522088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3897d-c8b3-4d3a-a02b-2d7787e7f5ec None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:29.522374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3897d-c8b3-4d3a-a02b-2d7787e7f5ec None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:29.522651 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3897d-c8b3-4d3a-a02b-2d7787e7f5ec None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:29.523392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3897d-c8b3-4d3a-a02b-2d7787e7f5ec None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:29.524885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3897d-c8b3-4d3a-a02b-2d7787e7f5ec None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:29.600879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 582/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Thu Jun 23 10:41:29 2022] POST /identity/v3/domains => generated 267 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:41:31.690451 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b019f8-27dc-4b85-8af6-516a081f8627 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:31.690948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b019f8-27dc-4b85-8af6-516a081f8627 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:31.691060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b019f8-27dc-4b85-8af6-516a081f8627 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:31.692380 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 588/1170] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:31.697528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d245b8b-4261-4f67-9d1c-4f4321decccc None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:31.697898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d245b8b-4261-4f67-9d1c-4f4321decccc None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:31.698099 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d245b8b-4261-4f67-9d1c-4f4321decccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:31.715106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-2d245b8b-4261-4f67-9d1c-4f4321decccc None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:31.716284 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-2d245b8b-4261-4f67-9d1c-4f4321decccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:31.751333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:31.783479 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 583/1171] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:41:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:41:31.807032 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b019f8-27dc-4b85-8af6-516a081f8627 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:31.896509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:31.905509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b019f8-27dc-4b85-8af6-516a081f8627 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:31.937824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa66539-2d8b-43dd-adba-81845617fe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:31.939205 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa66539-2d8b-43dd-adba-81845617fe30 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:31.939691 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa66539-2d8b-43dd-adba-81845617fe30 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:31.939977 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa66539-2d8b-43dd-adba-81845617fe30 None admin] PATH_INFO: `/v3/domains/b6ac91f6db104b21a089529cb07b0d80` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:31.950068 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa66539-2d8b-43dd-adba-81845617fe30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b6ac91f6db104b21a089529cb07b0d80)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:31.951503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa66539-2d8b-43dd-adba-81845617fe30 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:31.953161 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 589/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Thu Jun 23 10:41:31 2022] GET /identity/v3/domains/b6ac91f6db104b21a089529cb07b0d80 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:31.959874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d245b8b-4261-4f67-9d1c-4f4321decccc None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:32.055999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d245b8b-4261-4f67-9d1c-4f4321decccc None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:32.089082 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c231f-de1c-4128-8ad4-5f42215fb781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:32.089729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c231f-de1c-4128-8ad4-5f42215fb781 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:32.090013 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c231f-de1c-4128-8ad4-5f42215fb781 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:32.090290 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c231f-de1c-4128-8ad4-5f42215fb781 None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:32.090998 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c231f-de1c-4128-8ad4-5f42215fb781 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:32.092418 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c231f-de1c-4128-8ad4-5f42215fb781 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:32.160450 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 584/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 23 10:41:31 2022] POST /identity/v3/projects => generated 361 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:41:34.212351 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a1adf-a8c3-4967-aed5-c64dd4a00198 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:34.212967 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a1adf-a8c3-4967-aed5-c64dd4a00198 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:34.212967 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a1adf-a8c3-4967-aed5-c64dd4a00198 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:34.214296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 590/1174] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:34.219381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f807a-6d15-4584-9c6f-addb73decce5 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:34.220325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f807a-6d15-4584-9c6f-addb73decce5 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:34.220497 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f807a-6d15-4584-9c6f-addb73decce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:34.237620 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-941f807a-6d15-4584-9c6f-addb73decce5 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:34.238802 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-941f807a-6d15-4584-9c6f-addb73decce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:34.255650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:34.303868 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 585/1175] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:41:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:41:34.328685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a1adf-a8c3-4967-aed5-c64dd4a00198 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:34.427426 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a1adf-a8c3-4967-aed5-c64dd4a00198 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:34.459574 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b569d5-999c-4bdf-b215-e27271a41473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:34.460421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b569d5-999c-4bdf-b215-e27271a41473 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:34.460730 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b569d5-999c-4bdf-b215-e27271a41473 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:34.461010 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b569d5-999c-4bdf-b215-e27271a41473 None admin] PATH_INFO: `/v3/domains/b6ac91f6db104b21a089529cb07b0d80` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:34.462170 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b569d5-999c-4bdf-b215-e27271a41473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b6ac91f6db104b21a089529cb07b0d80)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:34.463640 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b569d5-999c-4bdf-b215-e27271a41473 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:34.465197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 591/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Thu Jun 23 10:41:34 2022] GET /identity/v3/domains/b6ac91f6db104b21a089529cb07b0d80 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:34.471536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f807a-6d15-4584-9c6f-addb73decce5 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:34.566342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f807a-6d15-4584-9c6f-addb73decce5 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:34.598088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32da27-4857-45a1-b903-b567c0719e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:34.598742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32da27-4857-45a1-b903-b567c0719e17 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:34.599025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32da27-4857-45a1-b903-b567c0719e17 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:34.599301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32da27-4857-45a1-b903-b567c0719e17 None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:34.600004 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32da27-4857-45a1-b903-b567c0719e17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:34.601448 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32da27-4857-45a1-b903-b567c0719e17 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:34.688942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 586/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 23 10:41:34 2022] POST /identity/v3/users => generated 311 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:41:36.801659 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16b08c-96f0-4c26-9ea1-36e18163fc52 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:36.802205 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16b08c-96f0-4c26-9ea1-36e18163fc52 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:36.802205 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16b08c-96f0-4c26-9ea1-36e18163fc52 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:36.803560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 592/1178] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:36.808765 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0dbaa-d578-4bba-8402-a2f059367200 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:36.809199 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0dbaa-d578-4bba-8402-a2f059367200 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:36.809335 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0dbaa-d578-4bba-8402-a2f059367200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:36.826241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-41f0dbaa-d578-4bba-8402-a2f059367200 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:36.827420 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-41f0dbaa-d578-4bba-8402-a2f059367200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:36.830310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:36.892227 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 587/1179] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:41:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:41:36.915307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16b08c-96f0-4c26-9ea1-36e18163fc52 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:36.937691 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:37.013234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16b08c-96f0-4c26-9ea1-36e18163fc52 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:37.044699 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68948fdb-9a6a-4101-b010-298d498a313b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:37.045514 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68948fdb-9a6a-4101-b010-298d498a313b None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:37.045799 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68948fdb-9a6a-4101-b010-298d498a313b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:37.046073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68948fdb-9a6a-4101-b010-298d498a313b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:37.056852 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68948fdb-9a6a-4101-b010-298d498a313b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:41:37.064462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-68948fdb-9a6a-4101-b010-298d498a313b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:41:37.064462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:41:37.064462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:41:37.064462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:41:37.064462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:41:37.064462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:41:37.064462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:41:37.064462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:41:37.064462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:41:37.064462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:41:37.064462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:41:37.064462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:41:37.064462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:41:37.064462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:41:37.064462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:41:37.064462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:41:37.065658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:41:37.065658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:41:37.065658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:41:37.065658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:41:37.065658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:41:37.065658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:41:37.065658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:41:37.065658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:41:37.065658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:41:37.065658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:41:37.065658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:41:37.065658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:41:37.065658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:41:37.065658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:41:37.065658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:41:37.065658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:41:37.066732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:41:37.066732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:41:37.066732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:41:37.066732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:41:37.066732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:41:37.066732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:41:37.066732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:41:37.066732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:41:37.066732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:41:37.066732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:41:37.066732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:41:37.066732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:41:37.066732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 593/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:41:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:41:37.071518 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0dbaa-d578-4bba-8402-a2f059367200 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:37.165718 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0dbaa-d578-4bba-8402-a2f059367200 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:37.197985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7e26a-adfc-4b7c-aaa4-ef88eef691ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:37.198638 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7e26a-adfc-4b7c-aaa4-ef88eef691ca None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:37.198918 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7e26a-adfc-4b7c-aaa4-ef88eef691ca None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:37.199192 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7e26a-adfc-4b7c-aaa4-ef88eef691ca None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:37.199931 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7e26a-adfc-4b7c-aaa4-ef88eef691ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:41:37.200238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7e26a-adfc-4b7c-aaa4-ef88eef691ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:37.201626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7e26a-adfc-4b7c-aaa4-ef88eef691ca None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:37.209727 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 588/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:41:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:37.215429 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68948fdb-9a6a-4101-b010-298d498a313b None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:37.292505 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:37.310816 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68948fdb-9a6a-4101-b010-298d498a313b None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:37.349976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720796a-d771-4583-a61d-54c6ebae0316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:37.350831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720796a-d771-4583-a61d-54c6ebae0316 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:37.351115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720796a-d771-4583-a61d-54c6ebae0316 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:37.351388 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720796a-d771-4583-a61d-54c6ebae0316 None admin] PATH_INFO: `/v3/users/5e7cff575a7946768791cf75cd38c2b7` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:37.364014 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720796a-d771-4583-a61d-54c6ebae0316 None admin] RBAC: Authorizing `identity:get_user(user_id=5e7cff575a7946768791cf75cd38c2b7)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:37.365475 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720796a-d771-4583-a61d-54c6ebae0316 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:37.367087 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 594/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:41:37 2022] GET /identity/v3/users/5e7cff575a7946768791cf75cd38c2b7 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:37.372981 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7e26a-adfc-4b7c-aaa4-ef88eef691ca None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:37.375825 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:37.471294 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7e26a-adfc-4b7c-aaa4-ef88eef691ca None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:37.502818 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3184e-8c88-43b9-b571-9a7e3096d522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:37.503454 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3184e-8c88-43b9-b571-9a7e3096d522 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:37.503737 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3184e-8c88-43b9-b571-9a7e3096d522 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:37.504012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3184e-8c88-43b9-b571-9a7e3096d522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:37.567909 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3184e-8c88-43b9-b571-9a7e3096d522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:37.569363 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3184e-8c88-43b9-b571-9a7e3096d522 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:37.571089 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:37.666617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 589/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:41:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:41:37.672995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720796a-d771-4583-a61d-54c6ebae0316 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:37.770447 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720796a-d771-4583-a61d-54c6ebae0316 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:37.803107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811490d4-3e43-437a-bfba-b7e198230a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:37.809604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811490d4-3e43-437a-bfba-b7e198230a9f None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:37.809604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811490d4-3e43-437a-bfba-b7e198230a9f None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:37.809604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811490d4-3e43-437a-bfba-b7e198230a9f None admin] PATH_INFO: `/v3/projects/47913d82cf594c15815d24e2f08a7f9b` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:37.809604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811490d4-3e43-437a-bfba-b7e198230a9f None admin] RBAC: Authorizing `identity:get_project(project_id=47913d82cf594c15815d24e2f08a7f9b)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:37.809604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811490d4-3e43-437a-bfba-b7e198230a9f None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:37.809604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 595/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:41:37 2022] GET /identity/v3/projects/47913d82cf594c15815d24e2f08a7f9b => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:37.814838 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3184e-8c88-43b9-b571-9a7e3096d522 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:37.911117 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3184e-8c88-43b9-b571-9a7e3096d522 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:37.912594 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:37.944412 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c5a51-f718-4b8a-9506-b1fecfa9b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:37.945079 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c5a51-f718-4b8a-9506-b1fecfa9b5b1 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:37.945370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c5a51-f718-4b8a-9506-b1fecfa9b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:37.945645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c5a51-f718-4b8a-9506-b1fecfa9b5b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:37.946470 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c5a51-f718-4b8a-9506-b1fecfa9b5b1 None admin] RBAC: Adding query filter params (role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.project.id=47913d82cf594c15815d24e2f08a7f9b, user.id=5e7cff575a7946768791cf75cd38c2b7) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:41:37.946782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c5a51-f718-4b8a-9506-b1fecfa9b5b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:37.948202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c5a51-f718-4b8a-9506-b1fecfa9b5b1 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:37.953524 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 590/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:41:37 2022] GET /identity/v3/role_assignments?user.id=5e7cff575a7946768791cf75cd38c2b7&scope.project.id=47913d82cf594c15815d24e2f08a7f9b&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:39.921508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0accf8-b558-47b2-8a8e-d1f1ab967311 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:39.922008 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0accf8-b558-47b2-8a8e-d1f1ab967311 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:39.922008 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0accf8-b558-47b2-8a8e-d1f1ab967311 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:39.923883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 596/1186] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:39.929186 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944b07d-6e3b-405d-9e2a-b650cebefa01 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:39.929627 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944b07d-6e3b-405d-9e2a-b650cebefa01 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:39.929756 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944b07d-6e3b-405d-9e2a-b650cebefa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:39.946722 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-a944b07d-6e3b-405d-9e2a-b650cebefa01 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:39.947965 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-a944b07d-6e3b-405d-9e2a-b650cebefa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:40.012546 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 591/1187] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:41:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:41:40.035787 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0accf8-b558-47b2-8a8e-d1f1ab967311 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:40.045050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:40.134291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0accf8-b558-47b2-8a8e-d1f1ab967311 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:40.166220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378c614-cb44-42b1-b774-5f989507162a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:40.167001 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378c614-cb44-42b1-b774-5f989507162a None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:40.167282 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378c614-cb44-42b1-b774-5f989507162a None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:40.167558 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378c614-cb44-42b1-b774-5f989507162a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:40.178360 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378c614-cb44-42b1-b774-5f989507162a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:41:40.185733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-0378c614-cb44-42b1-b774-5f989507162a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:41:40.185733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:41:40.185733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:41:40.185733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:41:40.185733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:41:40.185733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:41:40.185733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:41:40.185733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:41:40.185733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:41:40.185733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:41:40.185733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:41:40.185733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:41:40.185733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:41:40.185733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:41:40.185733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:41:40.185733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:41:40.186827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:41:40.186827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:41:40.186827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:41:40.186827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:41:40.186827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:41:40.186827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:41:40.186827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:41:40.186827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:41:40.186827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:41:40.186827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:41:40.186827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:41:40.186827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:41:40.186827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:41:40.186827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:41:40.186827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:41:40.186827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:41:40.187897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:41:40.187897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:41:40.187897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:41:40.187897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:41:40.187897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:41:40.187897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:41:40.187897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:41:40.187897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:41:40.187897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:41:40.187897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:41:40.187897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:41:40.187897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:41:40.187897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 597/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:41:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:41:40.193121 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944b07d-6e3b-405d-9e2a-b650cebefa01 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:40.282874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:40.288404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944b07d-6e3b-405d-9e2a-b650cebefa01 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:40.320902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3087ef-23b4-4a8e-b3e7-0460485db9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:40.321556 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3087ef-23b4-4a8e-b3e7-0460485db9b2 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:40.321838 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3087ef-23b4-4a8e-b3e7-0460485db9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:40.322114 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3087ef-23b4-4a8e-b3e7-0460485db9b2 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:40.322851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3087ef-23b4-4a8e-b3e7-0460485db9b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:41:40.323173 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3087ef-23b4-4a8e-b3e7-0460485db9b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:40.324505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3087ef-23b4-4a8e-b3e7-0460485db9b2 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:40.332363 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 592/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:41:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:40.338040 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378c614-cb44-42b1-b774-5f989507162a None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:40.401544 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:40.433785 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378c614-cb44-42b1-b774-5f989507162a None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:40.466208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d31ad4-a937-4ce4-be1c-3453d5430966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:40.467067 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d31ad4-a937-4ce4-be1c-3453d5430966 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:40.467348 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d31ad4-a937-4ce4-be1c-3453d5430966 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:40.467623 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d31ad4-a937-4ce4-be1c-3453d5430966 None admin] PATH_INFO: `/v3/users/5e7cff575a7946768791cf75cd38c2b7` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:40.468809 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d31ad4-a937-4ce4-be1c-3453d5430966 None admin] RBAC: Authorizing `identity:get_user(user_id=5e7cff575a7946768791cf75cd38c2b7)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:40.470975 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d31ad4-a937-4ce4-be1c-3453d5430966 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:40.472571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 598/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:41:40 2022] GET /identity/v3/users/5e7cff575a7946768791cf75cd38c2b7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:40.478207 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3087ef-23b4-4a8e-b3e7-0460485db9b2 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:40.573010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3087ef-23b4-4a8e-b3e7-0460485db9b2 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:40.605456 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b08dfe-de37-4d96-a095-32f670bbccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:40.606299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b08dfe-de37-4d96-a095-32f670bbccec None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:40.606581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b08dfe-de37-4d96-a095-32f670bbccec None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:40.606857 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b08dfe-de37-4d96-a095-32f670bbccec None admin] PATH_INFO: `/v3/projects/47913d82cf594c15815d24e2f08a7f9b` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:40.608004 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b08dfe-de37-4d96-a095-32f670bbccec None admin] RBAC: Authorizing `identity:get_project(project_id=47913d82cf594c15815d24e2f08a7f9b)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:40.609460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b08dfe-de37-4d96-a095-32f670bbccec None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:40.611172 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 593/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:41:40 2022] GET /identity/v3/projects/47913d82cf594c15815d24e2f08a7f9b => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:40.617137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d31ad4-a937-4ce4-be1c-3453d5430966 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:40.714431 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d31ad4-a937-4ce4-be1c-3453d5430966 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:40.747425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59528ba9-b946-4ff6-a19f-a66ed32f4077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:40.748303 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59528ba9-b946-4ff6-a19f-a66ed32f4077 None admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:40.748587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59528ba9-b946-4ff6-a19f-a66ed32f4077 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:40.748892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59528ba9-b946-4ff6-a19f-a66ed32f4077 None admin] PATH_INFO: `/v3/projects/47913d82cf594c15815d24e2f08a7f9b/users/5e7cff575a7946768791cf75cd38c2b7/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:40.750934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59528ba9-b946-4ff6-a19f-a66ed32f4077 None admin] RBAC: Authorizing `identity:create_grant(project_id=47913d82cf594c15815d24e2f08a7f9b, user_id=5e7cff575a7946768791cf75cd38c2b7, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:40.752358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59528ba9-b946-4ff6-a19f-a66ed32f4077 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:40.754546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:40.821486 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 599/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:41:40 2022] PUT /identity/v3/projects/47913d82cf594c15815d24e2f08a7f9b/users/5e7cff575a7946768791cf75cd38c2b7/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:41:42.814944 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cd187-20d2-497d-8902-4e640e06883e None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:42.815454 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cd187-20d2-497d-8902-4e640e06883e None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:42.815540 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cd187-20d2-497d-8902-4e640e06883e None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:42.816881 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 594/1193] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:41:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:42.822135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e265468-128c-4d79-94cb-e341012a55ef None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:42.822538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e265468-128c-4d79-94cb-e341012a55ef None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:42.822690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e265468-128c-4d79-94cb-e341012a55ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:42.838922 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-0e265468-128c-4d79-94cb-e341012a55ef None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:42.840097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-0e265468-128c-4d79-94cb-e341012a55ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:42.904787 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 600/1194] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:41:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:41:42.929281 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cd187-20d2-497d-8902-4e640e06883e None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:42.957225 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:43.027716 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cd187-20d2-497d-8902-4e640e06883e None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:43.060759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7c867-6cb2-436d-bdbd-0cfbac8c2267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:43.061526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7c867-6cb2-436d-bdbd-0cfbac8c2267 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:43.061810 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7c867-6cb2-436d-bdbd-0cfbac8c2267 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:43.062085 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7c867-6cb2-436d-bdbd-0cfbac8c2267 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:43.071784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7c867-6cb2-436d-bdbd-0cfbac8c2267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:41:43.079332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-35e7c867-6cb2-436d-bdbd-0cfbac8c2267 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:41:43.079332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:41:43.079332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:41:43.079332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:41:43.079332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:41:43.079332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:41:43.079332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:41:43.079332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:41:43.079332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:41:43.079332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:41:43.079332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:41:43.079332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:41:43.079332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:41:43.079332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:41:43.079332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:41:43.079332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:41:43.080408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:41:43.080408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:41:43.080408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:41:43.080408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:41:43.080408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:41:43.080408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:41:43.080408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:41:43.080408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:41:43.080408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:41:43.080408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:41:43.080408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:41:43.080408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:41:43.080408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:41:43.080408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:41:43.080408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:41:43.080408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:41:43.081477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:41:43.081477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:41:43.081477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:41:43.081477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:41:43.081477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:41:43.081477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:41:43.081477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:41:43.081477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:41:43.081477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:41:43.081477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:41:43.081477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:41:43.081477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:41:43.081477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 595/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:41:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:41:43.086354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e265468-128c-4d79-94cb-e341012a55ef None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:43.180721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e265468-128c-4d79-94cb-e341012a55ef None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:43.202549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:43.212615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3feea-ddc4-4f90-aba3-346efeda9cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:43.213258 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3feea-ddc4-4f90-aba3-346efeda9cb4 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:43.221776 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3feea-ddc4-4f90-aba3-346efeda9cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:43.221776 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3feea-ddc4-4f90-aba3-346efeda9cb4 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:43.221776 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3feea-ddc4-4f90-aba3-346efeda9cb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:41:43.221776 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3feea-ddc4-4f90-aba3-346efeda9cb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:43.221776 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3feea-ddc4-4f90-aba3-346efeda9cb4 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:43.224353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 601/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:41:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:43.230040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7c867-6cb2-436d-bdbd-0cfbac8c2267 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:43.313749 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:43.327831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7c867-6cb2-436d-bdbd-0cfbac8c2267 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:43.361236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f93790-9f60-40ed-b66b-ad19a0475769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:43.362084 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f93790-9f60-40ed-b66b-ad19a0475769 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:43.362368 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f93790-9f60-40ed-b66b-ad19a0475769 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:43.362649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f93790-9f60-40ed-b66b-ad19a0475769 None admin] PATH_INFO: `/v3/users/5e7cff575a7946768791cf75cd38c2b7` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:43.363820 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f93790-9f60-40ed-b66b-ad19a0475769 None admin] RBAC: Authorizing `identity:get_user(user_id=5e7cff575a7946768791cf75cd38c2b7)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:43.365275 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f93790-9f60-40ed-b66b-ad19a0475769 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:43.366884 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 596/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 23 10:41:43 2022] GET /identity/v3/users/5e7cff575a7946768791cf75cd38c2b7 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:43.372780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3feea-ddc4-4f90-aba3-346efeda9cb4 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:43.467989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3feea-ddc4-4f90-aba3-346efeda9cb4 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:43.499884 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5d929-5b47-4ee7-99ab-e99a302a8c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:43.500546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5d929-5b47-4ee7-99ab-e99a302a8c90 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:43.500854 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5d929-5b47-4ee7-99ab-e99a302a8c90 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:43.501131 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5d929-5b47-4ee7-99ab-e99a302a8c90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:43.552393 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:43.564599 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5d929-5b47-4ee7-99ab-e99a302a8c90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:43.566050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5d929-5b47-4ee7-99ab-e99a302a8c90 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:43.664173 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 602/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:41:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:41:43.670049 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f93790-9f60-40ed-b66b-ad19a0475769 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:43.766178 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f93790-9f60-40ed-b66b-ad19a0475769 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:43.798349 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc444f7-d700-4a9a-b7a1-cf0fe473fc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:43.799193 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc444f7-d700-4a9a-b7a1-cf0fe473fc14 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:43.799479 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc444f7-d700-4a9a-b7a1-cf0fe473fc14 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:43.799758 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc444f7-d700-4a9a-b7a1-cf0fe473fc14 None admin] PATH_INFO: `/v3/projects/47913d82cf594c15815d24e2f08a7f9b` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:43.800954 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc444f7-d700-4a9a-b7a1-cf0fe473fc14 None admin] RBAC: Authorizing `identity:get_project(project_id=47913d82cf594c15815d24e2f08a7f9b)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:43.802382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc444f7-d700-4a9a-b7a1-cf0fe473fc14 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:43.804053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 597/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 23 10:41:43 2022] GET /identity/v3/projects/47913d82cf594c15815d24e2f08a7f9b => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:43.809939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5d929-5b47-4ee7-99ab-e99a302a8c90 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:43.892191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:43.906352 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5d929-5b47-4ee7-99ab-e99a302a8c90 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:43.939998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52c73d-f1e3-4ed7-af7c-2f94b3b935dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:43.940667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52c73d-f1e3-4ed7-af7c-2f94b3b935dc None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:43.940959 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52c73d-f1e3-4ed7-af7c-2f94b3b935dc None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:43.941240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52c73d-f1e3-4ed7-af7c-2f94b3b935dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:43.942088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52c73d-f1e3-4ed7-af7c-2f94b3b935dc None admin] RBAC: Adding query filter params (role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.project.id=47913d82cf594c15815d24e2f08a7f9b, user.id=5e7cff575a7946768791cf75cd38c2b7) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:41:43.942402 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52c73d-f1e3-4ed7-af7c-2f94b3b935dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:43.943827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52c73d-f1e3-4ed7-af7c-2f94b3b935dc None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:43.949526 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 603/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:41:43 2022] GET /identity/v3/role_assignments?user.id=5e7cff575a7946768791cf75cd38c2b7&scope.project.id=47913d82cf594c15815d24e2f08a7f9b&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:41:53.794045 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:53.947013 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=25 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:56.433806 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec34db-e8fc-498c-8880-ce87e52ee4c9 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:56.434391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec34db-e8fc-498c-8880-ce87e52ee4c9 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:56.434391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec34db-e8fc-498c-8880-ce87e52ee4c9 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:56.435704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 598/1201] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:56.440949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfc7e5-99bf-4a92-afb0-e134a0c181f6 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:56.441373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfc7e5-99bf-4a92-afb0-e134a0c181f6 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:56.441511 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfc7e5-99bf-4a92-afb0-e134a0c181f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:56.458136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-3bdfc7e5-99bf-4a92-afb0-e134a0c181f6 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:56.459313 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-3bdfc7e5-99bf-4a92-afb0-e134a0c181f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:56.525657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 604/1202] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:42:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:42:56.551079 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec34db-e8fc-498c-8880-ce87e52ee4c9 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:56.652548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec34db-e8fc-498c-8880-ce87e52ee4c9 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:56.685873 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1c911-cd7e-4417-837b-aa8e0b59f9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:56.686602 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1c911-cd7e-4417-837b-aa8e0b59f9f8 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:56.687103 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1c911-cd7e-4417-837b-aa8e0b59f9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:56.687398 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1c911-cd7e-4417-837b-aa8e0b59f9f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:56.697159 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1c911-cd7e-4417-837b-aa8e0b59f9f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:56.698587 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1c911-cd7e-4417-837b-aa8e0b59f9f8 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:56.716319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-f7a1c911-cd7e-4417-837b-aa8e0b59f9f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:42:56.716319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:42:56.716319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:42:56.716319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:42:56.716319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:42:56.716319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:42:56.716319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:42:56.716319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:42:56.716319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:42:56.716319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:42:56.716319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:42:56.716319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:42:56.716319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:42:56.716319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:42:56.716319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:42:56.718093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:42:56.718093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:42:56.718093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:42:56.718093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:42:56.718093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:42:56.718093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:42:56.718093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:42:56.718093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:42:56.718093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:42:56.718093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:42:56.718093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:42:56.718093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:42:56.718093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:42:56.718093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:42:56.718093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:42:56.718093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:42:56.718093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:42:56.719692 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:42:56.719692 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:42:56.719692 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:42:56.719692 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:42:56.719692 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 599/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:42:56.724130 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfc7e5-99bf-4a92-afb0-e134a0c181f6 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:56.820770 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfc7e5-99bf-4a92-afb0-e134a0c181f6 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:56.848782 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:56.854024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba9b0b-eacd-4127-82b4-127898c5aed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:56.854694 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba9b0b-eacd-4127-82b4-127898c5aed3 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:56.860934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba9b0b-eacd-4127-82b4-127898c5aed3 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:56.860934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba9b0b-eacd-4127-82b4-127898c5aed3 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:56.860934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba9b0b-eacd-4127-82b4-127898c5aed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:42:56.860934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba9b0b-eacd-4127-82b4-127898c5aed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:56.860934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba9b0b-eacd-4127-82b4-127898c5aed3 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:56.869106 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 605/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:42:56.875458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1c911-cd7e-4417-837b-aa8e0b59f9f8 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:56.926957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:56.971729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1c911-cd7e-4417-837b-aa8e0b59f9f8 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:57.006327 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64c247-ae81-439a-9eab-f222bae05147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:57.009427 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64c247-ae81-439a-9eab-f222bae05147 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:57.009427 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64c247-ae81-439a-9eab-f222bae05147 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:57.009427 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64c247-ae81-439a-9eab-f222bae05147 None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:57.009427 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64c247-ae81-439a-9eab-f222bae05147 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:57.009805 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64c247-ae81-439a-9eab-f222bae05147 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:57.121563 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 600/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 23 10:42:56 2022] POST /identity/v3/users => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:42:59.159620 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec6ae1-8dea-4019-8653-58736846432c None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:59.160193 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec6ae1-8dea-4019-8653-58736846432c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:59.160193 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec6ae1-8dea-4019-8653-58736846432c None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:59.161587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 606/1206] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:59.166924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be563b39-7cb0-4709-a3ed-4a07474cd0d2 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:59.167387 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be563b39-7cb0-4709-a3ed-4a07474cd0d2 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:59.167521 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be563b39-7cb0-4709-a3ed-4a07474cd0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:59.184506 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-be563b39-7cb0-4709-a3ed-4a07474cd0d2 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:59.185697 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-be563b39-7cb0-4709-a3ed-4a07474cd0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:59.255655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 601/1207] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:42:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:42:59.280197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec6ae1-8dea-4019-8653-58736846432c None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:59.380243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec6ae1-8dea-4019-8653-58736846432c None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:59.414092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4becbee-50ca-43c3-85e9-3868c16ad48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:59.414812 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4becbee-50ca-43c3-85e9-3868c16ad48c None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:59.415091 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4becbee-50ca-43c3-85e9-3868c16ad48c None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:59.415362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4becbee-50ca-43c3-85e9-3868c16ad48c None admin] PATH_INFO: `/v3/roles/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:59.427810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4becbee-50ca-43c3-85e9-3868c16ad48c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:42:59.435551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-e4becbee-50ca-43c3-85e9-3868c16ad48c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:42:59.435551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:42:59.435551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:42:59.435551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:42:59.435551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:42:59.435551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:42:59.435551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:42:59.435551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:42:59.435551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:42:59.435551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:42:59.435551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:42:59.435551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:42:59.435551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:42:59.435551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:42:59.435551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:42:59.435551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:42:59.437266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:42:59.437266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:42:59.437266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:42:59.437266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:42:59.437266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:42:59.437266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:42:59.437266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:42:59.437266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:42:59.437266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:42:59.437266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:42:59.437266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:42:59.437266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:42:59.437266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:42:59.437266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:42:59.437266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:42:59.437266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:42:59.438428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:42:59.438428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:42:59.438428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:42:59.438428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:42:59.438428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:42:59.438428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:42:59.438428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:42:59.438428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:42:59.438428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:42:59.438428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:42:59.438428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:42:59.438428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:42:59.438428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 607/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:42:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:42:59.443601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be563b39-7cb0-4709-a3ed-4a07474cd0d2 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:59.482164 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:59.540230 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be563b39-7cb0-4709-a3ed-4a07474cd0d2 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:59.573109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02ee6d-b6fc-4048-9b21-6c4aa7b8e0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:59.573766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02ee6d-b6fc-4048-9b21-6c4aa7b8e0a8 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:59.574048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02ee6d-b6fc-4048-9b21-6c4aa7b8e0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:59.574321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02ee6d-b6fc-4048-9b21-6c4aa7b8e0a8 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:59.575169 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02ee6d-b6fc-4048-9b21-6c4aa7b8e0a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:42:59.575474 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02ee6d-b6fc-4048-9b21-6c4aa7b8e0a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:59.576859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02ee6d-b6fc-4048-9b21-6c4aa7b8e0a8 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:59.585300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 602/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:42:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:42:59.591258 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4becbee-50ca-43c3-85e9-3868c16ad48c None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:59.643104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:59.692083 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4becbee-50ca-43c3-85e9-3868c16ad48c None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:59.725176 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e0b42-52ee-4097-b1c1-67042dce31d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:59.726062 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e0b42-52ee-4097-b1c1-67042dce31d5 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:59.726346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e0b42-52ee-4097-b1c1-67042dce31d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:59.726621 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e0b42-52ee-4097-b1c1-67042dce31d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:59.737526 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e0b42-52ee-4097-b1c1-67042dce31d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:59.739254 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e0b42-52ee-4097-b1c1-67042dce31d5 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:59.756127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-385e0b42-52ee-4097-b1c1-67042dce31d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:42:59.756127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:42:59.756127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:42:59.756127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:42:59.756127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:42:59.756127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:42:59.756127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:42:59.756127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:42:59.756127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:42:59.756127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:42:59.756127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:42:59.756127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:42:59.756127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:42:59.756127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:42:59.756127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:42:59.757189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:42:59.757189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:42:59.757189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:42:59.757189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:42:59.757189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:42:59.757189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:42:59.757189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:42:59.757189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:42:59.757189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:42:59.757189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:42:59.757189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:42:59.757189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:42:59.757189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:42:59.757189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:42:59.757189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:42:59.757189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:42:59.757189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:42:59.758285 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:42:59.758285 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:42:59.758285 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:42:59.758285 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:42:59.758285 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 608/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:42:59.763185 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02ee6d-b6fc-4048-9b21-6c4aa7b8e0a8 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:59.859963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:59.862810 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02ee6d-b6fc-4048-9b21-6c4aa7b8e0a8 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:59.895105 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29519eda-a2bf-49ef-a559-b98991cfc7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:59.895753 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29519eda-a2bf-49ef-a559-b98991cfc7c8 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:59.896035 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29519eda-a2bf-49ef-a559-b98991cfc7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:59.896309 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29519eda-a2bf-49ef-a559-b98991cfc7c8 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:59.897083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29519eda-a2bf-49ef-a559-b98991cfc7c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:42:59.897372 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29519eda-a2bf-49ef-a559-b98991cfc7c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:59.898715 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29519eda-a2bf-49ef-a559-b98991cfc7c8 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:59.909964 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 603/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:42:59.915608 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e0b42-52ee-4097-b1c1-67042dce31d5 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:00.017174 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e0b42-52ee-4097-b1c1-67042dce31d5 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:00.018619 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:00.051937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfd92c-e243-407c-b2f5-9a40780841b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:00.052770 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfd92c-e243-407c-b2f5-9a40780841b4 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:00.053054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfd92c-e243-407c-b2f5-9a40780841b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:00.053328 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfd92c-e243-407c-b2f5-9a40780841b4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:00.061732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfd92c-e243-407c-b2f5-9a40780841b4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:00.063185 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfd92c-e243-407c-b2f5-9a40780841b4 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:00.076891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-d1dfd92c-e243-407c-b2f5-9a40780841b4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:43:00.076891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:00.076891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:00.076891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:00.076891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:00.076891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:00.076891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:00.076891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:00.076891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:00.076891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:00.076891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:00.076891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:00.076891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:43:00.076891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:43:00.076891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:43:00.076891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:43:00.080227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:00.080227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:00.080227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:43:00.080227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:43:00.080227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:43:00.080227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:43:00.080227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:00.080227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:00.080227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:00.080227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:00.080227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:00.080227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:00.080227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:00.080227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:00.080227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:00.080227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:00.080227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:00.080227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:00.081456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:00.081456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:00.081456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:43:00.081456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:43:00.081456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:43:00.081456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:43:00.081456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:43:00.081456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:43:00.081456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:43:00.081456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:00.081456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 609/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:42:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:00.083762 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29519eda-a2bf-49ef-a559-b98991cfc7c8 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:00.180729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29519eda-a2bf-49ef-a559-b98991cfc7c8 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:00.213382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b82810-8584-4e11-aeaa-0d4f7f94790e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:00.214046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b82810-8584-4e11-aeaa-0d4f7f94790e None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:00.214330 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b82810-8584-4e11-aeaa-0d4f7f94790e None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:00.214635 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b82810-8584-4e11-aeaa-0d4f7f94790e None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:00.215495 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b82810-8584-4e11-aeaa-0d4f7f94790e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:00.215805 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b82810-8584-4e11-aeaa-0d4f7f94790e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:00.217259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b82810-8584-4e11-aeaa-0d4f7f94790e None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:00.235305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 604/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jun 23 10:43:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:00.241270 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfd92c-e243-407c-b2f5-9a40780841b4 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:00.338630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfd92c-e243-407c-b2f5-9a40780841b4 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:00.371597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e76b09-3854-42ae-854f-e2126b1d2023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:00.372253 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e76b09-3854-42ae-854f-e2126b1d2023 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:00.372544 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e76b09-3854-42ae-854f-e2126b1d2023 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:00.372861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e76b09-3854-42ae-854f-e2126b1d2023 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:00.402143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:00.438685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e76b09-3854-42ae-854f-e2126b1d2023 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:00.440165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e76b09-3854-42ae-854f-e2126b1d2023 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:00.538786 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 610/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:43:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:43:00.544553 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b82810-8584-4e11-aeaa-0d4f7f94790e None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:00.563290 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:00.642056 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b82810-8584-4e11-aeaa-0d4f7f94790e None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:00.676386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3817f5-35ba-4d5d-a381-0b6822d8a670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:00.677191 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3817f5-35ba-4d5d-a381-0b6822d8a670 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:00.677473 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3817f5-35ba-4d5d-a381-0b6822d8a670 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:00.677747 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3817f5-35ba-4d5d-a381-0b6822d8a670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:00.687907 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3817f5-35ba-4d5d-a381-0b6822d8a670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:00.689363 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3817f5-35ba-4d5d-a381-0b6822d8a670 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:00.706759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-9e3817f5-35ba-4d5d-a381-0b6822d8a670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:00.706759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:00.706759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:00.706759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:00.706759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:00.706759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:00.706759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:00.706759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:00.706759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:00.706759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:00.706759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:00.706759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:00.706759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:43:00.706759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:43:00.706759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:43:00.713750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:43:00.713750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:00.713750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:00.713750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:00.713750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:00.713750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:00.713750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:00.713750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:00.713750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:00.713750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:00.713750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:00.713750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:00.713750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:00.713750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:00.713750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:00.713750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:00.713750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:00.714893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:43:00.714893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:43:00.714893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:00.714893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:43:00.714893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 605/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:00.715233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e76b09-3854-42ae-854f-e2126b1d2023 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:00.775901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:00.813418 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e76b09-3854-42ae-854f-e2126b1d2023 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:00.847073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a9f32-6235-477d-a1e8-8140abe77ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:00.847736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a9f32-6235-477d-a1e8-8140abe77ec8 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:00.848024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a9f32-6235-477d-a1e8-8140abe77ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:00.848306 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a9f32-6235-477d-a1e8-8140abe77ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:00.849103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a9f32-6235-477d-a1e8-8140abe77ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:00.849412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a9f32-6235-477d-a1e8-8140abe77ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:00.850781 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a9f32-6235-477d-a1e8-8140abe77ec8 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:00.864248 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 611/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:00.869665 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3817f5-35ba-4d5d-a381-0b6822d8a670 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:00.938257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:00.967706 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3817f5-35ba-4d5d-a381-0b6822d8a670 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:01.001444 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18316a-e786-4ac9-bc90-6b8d2fdeeee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:01.002225 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18316a-e786-4ac9-bc90-6b8d2fdeeee0 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:01.002515 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18316a-e786-4ac9-bc90-6b8d2fdeeee0 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:01.002841 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18316a-e786-4ac9-bc90-6b8d2fdeeee0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:01.010290 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18316a-e786-4ac9-bc90-6b8d2fdeeee0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:01.014390 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18316a-e786-4ac9-bc90-6b8d2fdeeee0 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:01.025165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-bd18316a-e786-4ac9-bc90-6b8d2fdeeee0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:43:01.025165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:01.025165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:01.025165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:01.025165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:01.025165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:01.025165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:01.025165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:01.025165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:01.025165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:01.025165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:01.025165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:01.025165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:43:01.025165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:43:01.025165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:43:01.026221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:43:01.026221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:01.026221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:01.026221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:01.026221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:01.026221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:01.026221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:01.026221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:01.026221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:01.026221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:01.026221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:01.026221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:01.026221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:01.026221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:01.026221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:01.026221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:01.026221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:01.027267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:43:01.027267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:43:01.027267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:43:01.027267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:43:01.027267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:43:01.027267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:43:01.027267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:43:01.027267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:43:01.027267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 606/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:43:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:01.032389 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a9f32-6235-477d-a1e8-8140abe77ec8 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:01.131753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a9f32-6235-477d-a1e8-8140abe77ec8 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:01.153015 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:01.164006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee05c52-ebfd-4ac2-98a1-9a6da9c34dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:01.164732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee05c52-ebfd-4ac2-98a1-9a6da9c34dd4 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:01.165014 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee05c52-ebfd-4ac2-98a1-9a6da9c34dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:01.165290 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee05c52-ebfd-4ac2-98a1-9a6da9c34dd4 None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:01.166069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee05c52-ebfd-4ac2-98a1-9a6da9c34dd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:01.166380 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee05c52-ebfd-4ac2-98a1-9a6da9c34dd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:01.167793 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee05c52-ebfd-4ac2-98a1-9a6da9c34dd4 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:01.180159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 612/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:43:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:01.186346 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18316a-e786-4ac9-bc90-6b8d2fdeeee0 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:01.285027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18316a-e786-4ac9-bc90-6b8d2fdeeee0 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:01.313927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:01.319600 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a4af2-4b66-4725-abe8-205cf1413b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:01.320256 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a4af2-4b66-4725-abe8-205cf1413b4f None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:01.320545 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a4af2-4b66-4725-abe8-205cf1413b4f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:01.320855 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a4af2-4b66-4725-abe8-205cf1413b4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:01.321685 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a4af2-4b66-4725-abe8-205cf1413b4f None admin] RBAC: Adding query filter params (role.id=3522dd96085d47688d7a42ed133484a9, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=6ff588aaad264f9cbc5a80e73ef0c09d) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:01.322000 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a4af2-4b66-4725-abe8-205cf1413b4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:01.323458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a4af2-4b66-4725-abe8-205cf1413b4f None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:01.329253 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 607/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:43:01 2022] GET /identity/v3/role_assignments?user.id=6ff588aaad264f9cbc5a80e73ef0c09d&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=3522dd96085d47688d7a42ed133484a9 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:03.332968 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69455794-71e6-4a2e-9af3-46842f7e4d09 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:03.333528 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69455794-71e6-4a2e-9af3-46842f7e4d09 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:03.333528 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69455794-71e6-4a2e-9af3-46842f7e4d09 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:03.334975 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 613/1220] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:03.340079 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201bf50-c1fd-490d-b3d5-b9760b862c99 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:03.340519 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201bf50-c1fd-490d-b3d5-b9760b862c99 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:03.340614 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201bf50-c1fd-490d-b3d5-b9760b862c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:03.357174 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-b201bf50-c1fd-490d-b3d5-b9760b862c99 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:03.358939 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b201bf50-c1fd-490d-b3d5-b9760b862c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:03.424872 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 608/1221] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:43:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:43:03.448232 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69455794-71e6-4a2e-9af3-46842f7e4d09 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:03.547439 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69455794-71e6-4a2e-9af3-46842f7e4d09 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:03.581052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a140a-9df1-4283-abc1-aeb431fd3417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:03.581852 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a140a-9df1-4283-abc1-aeb431fd3417 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:03.582129 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a140a-9df1-4283-abc1-aeb431fd3417 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:03.582411 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a140a-9df1-4283-abc1-aeb431fd3417 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:03.592546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a140a-9df1-4283-abc1-aeb431fd3417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:43:03.600901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-114a140a-9df1-4283-abc1-aeb431fd3417 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:43:03.600901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:03.600901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:03.600901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:03.600901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:03.600901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:03.600901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:03.600901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:03.600901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:03.600901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:03.600901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:03.600901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:03.600901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:43:03.600901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:43:03.600901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:43:03.600901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:43:03.602112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:43:03.602112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:43:03.602112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:43:03.602112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:43:03.602112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:03.602112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:03.602112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:03.602112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:03.602112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:03.602112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:03.602112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:03.602112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:03.602112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:03.602112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:03.602112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:03.602112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:03.602998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:03.602998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:03.602998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:03.602998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:03.602998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:43:03.602998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:43:03.602998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:43:03.602998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:43:03.602998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:43:03.602998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:43:03.602998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:43:03.602998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:03.602998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 614/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:43:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:03.609190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201bf50-c1fd-490d-b3d5-b9760b862c99 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:03.707303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201bf50-c1fd-490d-b3d5-b9760b862c99 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:03.730131 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:03.741209 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c546700-13e1-4c9a-a67b-ff80f2eedf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:03.741869 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c546700-13e1-4c9a-a67b-ff80f2eedf00 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:03.742203 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c546700-13e1-4c9a-a67b-ff80f2eedf00 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:03.742454 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c546700-13e1-4c9a-a67b-ff80f2eedf00 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:03.743192 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c546700-13e1-4c9a-a67b-ff80f2eedf00 None admin] RBAC: Adding query filter params (name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:03.743498 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c546700-13e1-4c9a-a67b-ff80f2eedf00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:03.744888 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c546700-13e1-4c9a-a67b-ff80f2eedf00 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:03.752740 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 609/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:43:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:03.758355 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a140a-9df1-4283-abc1-aeb431fd3417 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:03.801207 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:03.855535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a140a-9df1-4283-abc1-aeb431fd3417 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:03.888008 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee838570-8d71-4b9a-abe3-8b86f8ee6107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:03.888866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee838570-8d71-4b9a-abe3-8b86f8ee6107 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:03.889149 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee838570-8d71-4b9a-abe3-8b86f8ee6107 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:03.889428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee838570-8d71-4b9a-abe3-8b86f8ee6107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:03.899716 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee838570-8d71-4b9a-abe3-8b86f8ee6107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:03.901243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee838570-8d71-4b9a-abe3-8b86f8ee6107 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:03.919896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-ee838570-8d71-4b9a-abe3-8b86f8ee6107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:03.919896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:03.919896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:03.919896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:03.919896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:03.919896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:03.919896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:03.919896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:03.919896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:03.919896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:03.919896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:03.919896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:03.919896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:43:03.919896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:43:03.919896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:43:03.921071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:43:03.921071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:03.921071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:03.921071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:03.921071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:03.921071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:03.921071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:03.921071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:03.921071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:03.921071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:03.921071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:03.921071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:03.921071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:03.921071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:03.921071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:03.921071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:03.921071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:03.922695 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:43:03.922695 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:43:03.922695 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:03.922695 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:03.922695 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 615/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:03.927660 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c546700-13e1-4c9a-a67b-ff80f2eedf00 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:04.026854 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c546700-13e1-4c9a-a67b-ff80f2eedf00 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:04.059891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9fc78-bad8-46cf-b93d-ca72bbc7c3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:04.060545 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9fc78-bad8-46cf-b93d-ca72bbc7c3c9 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:04.060905 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9fc78-bad8-46cf-b93d-ca72bbc7c3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:04.061180 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9fc78-bad8-46cf-b93d-ca72bbc7c3c9 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:04.062011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9fc78-bad8-46cf-b93d-ca72bbc7c3c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:04.062315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9fc78-bad8-46cf-b93d-ca72bbc7c3c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:04.063896 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9fc78-bad8-46cf-b93d-ca72bbc7c3c9 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:04.075957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 610/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:04.082335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee838570-8d71-4b9a-abe3-8b86f8ee6107 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:04.175339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:04.181746 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee838570-8d71-4b9a-abe3-8b86f8ee6107 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:04.214386 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c986b-85cc-4d23-b532-4f953a2a97b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:04.215191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c986b-85cc-4d23-b532-4f953a2a97b4 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:04.215478 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c986b-85cc-4d23-b532-4f953a2a97b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:04.215760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c986b-85cc-4d23-b532-4f953a2a97b4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:04.223636 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c986b-85cc-4d23-b532-4f953a2a97b4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:04.225104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c986b-85cc-4d23-b532-4f953a2a97b4 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:04.239471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-c14c986b-85cc-4d23-b532-4f953a2a97b4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:43:04.239471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:04.239471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:04.239471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:04.239471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:04.239471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:04.239471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:04.239471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:04.239471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:04.239471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:04.239471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:04.239471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:04.239471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:43:04.239471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:43:04.239471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:43:04.239471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:43:04.240575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:04.240575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:04.240575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:43:04.240575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:43:04.240575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:43:04.240575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:43:04.240575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:04.240575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:04.240575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:04.240575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:04.240575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:04.240575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:04.240575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:04.240575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:04.240575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:04.240575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:04.240575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:04.240575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:04.241759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:04.241759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:04.241759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:43:04.241759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:43:04.241759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:43:04.241759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:43:04.241759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:43:04.241759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:43:04.241759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:43:04.241759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:04.241759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 616/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:43:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:04.246599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9fc78-bad8-46cf-b93d-ca72bbc7c3c9 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:04.292893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:04.345158 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9fc78-bad8-46cf-b93d-ca72bbc7c3c9 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:04.379871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6c6d9-0ae5-484f-b646-2cf8205bf3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:04.380526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6c6d9-0ae5-484f-b646-2cf8205bf3fd None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:04.380839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6c6d9-0ae5-484f-b646-2cf8205bf3fd None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:04.381116 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6c6d9-0ae5-484f-b646-2cf8205bf3fd None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:04.381943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6c6d9-0ae5-484f-b646-2cf8205bf3fd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:04.382250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6c6d9-0ae5-484f-b646-2cf8205bf3fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:04.383663 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6c6d9-0ae5-484f-b646-2cf8205bf3fd None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:04.401132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 611/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jun 23 10:43:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:04.407086 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c986b-85cc-4d23-b532-4f953a2a97b4 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:04.505615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c986b-85cc-4d23-b532-4f953a2a97b4 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:04.538036 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96960f-cf6c-411f-8bb7-ca8ab8ee5436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:04.538822 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96960f-cf6c-411f-8bb7-ca8ab8ee5436 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:04.539106 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96960f-cf6c-411f-8bb7-ca8ab8ee5436 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:04.539383 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96960f-cf6c-411f-8bb7-ca8ab8ee5436 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:04.550497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96960f-cf6c-411f-8bb7-ca8ab8ee5436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:04.551977 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96960f-cf6c-411f-8bb7-ca8ab8ee5436 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:04.568519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-7d96960f-cf6c-411f-8bb7-ca8ab8ee5436 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:04.568519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:04.568519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:04.568519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:04.568519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:04.568519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:04.568519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:04.568519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:04.568519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:04.568519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:04.568519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:04.568519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:04.568519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:43:04.568519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:43:04.568519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:43:04.569609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:43:04.569609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:04.569609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:04.569609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:04.569609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:04.569609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:04.569609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:04.569609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:04.569609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:04.569609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:04.569609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:04.569609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:04.569609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:04.569609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:04.569609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:04.569609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:04.569609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:04.570686 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:43:04.570686 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:43:04.570686 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:04.570686 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:04.570686 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 617/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:04.575573 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6c6d9-0ae5-484f-b646-2cf8205bf3fd None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:04.675230 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6c6d9-0ae5-484f-b646-2cf8205bf3fd None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:04.677506 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:04.707807 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd002a7-350a-495f-9a8b-b77cb7e44997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:04.708465 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd002a7-350a-495f-9a8b-b77cb7e44997 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:04.708779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd002a7-350a-495f-9a8b-b77cb7e44997 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:04.709058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd002a7-350a-495f-9a8b-b77cb7e44997 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:04.709770 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd002a7-350a-495f-9a8b-b77cb7e44997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:04.710080 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd002a7-350a-495f-9a8b-b77cb7e44997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:04.711448 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd002a7-350a-495f-9a8b-b77cb7e44997 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:04.723048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 612/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:04.728850 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96960f-cf6c-411f-8bb7-ca8ab8ee5436 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:04.738323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:04.824608 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96960f-cf6c-411f-8bb7-ca8ab8ee5436 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:04.858107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7cbc66-4ec2-4d9c-a10a-55ad6d6814c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:04.858927 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cbc66-4ec2-4d9c-a10a-55ad6d6814c3 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:04.859217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cbc66-4ec2-4d9c-a10a-55ad6d6814c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:04.859487 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cbc66-4ec2-4d9c-a10a-55ad6d6814c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:04.866229 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7cbc66-4ec2-4d9c-a10a-55ad6d6814c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:04.867662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7cbc66-4ec2-4d9c-a10a-55ad6d6814c3 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:04.882425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-ab7cbc66-4ec2-4d9c-a10a-55ad6d6814c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:43:04.882425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:04.882425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:04.882425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:04.882425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:04.882425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:04.882425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:04.882425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:04.882425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:04.882425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:04.882425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:04.882425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:04.882425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:43:04.882425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:43:04.882425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:43:04.883474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:43:04.883474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:04.883474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:04.883474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:04.883474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:04.883474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:04.883474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:04.883474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:04.883474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:04.883474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:04.883474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:04.883474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:04.883474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:04.883474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:04.883474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:04.883474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:04.883474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:04.884561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:43:04.884561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:43:04.884561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:43:04.884561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:43:04.884561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:43:04.884561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:43:04.884561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:43:04.884561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:04.884561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 618/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:43:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:04.889564 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd002a7-350a-495f-9a8b-b77cb7e44997 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:04.989449 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd002a7-350a-495f-9a8b-b77cb7e44997 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:05.022398 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26ece4-1f0a-45dc-8e63-656d58476419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:05.023056 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26ece4-1f0a-45dc-8e63-656d58476419 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:05.023369 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26ece4-1f0a-45dc-8e63-656d58476419 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:05.023628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26ece4-1f0a-45dc-8e63-656d58476419 None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:05.024414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26ece4-1f0a-45dc-8e63-656d58476419 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:05.024759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26ece4-1f0a-45dc-8e63-656d58476419 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:05.026183 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26ece4-1f0a-45dc-8e63-656d58476419 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:05.038624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 613/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:43:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:05.044687 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7cbc66-4ec2-4d9c-a10a-55ad6d6814c3 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:05.109286 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:05.143953 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7cbc66-4ec2-4d9c-a10a-55ad6d6814c3 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:05.176261 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d74106-1d6f-4cc4-89be-c023929608ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:05.177227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d74106-1d6f-4cc4-89be-c023929608ee None admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:05.177717 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d74106-1d6f-4cc4-89be-c023929608ee None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:05.178183 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d74106-1d6f-4cc4-89be-c023929608ee None admin] PATH_INFO: `/v3/projects/d7a9c82a62044db884e547da9a523927/users/6ff588aaad264f9cbc5a80e73ef0c09d/roles/3522dd96085d47688d7a42ed133484a9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:05.194152 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d74106-1d6f-4cc4-89be-c023929608ee None admin] RBAC: Authorizing `identity:create_grant(project_id=d7a9c82a62044db884e547da9a523927, user_id=6ff588aaad264f9cbc5a80e73ef0c09d, role_id=3522dd96085d47688d7a42ed133484a9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:05.218607 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d74106-1d6f-4cc4-89be-c023929608ee None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:05.298359 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 619/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:43:05 2022] PUT /identity/v3/projects/d7a9c82a62044db884e547da9a523927/users/6ff588aaad264f9cbc5a80e73ef0c09d/roles/3522dd96085d47688d7a42ed133484a9 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:43:07.300342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a7367-5ded-482f-aa5e-7b522cb6fbbb None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:07.301048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a7367-5ded-482f-aa5e-7b522cb6fbbb None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:07.301048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a7367-5ded-482f-aa5e-7b522cb6fbbb None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:07.302289 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 614/1233] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:07.307729 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9023d1-f9e9-43c2-8b9e-d9d271ae515b None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:07.308147 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9023d1-f9e9-43c2-8b9e-d9d271ae515b None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:07.308287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9023d1-f9e9-43c2-8b9e-d9d271ae515b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:07.324864 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-ad9023d1-f9e9-43c2-8b9e-d9d271ae515b None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:07.327377 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ad9023d1-f9e9-43c2-8b9e-d9d271ae515b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:07.393106 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 620/1234] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:43:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:43:07.417010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a7367-5ded-482f-aa5e-7b522cb6fbbb None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:07.442828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:07.516374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a7367-5ded-482f-aa5e-7b522cb6fbbb None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:07.549355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec59cb-8f82-4595-902d-57e2506c0e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:07.550135 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec59cb-8f82-4595-902d-57e2506c0e38 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:07.550469 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec59cb-8f82-4595-902d-57e2506c0e38 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:07.550693 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec59cb-8f82-4595-902d-57e2506c0e38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:07.560226 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec59cb-8f82-4595-902d-57e2506c0e38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:43:07.567779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-b5ec59cb-8f82-4595-902d-57e2506c0e38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:43:07.567779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:07.567779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:07.567779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:07.567779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:07.567779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:07.567779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:07.567779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:07.567779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:07.567779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:07.567779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:07.567779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:07.567779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:43:07.567779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:43:07.567779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:43:07.567779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:43:07.569038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:43:07.569038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:43:07.569038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:43:07.569038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:43:07.569038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:07.569038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:07.569038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:07.569038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:07.569038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:07.569038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:07.569038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:07.569038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:07.569038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:07.569038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:07.569038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:07.569038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:07.570316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:07.570316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:07.570316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:07.570316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:07.570316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:43:07.570316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:43:07.570316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:43:07.570316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:43:07.570316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:43:07.570316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:43:07.570316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:43:07.570316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:43:07.570316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 615/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 23 10:43:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:07.574909 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9023d1-f9e9-43c2-8b9e-d9d271ae515b None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:07.622133 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:07.673965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9023d1-f9e9-43c2-8b9e-d9d271ae515b None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:07.706978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d3a53-bcb0-4c61-bf84-4225de157152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:07.707658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d3a53-bcb0-4c61-bf84-4225de157152 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:07.707946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d3a53-bcb0-4c61-bf84-4225de157152 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:07.708226 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d3a53-bcb0-4c61-bf84-4225de157152 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:07.709085 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d3a53-bcb0-4c61-bf84-4225de157152 None admin] RBAC: Adding query filter params (name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:07.709401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d3a53-bcb0-4c61-bf84-4225de157152 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:07.710775 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d3a53-bcb0-4c61-bf84-4225de157152 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:07.720122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 621/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 23 10:43:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:07.726287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec59cb-8f82-4595-902d-57e2506c0e38 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:07.809814 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:07.824721 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec59cb-8f82-4595-902d-57e2506c0e38 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:07.857526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dbeae-15c5-44e5-b5a8-e4963efdc433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:07.858308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dbeae-15c5-44e5-b5a8-e4963efdc433 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:07.858667 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dbeae-15c5-44e5-b5a8-e4963efdc433 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:07.858938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dbeae-15c5-44e5-b5a8-e4963efdc433 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:07.869460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dbeae-15c5-44e5-b5a8-e4963efdc433 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:07.870891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dbeae-15c5-44e5-b5a8-e4963efdc433 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:07.887333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-ba4dbeae-15c5-44e5-b5a8-e4963efdc433 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:07.887333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:07.887333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:07.887333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:07.887333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:07.887333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:07.887333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:07.887333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:07.887333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:07.887333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:07.887333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:07.887333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:07.887333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:43:07.887333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:43:07.887333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:43:07.891726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:43:07.891726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:07.891726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:07.891726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:07.891726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:07.891726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:07.891726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:07.891726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:07.891726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:07.891726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:07.891726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:07.891726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:07.891726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:07.891726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:07.891726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:07.891726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:07.891726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:07.892910 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:43:07.892910 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:43:07.892910 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:07.892910 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:43:07.892910 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 616/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:43:07.895174 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d3a53-bcb0-4c61-bf84-4225de157152 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:07.996608 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d3a53-bcb0-4c61-bf84-4225de157152 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:08.005990 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:08.030049 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435087e6-b922-4071-aced-5ed223d7fe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:08.031317 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435087e6-b922-4071-aced-5ed223d7fe92 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:08.031613 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435087e6-b922-4071-aced-5ed223d7fe92 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:08.031892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435087e6-b922-4071-aced-5ed223d7fe92 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:08.032608 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435087e6-b922-4071-aced-5ed223d7fe92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:08.032945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435087e6-b922-4071-aced-5ed223d7fe92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:08.034311 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435087e6-b922-4071-aced-5ed223d7fe92 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:08.045420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 622/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:08.051290 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dbeae-15c5-44e5-b5a8-e4963efdc433 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:08.149137 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dbeae-15c5-44e5-b5a8-e4963efdc433 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:08.181381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a54ef-1657-4bec-a343-58ba8cc1bb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:08.182169 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a54ef-1657-4bec-a343-58ba8cc1bb88 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:08.182455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a54ef-1657-4bec-a343-58ba8cc1bb88 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:08.182734 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a54ef-1657-4bec-a343-58ba8cc1bb88 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:08.185349 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:08.190761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a54ef-1657-4bec-a343-58ba8cc1bb88 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:08.192235 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a54ef-1657-4bec-a343-58ba8cc1bb88 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:08.206621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-566a54ef-1657-4bec-a343-58ba8cc1bb88 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:43:08.206621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:08.206621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:08.206621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:08.206621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:08.206621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:08.206621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:08.206621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:08.206621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:08.206621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:08.206621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:08.206621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:08.206621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:43:08.206621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:43:08.206621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:43:08.206621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:43:08.207763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:08.207763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:08.207763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:43:08.207763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:43:08.207763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:43:08.207763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:43:08.207763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:08.207763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:08.207763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:08.207763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:08.207763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:08.207763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:08.207763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:08.207763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:08.207763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:08.207763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:08.207763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:08.207763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:08.208968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:08.208968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:08.208968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:43:08.208968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:43:08.208968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:43:08.208968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:43:08.208968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:43:08.208968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:43:08.208968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:43:08.208968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:43:08.208968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 617/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:43:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:08.213543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435087e6-b922-4071-aced-5ed223d7fe92 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:08.312625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435087e6-b922-4071-aced-5ed223d7fe92 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:08.345655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b9585-713e-4995-b321-50b0a4bf247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:08.350049 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b9585-713e-4995-b321-50b0a4bf247d None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:08.350049 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b9585-713e-4995-b321-50b0a4bf247d None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:08.350049 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b9585-713e-4995-b321-50b0a4bf247d None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:08.350049 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b9585-713e-4995-b321-50b0a4bf247d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:08.350049 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b9585-713e-4995-b321-50b0a4bf247d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:08.350049 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b9585-713e-4995-b321-50b0a4bf247d None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:08.367011 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 623/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jun 23 10:43:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:43:08.372747 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a54ef-1657-4bec-a343-58ba8cc1bb88 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:08.470418 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a54ef-1657-4bec-a343-58ba8cc1bb88 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:08.505051 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fac09a-408c-4f54-9bbe-5ef22a1b24ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:08.505704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fac09a-408c-4f54-9bbe-5ef22a1b24ef None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:08.505993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fac09a-408c-4f54-9bbe-5ef22a1b24ef None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:08.506273 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fac09a-408c-4f54-9bbe-5ef22a1b24ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:08.566109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:08.572341 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fac09a-408c-4f54-9bbe-5ef22a1b24ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:08.573815 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fac09a-408c-4f54-9bbe-5ef22a1b24ef None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:08.669417 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 618/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:43:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:43:08.676105 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b9585-713e-4995-b321-50b0a4bf247d None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:08.703167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:08.775469 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b9585-713e-4995-b321-50b0a4bf247d None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:08.808866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07498bfd-acf3-448c-ad98-b0495f58c235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:08.809725 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07498bfd-acf3-448c-ad98-b0495f58c235 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:08.810013 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07498bfd-acf3-448c-ad98-b0495f58c235 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:08.810295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07498bfd-acf3-448c-ad98-b0495f58c235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:08.820962 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07498bfd-acf3-448c-ad98-b0495f58c235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:08.822407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07498bfd-acf3-448c-ad98-b0495f58c235 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:08.840698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-07498bfd-acf3-448c-ad98-b0495f58c235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:08.840698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:08.840698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:08.840698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:08.840698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:08.840698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:08.840698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:08.840698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:08.840698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:08.840698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:08.840698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:08.840698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:08.840698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:43:08.840698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:43:08.840698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:43:08.841615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:43:08.841615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:08.841615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:08.841615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:08.841615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:08.841615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:08.841615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:08.841615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:08.841615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:08.841615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:08.841615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:08.841615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:08.841615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:08.841615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:08.841615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:08.841615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:08.841615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:08.842598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:43:08.842598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:43:08.842598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:08.842598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:08.842598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 624/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:08.848548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fac09a-408c-4f54-9bbe-5ef22a1b24ef None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:08.943669 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:08.949693 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fac09a-408c-4f54-9bbe-5ef22a1b24ef None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:08.983295 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d1b91-eae4-4961-aac3-68ad14da5b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:08.984870 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d1b91-eae4-4961-aac3-68ad14da5b72 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:08.985169 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d1b91-eae4-4961-aac3-68ad14da5b72 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:08.985455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d1b91-eae4-4961-aac3-68ad14da5b72 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:08.986250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d1b91-eae4-4961-aac3-68ad14da5b72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:08.986562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d1b91-eae4-4961-aac3-68ad14da5b72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:08.987932 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d1b91-eae4-4961-aac3-68ad14da5b72 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:08.999529 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 619/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:09.004921 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07498bfd-acf3-448c-ad98-b0495f58c235 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:09.083864 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:09.105374 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07498bfd-acf3-448c-ad98-b0495f58c235 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:09.138795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2d25f-f980-40bf-b943-71f554c48d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:09.139584 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2d25f-f980-40bf-b943-71f554c48d97 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:09.139872 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2d25f-f980-40bf-b943-71f554c48d97 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:09.140138 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2d25f-f980-40bf-b943-71f554c48d97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:09.146549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2d25f-f980-40bf-b943-71f554c48d97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:09.147975 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2d25f-f980-40bf-b943-71f554c48d97 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:09.161830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-b5c2d25f-f980-40bf-b943-71f554c48d97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:43:09.161830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:09.161830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:09.161830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:09.161830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:09.161830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:09.161830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:09.161830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:09.161830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:09.161830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:09.161830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:09.161830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:09.161830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:43:09.161830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:43:09.161830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:43:09.162831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:43:09.162831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:09.162831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:09.162831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:09.162831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:09.162831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:09.162831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:09.162831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:09.162831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:09.162831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:09.162831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:09.162831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:09.162831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:09.162831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:09.162831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:09.162831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:09.162831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:09.163718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:43:09.163718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:43:09.163718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:43:09.163718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:43:09.163718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:43:09.163718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:43:09.163718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:43:09.163718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:09.163718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 625/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:43:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:09.168859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d1b91-eae4-4961-aac3-68ad14da5b72 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:09.269146 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d1b91-eae4-4961-aac3-68ad14da5b72 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:09.302087 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a19c45-46c0-4413-8716-1cee979cff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:09.302739 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a19c45-46c0-4413-8716-1cee979cff4a None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:09.303023 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a19c45-46c0-4413-8716-1cee979cff4a None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:09.303291 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a19c45-46c0-4413-8716-1cee979cff4a None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:09.304069 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a19c45-46c0-4413-8716-1cee979cff4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:09.304377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a19c45-46c0-4413-8716-1cee979cff4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:09.305821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a19c45-46c0-4413-8716-1cee979cff4a None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:09.317612 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 620/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:43:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:09.323681 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2d25f-f980-40bf-b943-71f554c48d97 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:09.423386 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2d25f-f980-40bf-b943-71f554c48d97 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:09.457562 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2a3d1-e465-4302-9f83-86a868d5eb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:09.458211 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2a3d1-e465-4302-9f83-86a868d5eb1b None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:09.458499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2a3d1-e465-4302-9f83-86a868d5eb1b None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:09.458775 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2a3d1-e465-4302-9f83-86a868d5eb1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:09.459591 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2a3d1-e465-4302-9f83-86a868d5eb1b None admin] RBAC: Adding query filter params (role.id=3522dd96085d47688d7a42ed133484a9, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=6ff588aaad264f9cbc5a80e73ef0c09d) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:09.459901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2a3d1-e465-4302-9f83-86a868d5eb1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:09.461429 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2a3d1-e465-4302-9f83-86a868d5eb1b None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:09.467094 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 626/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:43:09 2022] GET /identity/v3/role_assignments?user.id=6ff588aaad264f9cbc5a80e73ef0c09d&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=3522dd96085d47688d7a42ed133484a9 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:11.549102 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f3e21-715e-4f7b-bd7c-fea7b044a7df None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:11.549657 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f3e21-715e-4f7b-bd7c-fea7b044a7df None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:11.549657 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f3e21-715e-4f7b-bd7c-fea7b044a7df None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:11.551029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 621/1247] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:11.556325 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677e24d-824a-4c1d-800b-eb1fc56c72dd None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:11.556772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677e24d-824a-4c1d-800b-eb1fc56c72dd None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:11.556910 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677e24d-824a-4c1d-800b-eb1fc56c72dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:11.562667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:11.574761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-e677e24d-824a-4c1d-800b-eb1fc56c72dd None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:11.575949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e677e24d-824a-4c1d-800b-eb1fc56c72dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:11.643900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 627/1248] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:43:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:43:11.667238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f3e21-715e-4f7b-bd7c-fea7b044a7df None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:11.685378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:11.769453 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f3e21-715e-4f7b-bd7c-fea7b044a7df None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:11.802902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf5ab8-564c-4691-9287-18e08dd3d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:11.803625 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf5ab8-564c-4691-9287-18e08dd3d76b None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:11.803909 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf5ab8-564c-4691-9287-18e08dd3d76b None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:11.804183 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf5ab8-564c-4691-9287-18e08dd3d76b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:11.814617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf5ab8-564c-4691-9287-18e08dd3d76b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:43:11.822016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-95cf5ab8-564c-4691-9287-18e08dd3d76b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:43:11.822016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:11.822016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:11.822016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:11.822016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:11.822016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:11.822016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:11.822016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:11.822016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:11.822016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:11.822016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:11.822016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:11.822016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:43:11.822016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:43:11.822016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:43:11.822016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:43:11.823112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:43:11.823112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:43:11.823112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:43:11.823112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:43:11.823112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:11.823112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:11.823112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:11.823112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:11.823112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:11.823112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:11.823112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:11.823112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:11.823112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:11.823112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:11.823112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:11.823112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:11.824182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:11.824182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:11.824182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:11.824182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:11.824182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:43:11.824182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:43:11.824182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:43:11.824182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:43:11.824182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:43:11.824182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:43:11.824182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:43:11.824182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:43:11.824182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 622/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:43:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:11.829262 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677e24d-824a-4c1d-800b-eb1fc56c72dd None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:11.925748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677e24d-824a-4c1d-800b-eb1fc56c72dd None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:11.953498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:11.958319 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdaf4c-875d-4d7a-972d-e573f273f58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:11.958976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdaf4c-875d-4d7a-972d-e573f273f58a None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:11.959257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdaf4c-875d-4d7a-972d-e573f273f58a None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:11.959557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdaf4c-875d-4d7a-972d-e573f273f58a None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:11.960298 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcdaf4c-875d-4d7a-972d-e573f273f58a None admin] RBAC: Adding query filter params (name=admin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:11.960622 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcdaf4c-875d-4d7a-972d-e573f273f58a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:11.961980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcdaf4c-875d-4d7a-972d-e573f273f58a None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:11.970377 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 628/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:43:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:11.976316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf5ab8-564c-4691-9287-18e08dd3d76b None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:12.055666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:12.078344 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf5ab8-564c-4691-9287-18e08dd3d76b None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:12.111597 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef5228-d296-4d52-9ea0-a32dceadd3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:12.112382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef5228-d296-4d52-9ea0-a32dceadd3d9 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:12.112697 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef5228-d296-4d52-9ea0-a32dceadd3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:12.112982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef5228-d296-4d52-9ea0-a32dceadd3d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:12.123728 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef5228-d296-4d52-9ea0-a32dceadd3d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:12.125234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef5228-d296-4d52-9ea0-a32dceadd3d9 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:12.141861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-fdef5228-d296-4d52-9ea0-a32dceadd3d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:12.141861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:12.141861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:12.141861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:12.141861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:12.141861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:12.141861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:12.141861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:12.141861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:12.141861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:12.141861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:12.141861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:12.141861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:43:12.141861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:43:12.141861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:43:12.143029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:43:12.143029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:12.143029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:12.143029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:12.143029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:12.143029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:12.143029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:12.143029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:12.143029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:12.143029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:12.143029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:12.143029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:12.143029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:12.143029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:12.143029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:12.143029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:12.143029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:12.144048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:43:12.144048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:43:12.144048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:12.144048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:43:12.144048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 623/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:12.149085 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdaf4c-875d-4d7a-972d-e573f273f58a None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:12.247392 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdaf4c-875d-4d7a-972d-e573f273f58a None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:12.280011 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfff342-190d-4e06-b299-e003531f31dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:12.281544 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfff342-190d-4e06-b299-e003531f31dc None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:12.281829 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfff342-190d-4e06-b299-e003531f31dc None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:12.282105 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfff342-190d-4e06-b299-e003531f31dc None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:12.282852 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfff342-190d-4e06-b299-e003531f31dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:12.283162 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfff342-190d-4e06-b299-e003531f31dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:12.284528 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfff342-190d-4e06-b299-e003531f31dc None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:12.296051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 629/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:12.301826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef5228-d296-4d52-9ea0-a32dceadd3d9 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:12.398647 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef5228-d296-4d52-9ea0-a32dceadd3d9 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:12.424092 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:12.431447 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0760d-4c2b-42d9-b96c-38d72d97271f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:12.433684 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0760d-4c2b-42d9-b96c-38d72d97271f None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:12.433684 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0760d-4c2b-42d9-b96c-38d72d97271f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:12.433684 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0760d-4c2b-42d9-b96c-38d72d97271f None admin] PATH_INFO: `/v3/users/placement` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:12.440520 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0760d-4c2b-42d9-b96c-38d72d97271f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:12.441981 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0760d-4c2b-42d9-b96c-38d72d97271f None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:12.456596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-47f0760d-4c2b-42d9-b96c-38d72d97271f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:43:12.456596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:12.456596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:12.456596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:12.456596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:12.456596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:12.456596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:12.456596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:12.456596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:12.456596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:12.456596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:12.456596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:12.456596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:43:12.456596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:43:12.456596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:43:12.456596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:43:12.459517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:12.459517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:12.459517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:43:12.459517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:43:12.459517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:43:12.459517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:43:12.459517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:12.459517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:12.459517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:12.459517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:12.459517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:12.459517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:12.459517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:12.459517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:12.459517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:12.459517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:12.459517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:12.459517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:12.460738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:12.460738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:12.460738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:43:12.460738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:43:12.460738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:43:12.460738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:43:12.460738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:43:12.460738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:43:12.460738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:43:12.460738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:43:12.460738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 624/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:43:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:12.463752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfff342-190d-4e06-b299-e003531f31dc None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:12.519042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:12.561617 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfff342-190d-4e06-b299-e003531f31dc None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:12.595057 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4d8e5-f7aa-4145-baba-8003c65444e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:12.595761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4d8e5-f7aa-4145-baba-8003c65444e0 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:12.596153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4d8e5-f7aa-4145-baba-8003c65444e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:12.596431 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4d8e5-f7aa-4145-baba-8003c65444e0 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:12.597293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4d8e5-f7aa-4145-baba-8003c65444e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:12.597603 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4d8e5-f7aa-4145-baba-8003c65444e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:12.599017 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4d8e5-f7aa-4145-baba-8003c65444e0 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:12.616297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 630/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jun 23 10:43:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:12.621849 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0760d-4c2b-42d9-b96c-38d72d97271f None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:12.723139 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0760d-4c2b-42d9-b96c-38d72d97271f None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:12.756618 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854830f0-de80-4c32-a992-243d74386154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:12.757475 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854830f0-de80-4c32-a992-243d74386154 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:12.757579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854830f0-de80-4c32-a992-243d74386154 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:12.757835 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854830f0-de80-4c32-a992-243d74386154 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:12.811157 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:12.823352 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854830f0-de80-4c32-a992-243d74386154 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:12.824823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854830f0-de80-4c32-a992-243d74386154 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:12.922374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 625/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:43:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:43:12.928269 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4d8e5-f7aa-4145-baba-8003c65444e0 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:13.029709 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4d8e5-f7aa-4145-baba-8003c65444e0 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:13.042316 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:13.063954 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879fced-d37f-4f79-b149-74cce0448bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:13.064772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879fced-d37f-4f79-b149-74cce0448bcf None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:13.065212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879fced-d37f-4f79-b149-74cce0448bcf None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:13.065518 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879fced-d37f-4f79-b149-74cce0448bcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:13.075372 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879fced-d37f-4f79-b149-74cce0448bcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:13.076877 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879fced-d37f-4f79-b149-74cce0448bcf None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:13.094165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-0879fced-d37f-4f79-b149-74cce0448bcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:13.094165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:13.094165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:13.094165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:13.094165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:13.094165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:13.094165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:13.094165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:13.094165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:13.094165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:13.094165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:13.094165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:13.094165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:43:13.094165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:43:13.094165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:43:13.095257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:43:13.095257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:13.095257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:13.095257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:13.095257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:13.095257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:13.095257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:13.095257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:13.095257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:13.095257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:13.095257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:13.095257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:13.095257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:13.095257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:13.095257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:13.095257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:13.095257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:13.096166 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:43:13.096166 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:43:13.096166 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:13.096166 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:13.096166 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 631/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:13.101178 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854830f0-de80-4c32-a992-243d74386154 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:13.186056 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:13.197903 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854830f0-de80-4c32-a992-243d74386154 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:13.230527 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c51a6-912d-43b8-805b-53c576f9db49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:13.231180 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c51a6-912d-43b8-805b-53c576f9db49 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:13.231464 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c51a6-912d-43b8-805b-53c576f9db49 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:13.231741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c51a6-912d-43b8-805b-53c576f9db49 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:13.232470 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c51a6-912d-43b8-805b-53c576f9db49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:13.232795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c51a6-912d-43b8-805b-53c576f9db49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:13.234747 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c51a6-912d-43b8-805b-53c576f9db49 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:13.245833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 626/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:13.252204 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879fced-d37f-4f79-b149-74cce0448bcf None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:13.348816 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879fced-d37f-4f79-b149-74cce0448bcf None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:13.381903 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22226a-f40c-439b-9dbf-4ec97a832564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:13.382697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22226a-f40c-439b-9dbf-4ec97a832564 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:13.382981 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22226a-f40c-439b-9dbf-4ec97a832564 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:13.383259 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22226a-f40c-439b-9dbf-4ec97a832564 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:13.389894 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22226a-f40c-439b-9dbf-4ec97a832564 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:13.391326 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22226a-f40c-439b-9dbf-4ec97a832564 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:13.404543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-5f22226a-f40c-439b-9dbf-4ec97a832564 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:43:13.404543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:13.404543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:13.404543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:13.404543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:13.404543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:13.404543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:13.404543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:13.404543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:13.404543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:13.404543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:13.404543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:13.404543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:43:13.404543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:43:13.404543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:43:13.406178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:43:13.406178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:13.406178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:13.406178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:13.406178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:13.406178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:13.406178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:13.406178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:13.406178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:13.406178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:13.406178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:13.406178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:13.406178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:13.406178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:13.406178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:13.406178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:13.406178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:13.407296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:43:13.407296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:43:13.407296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:43:13.407296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:43:13.407296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:43:13.407296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:43:13.407296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:43:13.407296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:13.407296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 632/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:43:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:13.412046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c51a6-912d-43b8-805b-53c576f9db49 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:13.512174 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c51a6-912d-43b8-805b-53c576f9db49 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:13.544785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3758485-8450-4bd0-a498-787941650098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:13.545655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3758485-8450-4bd0-a498-787941650098 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:13.546472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3758485-8450-4bd0-a498-787941650098 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:13.546883 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3758485-8450-4bd0-a498-787941650098 None admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:13.547843 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3758485-8450-4bd0-a498-787941650098 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:13.548156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3758485-8450-4bd0-a498-787941650098 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:13.549598 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3758485-8450-4bd0-a498-787941650098 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:13.561700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 627/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:43:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:13.567673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22226a-f40c-439b-9dbf-4ec97a832564 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:13.594878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:13.667484 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22226a-f40c-439b-9dbf-4ec97a832564 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:13.700286 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8c6b5-de6f-4259-9d4e-fa109d464162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:13.700966 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8c6b5-de6f-4259-9d4e-fa109d464162 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:13.701251 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8c6b5-de6f-4259-9d4e-fa109d464162 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:13.701527 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8c6b5-de6f-4259-9d4e-fa109d464162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:13.702870 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8c6b5-de6f-4259-9d4e-fa109d464162 None admin] RBAC: Adding query filter params (role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=6ff588aaad264f9cbc5a80e73ef0c09d) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:13.703181 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8c6b5-de6f-4259-9d4e-fa109d464162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:13.704603 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8c6b5-de6f-4259-9d4e-fa109d464162 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:13.710037 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 633/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:43:13 2022] GET /identity/v3/role_assignments?user.id=6ff588aaad264f9cbc5a80e73ef0c09d&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:15.717244 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5090c29-c32d-404f-9d2d-ffcf18ca93d3 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:15.717826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5090c29-c32d-404f-9d2d-ffcf18ca93d3 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:15.717973 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5090c29-c32d-404f-9d2d-ffcf18ca93d3 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:15.719688 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 628/1261] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:15.724803 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5d8aa-00fc-4bc0-92ab-788b8b177777 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:15.725278 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5d8aa-00fc-4bc0-92ab-788b8b177777 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:15.725416 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5d8aa-00fc-4bc0-92ab-788b8b177777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:15.742156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-98e5d8aa-00fc-4bc0-92ab-788b8b177777 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:15.743347 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-98e5d8aa-00fc-4bc0-92ab-788b8b177777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:15.811130 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 634/1262] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:43:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:43:15.835241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5090c29-c32d-404f-9d2d-ffcf18ca93d3 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:15.846575 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:15.937155 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5090c29-c32d-404f-9d2d-ffcf18ca93d3 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:15.975676 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb276e-c800-49c0-b1e5-455ac6a27c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:15.976460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb276e-c800-49c0-b1e5-455ac6a27c37 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:15.976769 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb276e-c800-49c0-b1e5-455ac6a27c37 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:15.977043 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb276e-c800-49c0-b1e5-455ac6a27c37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:15.987736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb276e-c800-49c0-b1e5-455ac6a27c37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:43:15.995689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-17cb276e-c800-49c0-b1e5-455ac6a27c37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:43:15.995689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:15.995689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:15.995689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:15.995689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:15.995689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:15.995689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:15.995689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:15.995689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:15.995689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:15.995689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:15.995689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:15.995689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:43:15.995689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:43:15.995689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:43:15.995689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:43:15.996792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:43:15.996792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:43:15.996792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:43:15.996792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:43:15.996792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:15.996792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:15.996792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:15.996792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:15.996792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:15.996792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:15.996792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:15.996792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:15.996792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:15.996792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:15.996792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:15.996792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:15.998109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:15.998109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:15.998109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:15.998109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:15.998109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:43:15.998109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:43:15.998109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:43:15.998109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:43:15.998109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:43:15.998109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:43:15.998109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:43:15.998109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:43:15.998109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 629/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:43:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:16.003722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5d8aa-00fc-4bc0-92ab-788b8b177777 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:16.022103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:16.098765 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5d8aa-00fc-4bc0-92ab-788b8b177777 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:16.133181 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267391a6-6a9e-4349-ab59-2ed804e34315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:16.133983 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267391a6-6a9e-4349-ab59-2ed804e34315 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:16.134273 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267391a6-6a9e-4349-ab59-2ed804e34315 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:16.134544 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267391a6-6a9e-4349-ab59-2ed804e34315 None admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:16.135331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267391a6-6a9e-4349-ab59-2ed804e34315 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:16.135637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267391a6-6a9e-4349-ab59-2ed804e34315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:16.137018 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267391a6-6a9e-4349-ab59-2ed804e34315 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:16.145800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 635/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:43:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:16.151438 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb276e-c800-49c0-b1e5-455ac6a27c37 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:16.217402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:16.251556 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb276e-c800-49c0-b1e5-455ac6a27c37 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:16.285692 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786cff5-c826-45e7-ac56-385ae39de6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:16.286477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786cff5-c826-45e7-ac56-385ae39de6d1 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:16.286758 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786cff5-c826-45e7-ac56-385ae39de6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:16.287031 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786cff5-c826-45e7-ac56-385ae39de6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:16.297607 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786cff5-c826-45e7-ac56-385ae39de6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:16.299050 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786cff5-c826-45e7-ac56-385ae39de6d1 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:16.315776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-a786cff5-c826-45e7-ac56-385ae39de6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:16.315776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:16.315776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:16.315776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:16.315776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:16.315776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:16.315776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:16.315776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:16.315776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:16.315776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:16.315776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:16.315776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:16.315776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:43:16.315776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:43:16.315776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:43:16.316865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:43:16.316865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:16.316865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:16.316865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:16.316865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:16.316865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:16.316865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:16.316865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:16.316865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:16.316865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:16.316865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:16.316865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:16.316865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:16.316865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:16.316865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:16.316865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:16.316865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:16.317980 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:43:16.317980 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:43:16.317980 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:16.317980 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:43:16.317980 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 630/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:16.323000 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267391a6-6a9e-4349-ab59-2ed804e34315 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:16.404370 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:16.422918 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267391a6-6a9e-4349-ab59-2ed804e34315 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:16.457484 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62397b9-2117-4c2d-8807-5fb459cc927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:16.458166 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62397b9-2117-4c2d-8807-5fb459cc927a None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:16.458443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62397b9-2117-4c2d-8807-5fb459cc927a None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:16.458734 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62397b9-2117-4c2d-8807-5fb459cc927a None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:16.459453 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62397b9-2117-4c2d-8807-5fb459cc927a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:16.459769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62397b9-2117-4c2d-8807-5fb459cc927a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:16.461213 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62397b9-2117-4c2d-8807-5fb459cc927a None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:16.472975 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 636/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:16.478678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786cff5-c826-45e7-ac56-385ae39de6d1 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:16.578547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786cff5-c826-45e7-ac56-385ae39de6d1 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:16.597470 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:16.610833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f2edb-af23-43ad-8972-a0addd8f3a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:16.611629 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f2edb-af23-43ad-8972-a0addd8f3a36 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:16.611911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f2edb-af23-43ad-8972-a0addd8f3a36 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:16.615120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f2edb-af23-43ad-8972-a0addd8f3a36 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:16.624338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f2edb-af23-43ad-8972-a0addd8f3a36 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:16.625820 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f2edb-af23-43ad-8972-a0addd8f3a36 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:16.640262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-9a5f2edb-af23-43ad-8972-a0addd8f3a36 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:43:16.640262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:16.640262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:16.640262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:16.640262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:16.640262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:16.640262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:16.640262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:16.640262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:16.640262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:16.640262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:16.640262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:16.640262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:43:16.640262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:43:16.640262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:43:16.640262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:43:16.641378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:16.641378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:16.641378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:43:16.641378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:43:16.641378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:43:16.641378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:43:16.641378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:16.641378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:16.641378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:16.641378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:16.641378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:16.641378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:16.641378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:16.641378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:16.641378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:16.641378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:16.641378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:16.641378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:16.642491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:16.642491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:16.642491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:43:16.642491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:43:16.642491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:43:16.642491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:43:16.642491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:43:16.642491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:43:16.642491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:43:16.642491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:43:16.642491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 631/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:43:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:16.647312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62397b9-2117-4c2d-8807-5fb459cc927a None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:16.745733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62397b9-2117-4c2d-8807-5fb459cc927a None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:16.779194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7686e-2d00-42cc-9a74-148c3d20b2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:16.779862 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7686e-2d00-42cc-9a74-148c3d20b2f7 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:16.780183 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7686e-2d00-42cc-9a74-148c3d20b2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:16.780598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7686e-2d00-42cc-9a74-148c3d20b2f7 None admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:16.781460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7686e-2d00-42cc-9a74-148c3d20b2f7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:16.781775 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7686e-2d00-42cc-9a74-148c3d20b2f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:16.783241 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7686e-2d00-42cc-9a74-148c3d20b2f7 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:16.791595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:16.800883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 637/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jun 23 10:43:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:16.806471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f2edb-af23-43ad-8972-a0addd8f3a36 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:16.905929 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f2edb-af23-43ad-8972-a0addd8f3a36 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:16.939265 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d9f01-54f3-4cc7-b1c7-5032812dabd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:16.940052 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d9f01-54f3-4cc7-b1c7-5032812dabd0 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:16.940344 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d9f01-54f3-4cc7-b1c7-5032812dabd0 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:16.940626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d9f01-54f3-4cc7-b1c7-5032812dabd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:16.951109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d9f01-54f3-4cc7-b1c7-5032812dabd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:16.952830 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d9f01-54f3-4cc7-b1c7-5032812dabd0 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:16.969656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-ac0d9f01-54f3-4cc7-b1c7-5032812dabd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:16.969656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:16.969656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:16.969656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:16.969656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:16.969656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:16.969656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:16.969656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:16.969656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:16.969656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:16.969656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:16.969656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:16.969656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:43:16.969656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:43:16.969656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:43:16.973287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:43:16.973287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:16.973287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:16.973287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:16.973287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:16.973287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:16.973287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:16.973287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:16.973287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:16.973287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:16.973287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:16.973287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:16.973287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:16.973287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:16.973287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:16.973287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:16.973287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:16.974384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:43:16.974384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:43:16.974384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:16.974384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:43:16.974384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 632/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:16.976662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7686e-2d00-42cc-9a74-148c3d20b2f7 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:17.078419 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7686e-2d00-42cc-9a74-148c3d20b2f7 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:17.112172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a58988-2042-4088-ac74-e2c431331b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:17.112866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a58988-2042-4088-ac74-e2c431331b7f None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:17.113153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a58988-2042-4088-ac74-e2c431331b7f None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:17.113707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a58988-2042-4088-ac74-e2c431331b7f None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:17.114457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a58988-2042-4088-ac74-e2c431331b7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:17.114768 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a58988-2042-4088-ac74-e2c431331b7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:17.116137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a58988-2042-4088-ac74-e2c431331b7f None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:17.127315 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 638/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:17.132985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d9f01-54f3-4cc7-b1c7-5032812dabd0 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:17.164868 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:17.230228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d9f01-54f3-4cc7-b1c7-5032812dabd0 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:17.263619 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52eb55a-b790-4da3-add1-4a4dcfb09ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:17.264402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52eb55a-b790-4da3-add1-4a4dcfb09ddd None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:17.264704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52eb55a-b790-4da3-add1-4a4dcfb09ddd None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:17.265000 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52eb55a-b790-4da3-add1-4a4dcfb09ddd None admin] PATH_INFO: `/v3/projects/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:17.271684 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52eb55a-b790-4da3-add1-4a4dcfb09ddd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:17.273449 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52eb55a-b790-4da3-add1-4a4dcfb09ddd None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:17.288053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-e52eb55a-b790-4da3-add1-4a4dcfb09ddd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:43:17.288053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:17.288053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:17.288053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:17.288053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:17.288053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:17.288053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:17.288053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:17.288053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:17.288053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:17.288053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:17.288053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:17.288053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:43:17.288053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:43:17.288053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:43:17.289063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:43:17.289063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:17.289063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:17.289063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:17.289063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:17.289063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:17.289063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:17.289063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:17.289063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:17.289063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:17.289063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:17.289063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:17.289063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:17.289063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:17.289063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:17.289063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:17.289063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:17.289979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:43:17.289979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:43:17.289979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:43:17.289979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:43:17.289979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:43:17.289979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:43:17.289979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:43:17.289979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:43:17.289979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 633/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:43:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:17.295203 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a58988-2042-4088-ac74-e2c431331b7f None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:17.354194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:17.394377 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a58988-2042-4088-ac74-e2c431331b7f None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:17.428822 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07491257-24ed-4ae9-9750-ae38d4643e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:17.429491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07491257-24ed-4ae9-9750-ae38d4643e7f None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:17.429777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07491257-24ed-4ae9-9750-ae38d4643e7f None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:17.430055 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07491257-24ed-4ae9-9750-ae38d4643e7f None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:17.430844 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07491257-24ed-4ae9-9750-ae38d4643e7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:17.431158 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07491257-24ed-4ae9-9750-ae38d4643e7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:17.432593 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07491257-24ed-4ae9-9750-ae38d4643e7f None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:17.450649 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 639/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:43:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:17.452391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52eb55a-b790-4da3-add1-4a4dcfb09ddd None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:17.543356 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:17.551976 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52eb55a-b790-4da3-add1-4a4dcfb09ddd None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:17.584444 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db32ecf-1a01-433e-9a54-1583213e6cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:17.585345 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db32ecf-1a01-433e-9a54-1583213e6cc8 None admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:17.585636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db32ecf-1a01-433e-9a54-1583213e6cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:17.585918 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db32ecf-1a01-433e-9a54-1583213e6cc8 None admin] PATH_INFO: `/v3/projects/d7a9c82a62044db884e547da9a523927/users/6ff588aaad264f9cbc5a80e73ef0c09d/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:17.587939 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db32ecf-1a01-433e-9a54-1583213e6cc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7a9c82a62044db884e547da9a523927, user_id=6ff588aaad264f9cbc5a80e73ef0c09d, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:17.589403 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db32ecf-1a01-433e-9a54-1583213e6cc8 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:17.663864 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 634/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 23 10:43:17 2022] PUT /identity/v3/projects/d7a9c82a62044db884e547da9a523927/users/6ff588aaad264f9cbc5a80e73ef0c09d/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:43:19.675868 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c813790-6d0f-4b1e-b5dc-ee7fceee014c None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:19.676378 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c813790-6d0f-4b1e-b5dc-ee7fceee014c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:19.676469 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c813790-6d0f-4b1e-b5dc-ee7fceee014c None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:19.677833 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 640/1274] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:19.682991 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64176124-ca6c-4874-8caf-c4e96e993cf0 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:19.683418 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64176124-ca6c-4874-8caf-c4e96e993cf0 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:19.683548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64176124-ca6c-4874-8caf-c4e96e993cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:19.701136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-64176124-ca6c-4874-8caf-c4e96e993cf0 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:19.702948 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-64176124-ca6c-4874-8caf-c4e96e993cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:19.771171 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 635/1275] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:43:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:43:19.796154 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c813790-6d0f-4b1e-b5dc-ee7fceee014c None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:19.895349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c813790-6d0f-4b1e-b5dc-ee7fceee014c None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:19.911697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:19.928561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3a27f-bba1-4805-ab52-75eba3442edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:19.929799 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3a27f-bba1-4805-ab52-75eba3442edf None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:19.929799 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3a27f-bba1-4805-ab52-75eba3442edf None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:19.929992 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3a27f-bba1-4805-ab52-75eba3442edf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:19.940745 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3a27f-bba1-4805-ab52-75eba3442edf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:43:19.948407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-5bb3a27f-bba1-4805-ab52-75eba3442edf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:43:19.948407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:19.948407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:19.948407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:19.948407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:19.948407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:19.948407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:19.948407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:19.948407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:19.948407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:19.948407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:19.948407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:19.948407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:43:19.948407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:43:19.948407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:43:19.948407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:43:19.956580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:43:19.956580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:43:19.956580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:43:19.956580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:43:19.956580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:19.956580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:19.956580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:19.956580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:19.956580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:19.956580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:19.956580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:19.956580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:19.956580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:19.956580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:19.956580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:19.956580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:19.957677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:19.957677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:19.957677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:19.957677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:19.957677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:43:19.957677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:43:19.957677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:43:19.957677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:43:19.957677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:43:19.957677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:43:19.957677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:43:19.957677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:19.957677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 641/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 23 10:43:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:19.958433 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64176124-ca6c-4874-8caf-c4e96e993cf0 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:20.035702 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:20.053457 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64176124-ca6c-4874-8caf-c4e96e993cf0 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:20.087595 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813516f0-abaf-4df5-b49e-e4b636224ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:20.088372 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813516f0-abaf-4df5-b49e-e4b636224ca3 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:20.088678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813516f0-abaf-4df5-b49e-e4b636224ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:20.088959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813516f0-abaf-4df5-b49e-e4b636224ca3 None admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:20.089706 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813516f0-abaf-4df5-b49e-e4b636224ca3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:20.090016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813516f0-abaf-4df5-b49e-e4b636224ca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:20.091378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813516f0-abaf-4df5-b49e-e4b636224ca3 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:20.099687 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 636/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 23 10:43:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:20.105372 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3a27f-bba1-4805-ab52-75eba3442edf None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:20.203647 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3a27f-bba1-4805-ab52-75eba3442edf None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:20.236559 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45548a95-9a5b-4deb-9551-d8b372865a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:20.237420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45548a95-9a5b-4deb-9551-d8b372865a31 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:20.237727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45548a95-9a5b-4deb-9551-d8b372865a31 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:20.237985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45548a95-9a5b-4deb-9551-d8b372865a31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:20.248545 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45548a95-9a5b-4deb-9551-d8b372865a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:20.251966 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45548a95-9a5b-4deb-9551-d8b372865a31 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:20.267004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-45548a95-9a5b-4deb-9551-d8b372865a31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:20.267004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:20.267004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:20.267004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:20.267004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:20.267004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:20.267004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:20.267004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:20.267004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:20.267004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:20.267004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:20.267004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:20.267004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:43:20.267004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:43:20.267004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:43:20.268159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:43:20.268159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:20.268159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:20.268159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:20.268159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:20.268159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:20.268159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:20.268159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:20.268159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:20.268159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:20.268159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:20.268159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:20.268159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:20.268159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:20.268159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:20.268159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:20.268159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:20.269393 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:43:20.269393 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:43:20.269393 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:20.269393 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:20.269393 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 642/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:20.274286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813516f0-abaf-4df5-b49e-e4b636224ca3 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:20.374784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813516f0-abaf-4df5-b49e-e4b636224ca3 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:20.407808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebb143-d5e2-4e0e-b016-9386a5e9d202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:20.408469 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebb143-d5e2-4e0e-b016-9386a5e9d202 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:20.408790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebb143-d5e2-4e0e-b016-9386a5e9d202 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:20.409070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebb143-d5e2-4e0e-b016-9386a5e9d202 None admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:20.409795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebb143-d5e2-4e0e-b016-9386a5e9d202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:20.410107 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebb143-d5e2-4e0e-b016-9386a5e9d202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:20.411464 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebb143-d5e2-4e0e-b016-9386a5e9d202 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:20.423909 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 637/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:20.429817 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45548a95-9a5b-4deb-9551-d8b372865a31 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:20.460376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:20.529236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45548a95-9a5b-4deb-9551-d8b372865a31 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:20.564866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2492b-44db-4ba1-b884-9f5b5219ae55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:20.565689 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2492b-44db-4ba1-b884-9f5b5219ae55 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:20.565972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2492b-44db-4ba1-b884-9f5b5219ae55 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:20.566246 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2492b-44db-4ba1-b884-9f5b5219ae55 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:20.574467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2492b-44db-4ba1-b884-9f5b5219ae55 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:20.575903 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2492b-44db-4ba1-b884-9f5b5219ae55 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:20.590589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-90a2492b-44db-4ba1-b884-9f5b5219ae55 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:43:20.590589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:20.590589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:20.590589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:20.590589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:20.590589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:20.590589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:20.590589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:20.590589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:20.590589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:20.590589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:20.590589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:20.590589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:43:20.590589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:43:20.590589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:43:20.590589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:43:20.591698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:20.591698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:20.591698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:43:20.591698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:43:20.591698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:43:20.591698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:43:20.591698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:20.591698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:20.591698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:20.591698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:20.591698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:20.591698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:20.591698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:20.591698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:20.591698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:20.591698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:20.591698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:20.591698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:20.592883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:20.592883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:20.592883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:43:20.592883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:43:20.592883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:43:20.592883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:43:20.592883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:43:20.592883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:43:20.592883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:43:20.592883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:20.592883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 643/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:43:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:20.598311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebb143-d5e2-4e0e-b016-9386a5e9d202 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:20.602230 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:20.697996 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebb143-d5e2-4e0e-b016-9386a5e9d202 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:20.735175 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a51a6-6c90-4406-bdb8-83309ca6b25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:20.735175 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a51a6-6c90-4406-bdb8-83309ca6b25f None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:20.735175 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a51a6-6c90-4406-bdb8-83309ca6b25f None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:20.735175 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a51a6-6c90-4406-bdb8-83309ca6b25f None admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:20.735739 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a51a6-6c90-4406-bdb8-83309ca6b25f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:20.735739 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a51a6-6c90-4406-bdb8-83309ca6b25f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:20.735739 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a51a6-6c90-4406-bdb8-83309ca6b25f None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:20.751939 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 638/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jun 23 10:43:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:20.758639 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2492b-44db-4ba1-b884-9f5b5219ae55 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:20.848591 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:20.857691 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2492b-44db-4ba1-b884-9f5b5219ae55 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:20.891260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c3bd3-08e3-45f8-8281-6404f05b31ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:20.891937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c3bd3-08e3-45f8-8281-6404f05b31ca None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:20.892223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c3bd3-08e3-45f8-8281-6404f05b31ca None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:20.892501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c3bd3-08e3-45f8-8281-6404f05b31ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:20.957796 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c3bd3-08e3-45f8-8281-6404f05b31ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:20.959252 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c3bd3-08e3-45f8-8281-6404f05b31ca None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:21.044225 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:21.054225 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 644/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 23 10:43:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:43:21.059952 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a51a6-6c90-4406-bdb8-83309ca6b25f None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:21.120611 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:21.160113 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a51a6-6c90-4406-bdb8-83309ca6b25f None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:21.193107 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134605f-9239-4fbe-a010-146ebc605c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:21.193891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134605f-9239-4fbe-a010-146ebc605c59 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:21.194180 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134605f-9239-4fbe-a010-146ebc605c59 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:21.194461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134605f-9239-4fbe-a010-146ebc605c59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:21.205372 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134605f-9239-4fbe-a010-146ebc605c59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:21.206810 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134605f-9239-4fbe-a010-146ebc605c59 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:21.223374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-1134605f-9239-4fbe-a010-146ebc605c59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:21.223374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:21.223374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:21.223374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:21.223374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:21.223374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:21.223374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:21.223374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:21.223374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:21.223374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:21.223374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:21.223374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:21.223374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:43:21.223374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:43:21.223374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:43:21.224463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:43:21.224463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:21.224463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:21.224463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:21.224463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:21.224463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:21.224463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:21.224463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:21.224463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:21.224463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:21.224463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:21.224463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:21.224463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:21.224463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:21.224463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:21.224463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:21.224463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:21.225746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:43:21.225746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:43:21.225746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:43:21.225746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:43:21.225746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 639/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:21.230376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c3bd3-08e3-45f8-8281-6404f05b31ca None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:21.330498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c3bd3-08e3-45f8-8281-6404f05b31ca None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:21.363812 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30784c40-b378-4090-b5c7-6a7221c5d2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:21.364464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30784c40-b378-4090-b5c7-6a7221c5d2e1 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:21.364777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30784c40-b378-4090-b5c7-6a7221c5d2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:21.365064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30784c40-b378-4090-b5c7-6a7221c5d2e1 None admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:21.365783 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30784c40-b378-4090-b5c7-6a7221c5d2e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:21.366100 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30784c40-b378-4090-b5c7-6a7221c5d2e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:21.367474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30784c40-b378-4090-b5c7-6a7221c5d2e1 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:21.378927 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 645/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 23 10:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:21.384535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134605f-9239-4fbe-a010-146ebc605c59 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:21.480643 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134605f-9239-4fbe-a010-146ebc605c59 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:21.494501 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:21.514207 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1939f0-52b6-46f2-8e2c-8f0a185ef369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:21.515013 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1939f0-52b6-46f2-8e2c-8f0a185ef369 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:21.515300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1939f0-52b6-46f2-8e2c-8f0a185ef369 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:21.515579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1939f0-52b6-46f2-8e2c-8f0a185ef369 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:21.522243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1939f0-52b6-46f2-8e2c-8f0a185ef369 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:21.523678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1939f0-52b6-46f2-8e2c-8f0a185ef369 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:21.537539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application [None req-6b1939f0-52b6-46f2-8e2c-8f0a185ef369 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:43:21.537539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:21.537539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:21.537539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:21.537539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:21.537539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:21.537539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:21.537539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:21.537539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:21.537539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:21.537539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:21.537539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:21.537539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:43:21.537539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:43:21.537539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:43:21.538596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:43:21.538596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:21.538596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:21.538596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:21.538596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:21.538596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:21.538596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:21.538596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:21.538596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:21.538596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:21.538596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:21.538596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:21.538596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:21.538596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:21.538596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:21.538596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:21.538596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:21.539700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:43:21.539700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:43:21.539700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:43:21.539700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:43:21.539700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:43:21.539700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:43:21.539700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:43:21.539700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: ERROR keystone.server.flask.application Jun 23 10:43:21.539700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 640/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 23 10:43:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:21.544647 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30784c40-b378-4090-b5c7-6a7221c5d2e1 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:21.595578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:21.644915 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30784c40-b378-4090-b5c7-6a7221c5d2e1 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:21.679823 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2e643-f924-413c-a09d-22c900fa26c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:21.680487 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2e643-f924-413c-a09d-22c900fa26c3 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:21.680804 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2e643-f924-413c-a09d-22c900fa26c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:21.681091 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2e643-f924-413c-a09d-22c900fa26c3 None admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:21.681872 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2e643-f924-413c-a09d-22c900fa26c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:21.682186 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2e643-f924-413c-a09d-22c900fa26c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:21.683635 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2e643-f924-413c-a09d-22c900fa26c3 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:21.695548 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 646/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 23 10:43:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:21.701865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1939f0-52b6-46f2-8e2c-8f0a185ef369 None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:21.801783 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1939f0-52b6-46f2-8e2c-8f0a185ef369 None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:21.835351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d330ee-1861-46fd-ba5b-02871643c963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:21.835987 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d330ee-1861-46fd-ba5b-02871643c963 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:21.836273 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d330ee-1861-46fd-ba5b-02871643c963 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:21.836553 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d330ee-1861-46fd-ba5b-02871643c963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:21.837411 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d330ee-1861-46fd-ba5b-02871643c963 None admin] RBAC: Adding query filter params (role.id=6fc3d1eef0284133bc43fb1e63e842ff, scope.project.id=d7a9c82a62044db884e547da9a523927, user.id=6ff588aaad264f9cbc5a80e73ef0c09d) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:21.837728 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d330ee-1861-46fd-ba5b-02871643c963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:21.839159 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d330ee-1861-46fd-ba5b-02871643c963 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:21.845970 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 641/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 23 10:43:21 2022] GET /identity/v3/role_assignments?user.id=6ff588aaad264f9cbc5a80e73ef0c09d&scope.project.id=d7a9c82a62044db884e547da9a523927&role.id=6fc3d1eef0284133bc43fb1e63e842ff => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:23.880473 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c9b35-cffc-4173-af56-47d4a02ef63b None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:23.881059 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c9b35-cffc-4173-af56-47d4a02ef63b None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:23.881059 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c9b35-cffc-4173-af56-47d4a02ef63b None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:23.882393 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 647/1288] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:23.887686 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae649389-92eb-4bb2-a166-448fa03c87ad None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:23.888077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae649389-92eb-4bb2-a166-448fa03c87ad None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:23.888243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae649389-92eb-4bb2-a166-448fa03c87ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:23.904464 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-ae649389-92eb-4bb2-a166-448fa03c87ad None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:23.906185 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ae649389-92eb-4bb2-a166-448fa03c87ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:23.935365 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:23.971575 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 642/1289] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:43:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:43:23.994698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c9b35-cffc-4173-af56-47d4a02ef63b None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:24.096737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c9b35-cffc-4173-af56-47d4a02ef63b None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:24.108592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:24.131476 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b97e1f-6d92-43d1-a0e0-a2af3f9c63a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:24.132210 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b97e1f-6d92-43d1-a0e0-a2af3f9c63a2 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:24.132496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b97e1f-6d92-43d1-a0e0-a2af3f9c63a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:24.132810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b97e1f-6d92-43d1-a0e0-a2af3f9c63a2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:24.133464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b97e1f-6d92-43d1-a0e0-a2af3f9c63a2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:24.134907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b97e1f-6d92-43d1-a0e0-a2af3f9c63a2 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:24.147220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-80b97e1f-6d92-43d1-a0e0-a2af3f9c63a2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:43:24.147220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:24.147220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:43:24.147220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:43:24.147220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:43:24.147220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:43:24.147220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:43:24.147220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:43:24.147220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:43:24.147220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:24.147220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:43:24.147220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:24.147220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:24.147220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:24.147220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:24.147220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:24.147220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:24.153300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:24.153300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:24.153300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:24.153300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:24.153300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:24.153300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:24.153300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:43:24.153300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:43:24.153300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:43:24.153300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:43:24.153300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:24.153300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:24.153300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:24.153300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:24.153300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:24.153300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:24.154400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:24.154400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:24.154400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:24.154400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:24.154400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:24.154400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:24.154400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:24.154400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:24.154400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:24.154400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:24.154400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:43:24.154400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:43:24.154400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:43:24.154400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:24.154400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 648/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 23 10:43:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:24.155895 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae649389-92eb-4bb2-a166-448fa03c87ad None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:24.252042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae649389-92eb-4bb2-a166-448fa03c87ad None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:24.285914 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6683c6-bacd-487d-87a1-60ee6fd26109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:24.286578 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6683c6-bacd-487d-87a1-60ee6fd26109 None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:24.286863 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6683c6-bacd-487d-87a1-60ee6fd26109 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:24.287142 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6683c6-bacd-487d-87a1-60ee6fd26109 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:24.287848 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6683c6-bacd-487d-87a1-60ee6fd26109 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:24.288158 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6683c6-bacd-487d-87a1-60ee6fd26109 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:24.289658 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6683c6-bacd-487d-87a1-60ee6fd26109 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:24.294530 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 643/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Jun 23 10:43:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:24.300326 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b97e1f-6d92-43d1-a0e0-a2af3f9c63a2 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:24.398029 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b97e1f-6d92-43d1-a0e0-a2af3f9c63a2 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:24.431174 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cc3c0-d1a7-4be1-a60a-84b4d2f7a8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:24.431838 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cc3c0-d1a7-4be1-a60a-84b4d2f7a8f2 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:24.432122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cc3c0-d1a7-4be1-a60a-84b4d2f7a8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:24.432401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cc3c0-d1a7-4be1-a60a-84b4d2f7a8f2 None admin] PATH_INFO: `/v3/services` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:24.433132 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816cc3c0-d1a7-4be1-a60a-84b4d2f7a8f2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:24.433442 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816cc3c0-d1a7-4be1-a60a-84b4d2f7a8f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:24.434842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816cc3c0-d1a7-4be1-a60a-84b4d2f7a8f2 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:24.439446 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 649/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Jun 23 10:43:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:26.452380 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e35f4d-b804-4432-9eee-dc34f61d0e02 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:26.452945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e35f4d-b804-4432-9eee-dc34f61d0e02 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:26.453105 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e35f4d-b804-4432-9eee-dc34f61d0e02 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:26.454478 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 644/1293] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:43:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:26.459684 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a47520-7637-47ca-8c26-eb74b23f2cd3 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:26.460114 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a47520-7637-47ca-8c26-eb74b23f2cd3 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:26.460238 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a47520-7637-47ca-8c26-eb74b23f2cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:26.477380 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-d8a47520-7637-47ca-8c26-eb74b23f2cd3 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:26.479016 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-d8a47520-7637-47ca-8c26-eb74b23f2cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:26.508136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:26.544704 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 650/1294] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:43:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:43:26.574261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e35f4d-b804-4432-9eee-dc34f61d0e02 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:26.606370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:26.678607 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e35f4d-b804-4432-9eee-dc34f61d0e02 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:26.721613 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee754bc3-d61d-4b15-b14d-e98dafec0243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:26.722216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee754bc3-d61d-4b15-b14d-e98dafec0243 None admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:26.726384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee754bc3-d61d-4b15-b14d-e98dafec0243 None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:26.726677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee754bc3-d61d-4b15-b14d-e98dafec0243 None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:26.727402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee754bc3-d61d-4b15-b14d-e98dafec0243 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:26.728795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee754bc3-d61d-4b15-b14d-e98dafec0243 None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:26.830514 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 645/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 23 10:43:26 2022] POST /identity/v3/services => generated 246 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:43:28.887698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c4402-8744-4d7f-bc00-b2551bfff323 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:28.888213 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c4402-8744-4d7f-bc00-b2551bfff323 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:28.888213 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c4402-8744-4d7f-bc00-b2551bfff323 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:28.890047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 651/1296] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:43:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:28.895274 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e285d-ac68-47c6-b142-1f9ef24ac12b None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:28.895665 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e285d-ac68-47c6-b142-1f9ef24ac12b None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:28.895843 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e285d-ac68-47c6-b142-1f9ef24ac12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:28.912828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-fd5e285d-ac68-47c6-b142-1f9ef24ac12b None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:28.914023 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-fd5e285d-ac68-47c6-b142-1f9ef24ac12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:28.985953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 646/1297] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:43:28 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:43:29.009619 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c4402-8744-4d7f-bc00-b2551bfff323 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:29.110007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c4402-8744-4d7f-bc00-b2551bfff323 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:29.143669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89c29d-2649-4332-9c4a-3f7d05893553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:29.144445 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89c29d-2649-4332-9c4a-3f7d05893553 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:29.144762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89c29d-2649-4332-9c4a-3f7d05893553 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:29.145045 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89c29d-2649-4332-9c4a-3f7d05893553 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:29.145697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89c29d-2649-4332-9c4a-3f7d05893553 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:29.147125 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89c29d-2649-4332-9c4a-3f7d05893553 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:29.159390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-da89c29d-2649-4332-9c4a-3f7d05893553 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:43:29.159390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:29.159390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:43:29.159390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:43:29.159390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:43:29.159390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:43:29.159390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:43:29.159390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:43:29.159390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:43:29.159390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:29.159390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:43:29.159390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:29.159390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:29.159390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:29.159390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:29.159390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:29.159390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:29.160719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:29.160719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:29.160719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:29.160719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:29.160719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:29.160719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:29.160719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:43:29.160719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:43:29.160719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:43:29.160719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:43:29.160719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:29.160719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:29.160719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:29.160719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:29.160719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:29.160719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:29.161749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:29.161749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:29.161749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:29.161749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:29.161749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:29.161749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:29.161749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:29.161749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:29.161749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:29.161749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:29.161749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:43:29.161749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:43:29.161749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:43:29.161749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:29.161749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 652/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 23 10:43:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:29.166659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e285d-ac68-47c6-b142-1f9ef24ac12b None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:29.185165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:29.264659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e285d-ac68-47c6-b142-1f9ef24ac12b None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:29.298436 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cd0e0-30c7-49f3-a30d-f7cdb327821e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:29.299116 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cd0e0-30c7-49f3-a30d-f7cdb327821e None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:29.299442 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cd0e0-30c7-49f3-a30d-f7cdb327821e None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:29.299723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cd0e0-30c7-49f3-a30d-f7cdb327821e None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:29.300429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cd0e0-30c7-49f3-a30d-f7cdb327821e None admin] RBAC: Adding query filter params (name=placement) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:29.300772 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cd0e0-30c7-49f3-a30d-f7cdb327821e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:29.302774 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cd0e0-30c7-49f3-a30d-f7cdb327821e None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:29.308132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 647/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Jun 23 10:43:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:29.314266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89c29d-2649-4332-9c4a-3f7d05893553 None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:29.345697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:29.412585 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89c29d-2649-4332-9c4a-3f7d05893553 None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:29.446021 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0b7bf-f24a-44bb-9dcc-ce2bd26e4db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:29.446749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0b7bf-f24a-44bb-9dcc-ce2bd26e4db6 None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:29.447038 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0b7bf-f24a-44bb-9dcc-ce2bd26e4db6 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:29.447318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0b7bf-f24a-44bb-9dcc-ce2bd26e4db6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:29.448142 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0b7bf-f24a-44bb-9dcc-ce2bd26e4db6 None admin] RBAC: Adding query filter params (interface=public, service_id=cf20a4543c7849668cede35d26a7a8af, region_id=RegionOne) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:29.448460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0b7bf-f24a-44bb-9dcc-ce2bd26e4db6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:29.449866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0b7bf-f24a-44bb-9dcc-ce2bd26e4db6 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:29.455918 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 653/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jun 23 10:43:29 2022] GET /identity/v3/endpoints?service_id=cf20a4543c7849668cede35d26a7a8af&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:29.461566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cd0e0-30c7-49f3-a30d-f7cdb327821e None admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:29.542562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:29.559700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cd0e0-30c7-49f3-a30d-f7cdb327821e None admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:29.594018 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624460f4-931d-4bfc-9130-03288caf9cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:29.594750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624460f4-931d-4bfc-9130-03288caf9cea None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:29.595017 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624460f4-931d-4bfc-9130-03288caf9cea None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:29.595297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624460f4-931d-4bfc-9130-03288caf9cea None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:29.595975 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624460f4-931d-4bfc-9130-03288caf9cea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:29.597364 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624460f4-931d-4bfc-9130-03288caf9cea None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:29.603988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 648/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jun 23 10:43:29 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:43:31.630386 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b2e0d-cdc6-44a1-8860-e152eebdef51 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:31.630858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b2e0d-cdc6-44a1-8860-e152eebdef51 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:31.631033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b2e0d-cdc6-44a1-8860-e152eebdef51 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:31.632405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 654/1302] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:31.637661 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff60a8-7a6c-40c1-83bb-b7c5a9b57362 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:31.638076 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff60a8-7a6c-40c1-83bb-b7c5a9b57362 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:31.638224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff60a8-7a6c-40c1-83bb-b7c5a9b57362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:31.655286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-81ff60a8-7a6c-40c1-83bb-b7c5a9b57362 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:31.656462 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-81ff60a8-7a6c-40c1-83bb-b7c5a9b57362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:31.720517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 649/1303] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:43:31 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:43:31.744210 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b2e0d-cdc6-44a1-8860-e152eebdef51 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:31.838212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:31.844941 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b2e0d-cdc6-44a1-8860-e152eebdef51 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:31.877868 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9751f97-054f-4da6-80fa-0708f1dedbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:31.878593 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9751f97-054f-4da6-80fa-0708f1dedbbd None admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:31.878873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9751f97-054f-4da6-80fa-0708f1dedbbd None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:31.879147 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9751f97-054f-4da6-80fa-0708f1dedbbd None admin] PATH_INFO: `/v3/services/placement` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:31.879793 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9751f97-054f-4da6-80fa-0708f1dedbbd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:31.881303 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9751f97-054f-4da6-80fa-0708f1dedbbd None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:31.893436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application [None req-a9751f97-054f-4da6-80fa-0708f1dedbbd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:43:31.893436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:31.893436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:43:31.893436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:43:31.893436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:43:31.893436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:43:31.893436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:43:31.893436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:43:31.893436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:43:31.893436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:31.893436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:43:31.893436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:31.893436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:43:31.893436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:43:31.893436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:43:31.893436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:43:31.893436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:43:31.894727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:43:31.894727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:43:31.894727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:43:31.894727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:43:31.894727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:43:31.894727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:43:31.894727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:43:31.894727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:43:31.894727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:43:31.894727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:43:31.894727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:43:31.894727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:43:31.894727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:43:31.894727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:43:31.894727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:43:31.894727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:43:31.895778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:43:31.895778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application with Lock( Jun 23 10:43:31.895778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:43:31.895778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:43:31.895778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:43:31.895778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:43:31.895778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:43:31.895778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:43:31.895778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:43:31.895778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:43:31.895778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:43:31.895778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:43:31.895778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:43:31.895778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: ERROR keystone.server.flask.application Jun 23 10:43:31.895778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 655/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 23 10:43:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:43:31.902954 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff60a8-7a6c-40c1-83bb-b7c5a9b57362 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:31.977562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:32.000527 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff60a8-7a6c-40c1-83bb-b7c5a9b57362 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:32.033242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6547d-3254-42d2-bf16-df63888aca8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:32.034020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6547d-3254-42d2-bf16-df63888aca8e None admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:32.034301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6547d-3254-42d2-bf16-df63888aca8e None admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:32.034577 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6547d-3254-42d2-bf16-df63888aca8e None admin] PATH_INFO: `/v3/services` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:32.035275 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc6547d-3254-42d2-bf16-df63888aca8e None admin] RBAC: Adding query filter params (name=placement) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:43:32.035582 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc6547d-3254-42d2-bf16-df63888aca8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:32.036981 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc6547d-3254-42d2-bf16-df63888aca8e None admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:32.041947 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 650/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Jun 23 10:43:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:43:32.048395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9751f97-054f-4da6-80fa-0708f1dedbbd None admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:32.150335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9751f97-054f-4da6-80fa-0708f1dedbbd None admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:32.183211 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ed8d7-0eed-454b-8c45-e9b4ad4e7ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:32.183868 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ed8d7-0eed-454b-8c45-e9b4ad4e7ef1 None admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:32.184152 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ed8d7-0eed-454b-8c45-e9b4ad4e7ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:32.184429 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ed8d7-0eed-454b-8c45-e9b4ad4e7ef1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:32.185204 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ed8d7-0eed-454b-8c45-e9b4ad4e7ef1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:32.186589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ed8d7-0eed-454b-8c45-e9b4ad4e7ef1 None admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:32.274934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 656/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jun 23 10:43:32 2022] POST /identity/v3/endpoints => generated 331 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:43:42.039011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=30 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:42.270322 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:32.874274 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4ac08-36ad-4635-9c9b-badea7025fc8 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:32.875165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4ac08-36ad-4635-9c9b-badea7025fc8 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:32.875619 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4ac08-36ad-4635-9c9b-badea7025fc8 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:32.883485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76bbf5-051c-498b-822f-3f87eaa4b4b8 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:32.889028 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76bbf5-051c-498b-822f-3f87eaa4b4b8 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:32.889028 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76bbf5-051c-498b-822f-3f87eaa4b4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:32.889666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 651/1307] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:49:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:33.046405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-3e76bbf5-051c-498b-822f-3f87eaa4b4b8 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:33.049826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-3e76bbf5-051c-498b-822f-3f87eaa4b4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:33.220661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 657/1308] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:49:33.269170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41304e-6fc9-46dc-b538-1d4330e86d55 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:33.269708 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41304e-6fc9-46dc-b538-1d4330e86d55 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:33.270182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41304e-6fc9-46dc-b538-1d4330e86d55 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:33.272270 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 652/1309] 10.222.0.20 () {54 vars in 964 bytes} [Thu Jun 23 10:49:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:33.279405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefe584-3b11-40ce-aa31-f10ab3fb9c01 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:33.279697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefe584-3b11-40ce-aa31-f10ab3fb9c01 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:33.279983 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefe584-3b11-40ce-aa31-f10ab3fb9c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:33.404081 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-5cefe584-3b11-40ce-aa31-f10ab3fb9c01 None None] MFA Rules not processed for user `0348261a78984c62aced60af2768688e`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:33.405607 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-5cefe584-3b11-40ce-aa31-f10ab3fb9c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:33.430554 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:33.490922 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 658/1310] 10.222.0.20 () {58 vars in 1061 bytes} [Thu Jun 23 10:49:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:33.500762 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41304e-6fc9-46dc-b538-1d4330e86d55 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:33.502712 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-4c41304e-6fc9-46dc-b538-1d4330e86d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:33.648231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41304e-6fc9-46dc-b538-1d4330e86d55 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:33.744079 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b03c7e-364d-416a-bae9-951d22cf5756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:33.744897 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b03c7e-364d-416a-bae9-951d22cf5756 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:33.745299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b03c7e-364d-416a-bae9-951d22cf5756 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:33.745694 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b03c7e-364d-416a-bae9-951d22cf5756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:33.747937 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c0b03c7e-364d-416a-bae9-951d22cf5756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:33.813135 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:33.877901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b03c7e-364d-416a-bae9-951d22cf5756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:33.880366 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b03c7e-364d-416a-bae9-951d22cf5756 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:33.901657 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 653/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:36.241350 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32d27e-8e82-432e-b109-07570322d60e None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:36.241887 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32d27e-8e82-432e-b109-07570322d60e None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:36.241977 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32d27e-8e82-432e-b109-07570322d60e None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:36.243775 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 659/1312] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:36.248995 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90fb66-edb4-4e62-9235-42f7199ed9ea None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:36.249411 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90fb66-edb4-4e62-9235-42f7199ed9ea None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:36.249550 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90fb66-edb4-4e62-9235-42f7199ed9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:36.333171 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-2b90fb66-edb4-4e62-9235-42f7199ed9ea None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:36.335409 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-2b90fb66-edb4-4e62-9235-42f7199ed9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:36.436171 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 654/1313] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:36.476273 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32d27e-8e82-432e-b109-07570322d60e None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:36.477897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-6b32d27e-8e82-432e-b109-07570322d60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:36.590922 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32d27e-8e82-432e-b109-07570322d60e None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:36.668048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:36.670571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380de85-22d4-425c-85f9-3947cdf0a526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:36.671229 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380de85-22d4-425c-85f9-3947cdf0a526 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:36.671518 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380de85-22d4-425c-85f9-3947cdf0a526 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:36.671800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380de85-22d4-425c-85f9-3947cdf0a526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:36.673491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8380de85-22d4-425c-85f9-3947cdf0a526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:36.783654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380de85-22d4-425c-85f9-3947cdf0a526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:36.785141 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380de85-22d4-425c-85f9-3947cdf0a526 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:36.803146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 660/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:39.289441 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc4d09-fc92-4eb0-8a0b-5b86beece399 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:39.289972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc4d09-fc92-4eb0-8a0b-5b86beece399 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:39.289972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc4d09-fc92-4eb0-8a0b-5b86beece399 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:39.291365 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 655/1315] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:39.296578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5002bd-0be5-4f40-8c9c-bd21cbeea25a None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:39.296995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5002bd-0be5-4f40-8c9c-bd21cbeea25a None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:39.297176 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5002bd-0be5-4f40-8c9c-bd21cbeea25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:39.360535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-2f5002bd-0be5-4f40-8c9c-bd21cbeea25a None None] MFA Rules not processed for user `58555002ddb548cb941a3a670b187b25`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:39.361755 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-2f5002bd-0be5-4f40-8c9c-bd21cbeea25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:39.412817 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:39.456814 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 661/1316] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:39 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:39.497081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc4d09-fc92-4eb0-8a0b-5b86beece399 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:39.498615 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-84dc4d09-fc92-4eb0-8a0b-5b86beece399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:39.508436 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:39.600674 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc4d09-fc92-4eb0-8a0b-5b86beece399 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:39.672460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed29b4-a8b5-4564-a3b0-ca4ad4be6eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:39.673139 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed29b4-a8b5-4564-a3b0-ca4ad4be6eaf service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:39.673423 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed29b4-a8b5-4564-a3b0-ca4ad4be6eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:39.673699 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed29b4-a8b5-4564-a3b0-ca4ad4be6eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:39.675330 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e1ed29b4-a8b5-4564-a3b0-ca4ad4be6eaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:39.734767 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:39.779868 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed29b4-a8b5-4564-a3b0-ca4ad4be6eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:39.781320 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed29b4-a8b5-4564-a3b0-ca4ad4be6eaf service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:39.800286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 656/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:39 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:42.543022 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01612a92-e33e-4c5c-8cd6-320b3b3f89f6 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:42.543578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01612a92-e33e-4c5c-8cd6-320b3b3f89f6 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:42.543578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01612a92-e33e-4c5c-8cd6-320b3b3f89f6 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:42.545006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 662/1318] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:42.550053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9abfd9-21a6-4ae5-ad3d-d3373c2ead33 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:42.550430 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9abfd9-21a6-4ae5-ad3d-d3373c2ead33 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:42.550623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9abfd9-21a6-4ae5-ad3d-d3373c2ead33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:42.614663 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-af9abfd9-21a6-4ae5-ad3d-d3373c2ead33 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:42.615953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-af9abfd9-21a6-4ae5-ad3d-d3373c2ead33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:42.715001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 657/1319] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:42.753830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01612a92-e33e-4c5c-8cd6-320b3b3f89f6 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:42.755421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-01612a92-e33e-4c5c-8cd6-320b3b3f89f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:42.856530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01612a92-e33e-4c5c-8cd6-320b3b3f89f6 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:42.927886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76307f38-3b50-4984-83f1-e7eeb7e00ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:42.928536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76307f38-3b50-4984-83f1-e7eeb7e00ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:42.928849 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76307f38-3b50-4984-83f1-e7eeb7e00ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:42.929194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76307f38-3b50-4984-83f1-e7eeb7e00ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:42.930835 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-76307f38-3b50-4984-83f1-e7eeb7e00ac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:42.939106 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:43.038468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76307f38-3b50-4984-83f1-e7eeb7e00ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:43.039888 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76307f38-3b50-4984-83f1-e7eeb7e00ac8 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:43.057372 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 663/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:46.084950 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230d096-a78c-4324-a301-db0e1b6ef8e6 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:46.085503 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230d096-a78c-4324-a301-db0e1b6ef8e6 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:46.085503 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230d096-a78c-4324-a301-db0e1b6ef8e6 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:46.086807 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 658/1321] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:46.092218 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d5aa6-05a6-4440-9ab9-e1527a695ff0 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:46.092668 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d5aa6-05a6-4440-9ab9-e1527a695ff0 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:46.092942 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d5aa6-05a6-4440-9ab9-e1527a695ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:46.157791 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-851d5aa6-05a6-4440-9ab9-e1527a695ff0 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:46.159012 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-851d5aa6-05a6-4440-9ab9-e1527a695ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:46.217394 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:46.255515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 664/1322] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:46.292158 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230d096-a78c-4324-a301-db0e1b6ef8e6 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:46.293747 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-2230d096-a78c-4324-a301-db0e1b6ef8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:46.312924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:46.406757 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230d096-a78c-4324-a301-db0e1b6ef8e6 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:46.486428 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59324653-afa2-472e-982b-3aa0f14b6d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:46.487089 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59324653-afa2-472e-982b-3aa0f14b6d71 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:46.487372 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59324653-afa2-472e-982b-3aa0f14b6d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:46.487648 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59324653-afa2-472e-982b-3aa0f14b6d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:46.489378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-59324653-afa2-472e-982b-3aa0f14b6d71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:46.567523 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:46.606336 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59324653-afa2-472e-982b-3aa0f14b6d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:46.607771 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59324653-afa2-472e-982b-3aa0f14b6d71 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:46.627283 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 659/1323] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:48.721134 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1ce20-d4b5-43e5-bed4-fde50c5080fd None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:48.721708 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1ce20-d4b5-43e5-bed4-fde50c5080fd None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:48.721708 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1ce20-d4b5-43e5-bed4-fde50c5080fd None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:48.723076 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 665/1324] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:48.728961 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ec234-548e-403e-9d76-db11fa4a523e None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:48.729382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ec234-548e-403e-9d76-db11fa4a523e None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:48.729530 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ec234-548e-403e-9d76-db11fa4a523e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:48.794337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-b44ec234-548e-403e-9d76-db11fa4a523e None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:48.795528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b44ec234-548e-403e-9d76-db11fa4a523e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:48.892688 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 660/1325] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:48.929197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1ce20-d4b5-43e5-bed4-fde50c5080fd None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:48.930744 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-89f1ce20-d4b5-43e5-bed4-fde50c5080fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.036447 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1ce20-d4b5-43e5-bed4-fde50c5080fd None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:49.109962 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf80f7-eb07-4bda-bd59-cf0a03e720a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:49.110621 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf80f7-eb07-4bda-bd59-cf0a03e720a5 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.110916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf80f7-eb07-4bda-bd59-cf0a03e720a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.111196 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf80f7-eb07-4bda-bd59-cf0a03e720a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.112874 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a3bf80f7-eb07-4bda-bd59-cf0a03e720a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.129857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:49.225733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf80f7-eb07-4bda-bd59-cf0a03e720a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:49.227182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf80f7-eb07-4bda-bd59-cf0a03e720a5 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:49.246057 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 666/1326] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:51.304263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c3707-f5ad-4726-8161-60245c1e2f51 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.304781 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c3707-f5ad-4726-8161-60245c1e2f51 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.304875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c3707-f5ad-4726-8161-60245c1e2f51 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.306212 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 661/1327] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:49:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:49:51.311735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd8c59-0f36-4dcb-8d94-cf5433616639 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.312210 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd8c59-0f36-4dcb-8d94-cf5433616639 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.312310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd8c59-0f36-4dcb-8d94-cf5433616639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.379982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-5ffd8c59-0f36-4dcb-8d94-cf5433616639 None None] MFA Rules not processed for user `58555002ddb548cb941a3a670b187b25`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:51.381483 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-5ffd8c59-0f36-4dcb-8d94-cf5433616639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:51.445717 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.476720 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 667/1328] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:51 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:51.514610 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c3707-f5ad-4726-8161-60245c1e2f51 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:51.516137 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-f72c3707-f5ad-4726-8161-60245c1e2f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:51.547177 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.624794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c3707-f5ad-4726-8161-60245c1e2f51 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.702442 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6db74-9a53-4140-984b-bd3dc00ba5e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.703097 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6db74-9a53-4140-984b-bd3dc00ba5e4 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.703393 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6db74-9a53-4140-984b-bd3dc00ba5e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.703661 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6db74-9a53-4140-984b-bd3dc00ba5e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.705363 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-eea6db74-9a53-4140-984b-bd3dc00ba5e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:51.782829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.814223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6db74-9a53-4140-984b-bd3dc00ba5e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.815659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6db74-9a53-4140-984b-bd3dc00ba5e4 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.833415 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 662/1329] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:51 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:54.331712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d7911-2719-42b5-ae79-7389929b83be None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:54.332309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d7911-2719-42b5-ae79-7389929b83be None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:54.332309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d7911-2719-42b5-ae79-7389929b83be None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:54.333847 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 668/1330] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:54.338908 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690213c5-59a3-47a5-8806-240dccfa4215 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:54.339299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690213c5-59a3-47a5-8806-240dccfa4215 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:54.339476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690213c5-59a3-47a5-8806-240dccfa4215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:54.403703 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-690213c5-59a3-47a5-8806-240dccfa4215 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:54.404931 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-690213c5-59a3-47a5-8806-240dccfa4215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:54.500333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 663/1331] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:54.535749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d7911-2719-42b5-ae79-7389929b83be None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:54.537860 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-847d7911-2719-42b5-ae79-7389929b83be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:54.640454 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d7911-2719-42b5-ae79-7389929b83be None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:54.711629 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe39e20-3962-4c41-8c1b-102f93b5db7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:54.712269 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe39e20-3962-4c41-8c1b-102f93b5db7a service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:54.712552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe39e20-3962-4c41-8c1b-102f93b5db7a service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:54.712857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe39e20-3962-4c41-8c1b-102f93b5db7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:54.714474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ffe39e20-3962-4c41-8c1b-102f93b5db7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:54.740753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:54.822884 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe39e20-3962-4c41-8c1b-102f93b5db7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:54.824321 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe39e20-3962-4c41-8c1b-102f93b5db7a service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:54.842790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 669/1332] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:56.924721 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d727a-3877-4c5a-95ab-c7d5f225b10b None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.925260 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d727a-3877-4c5a-95ab-c7d5f225b10b None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.925260 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d727a-3877-4c5a-95ab-c7d5f225b10b None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.926581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 664/1333] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:56.932276 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302bcaa-18fc-42be-b7f6-792b0caaf3a9 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.932676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302bcaa-18fc-42be-b7f6-792b0caaf3a9 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.932873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302bcaa-18fc-42be-b7f6-792b0caaf3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.997103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-7302bcaa-18fc-42be-b7f6-792b0caaf3a9 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:56.998296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-7302bcaa-18fc-42be-b7f6-792b0caaf3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:57.071973 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:57.093482 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 670/1334] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:57.134451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d727a-3877-4c5a-95ab-c7d5f225b10b None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:57.135995 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-df5d727a-3877-4c5a-95ab-c7d5f225b10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:57.174855 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:57.237684 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d727a-3877-4c5a-95ab-c7d5f225b10b None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:57.308605 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0895f4f-8b94-4306-9b21-af4be87c0300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:57.309292 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0895f4f-8b94-4306-9b21-af4be87c0300 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:57.309574 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0895f4f-8b94-4306-9b21-af4be87c0300 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:57.309847 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0895f4f-8b94-4306-9b21-af4be87c0300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:57.311475 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d0895f4f-8b94-4306-9b21-af4be87c0300 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:57.391811 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:57.417227 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0895f4f-8b94-4306-9b21-af4be87c0300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:57.418659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0895f4f-8b94-4306-9b21-af4be87c0300 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:57.436762 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 665/1335] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:00.067224 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe624f-cd44-42b7-82e9-ab96acddf733 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:00.068368 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe624f-cd44-42b7-82e9-ab96acddf733 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:00.068697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe624f-cd44-42b7-82e9-ab96acddf733 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:00.070117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 671/1336] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:00.075360 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51300a50-e890-4b76-8d2c-d9fc022238f9 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:00.075795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51300a50-e890-4b76-8d2c-d9fc022238f9 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:00.075948 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51300a50-e890-4b76-8d2c-d9fc022238f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:00.140952 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-51300a50-e890-4b76-8d2c-d9fc022238f9 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:00.142156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-51300a50-e890-4b76-8d2c-d9fc022238f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:00.236968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 666/1337] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:00.273292 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe624f-cd44-42b7-82e9-ab96acddf733 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:00.274842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-05fe624f-cd44-42b7-82e9-ab96acddf733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:00.376071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe624f-cd44-42b7-82e9-ab96acddf733 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:00.445951 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ec052-c2dd-45f8-b2a9-f579e84fb7d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:00.446594 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ec052-c2dd-45f8-b2a9-f579e84fb7d4 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:00.446872 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ec052-c2dd-45f8-b2a9-f579e84fb7d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:00.447147 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ec052-c2dd-45f8-b2a9-f579e84fb7d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:00.448782 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8e4ec052-c2dd-45f8-b2a9-f579e84fb7d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:00.484025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:00.555691 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ec052-c2dd-45f8-b2a9-f579e84fb7d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:00.557157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ec052-c2dd-45f8-b2a9-f579e84fb7d4 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:00.574979 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 672/1338] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:04.673672 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dccdb-c691-4492-973b-bcee589ac8eb None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.674166 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dccdb-c691-4492-973b-bcee589ac8eb None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.674263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dccdb-c691-4492-973b-bcee589ac8eb None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.675677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 667/1339] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:50:04.681652 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9530dc-42ed-420d-919e-23eae5ef1ae9 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.682084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9530dc-42ed-420d-919e-23eae5ef1ae9 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.682244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9530dc-42ed-420d-919e-23eae5ef1ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.764170 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-3d9530dc-42ed-420d-919e-23eae5ef1ae9 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:04.765549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-3d9530dc-42ed-420d-919e-23eae5ef1ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:04.862579 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:04.879181 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 673/1340] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:50:04.918505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dccdb-c691-4492-973b-bcee589ac8eb None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:04.920684 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e82dccdb-c691-4492-973b-bcee589ac8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:04.971169 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:05.017562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dccdb-c691-4492-973b-bcee589ac8eb None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:05.021077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826bae8-e89f-4228-b888-a4641bcb7c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:05.021727 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826bae8-e89f-4228-b888-a4641bcb7c49 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:05.022012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826bae8-e89f-4228-b888-a4641bcb7c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:05.022905 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826bae8-e89f-4228-b888-a4641bcb7c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:05.032359 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826bae8-e89f-4228-b888-a4641bcb7c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:05.060187 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826bae8-e89f-4228-b888-a4641bcb7c49 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:05.060187 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 668/1341] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:08.060707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffabbe-f690-475b-b9d3-d04500fea31a None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.061254 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffabbe-f690-475b-b9d3-d04500fea31a None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.061254 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffabbe-f690-475b-b9d3-d04500fea31a None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.062620 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 674/1342] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:08.068658 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73705e3f-d7fd-4295-b520-965bbecce424 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.069184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73705e3f-d7fd-4295-b520-965bbecce424 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.069319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73705e3f-d7fd-4295-b520-965bbecce424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.098426 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-73705e3f-d7fd-4295-b520-965bbecce424 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:08.099653 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-73705e3f-d7fd-4295-b520-965bbecce424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:08.180986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 669/1343] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:08.233487 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dec195-dd2b-4260-9fa8-acfebd082ce8 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.233780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dec195-dd2b-4260-9fa8-acfebd082ce8 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.234064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dec195-dd2b-4260-9fa8-acfebd082ce8 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.235457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 675/1344] 10.222.0.20 () {54 vars in 964 bytes} [Thu Jun 23 10:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:08.241764 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3e9ff-c2a4-432a-8e25-cdf6e951e6f1 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.242113 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3e9ff-c2a4-432a-8e25-cdf6e951e6f1 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.242422 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3e9ff-c2a4-432a-8e25-cdf6e951e6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.299297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-1ee3e9ff-c2a4-432a-8e25-cdf6e951e6f1 None None] MFA Rules not processed for user `0348261a78984c62aced60af2768688e`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:08.300494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-1ee3e9ff-c2a4-432a-8e25-cdf6e951e6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:08.306893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 670/1345] 10.222.0.20 () {58 vars in 1061 bytes} [Thu Jun 23 10:50:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:08.316191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dec195-dd2b-4260-9fa8-acfebd082ce8 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:08.327288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dec195-dd2b-4260-9fa8-acfebd082ce8 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:08.330821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab2971-2b25-48f5-981d-70c5f7ca6ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:08.331458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab2971-2b25-48f5-981d-70c5f7ca6ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.331742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab2971-2b25-48f5-981d-70c5f7ca6ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.332019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab2971-2b25-48f5-981d-70c5f7ca6ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.341349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab2971-2b25-48f5-981d-70c5f7ca6ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:08.342778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab2971-2b25-48f5-981d-70c5f7ca6ca4 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:08.352624 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 676/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:13.315713 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cbbb1-e4ca-486a-b47a-e7a4d5b9227b None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.316178 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cbbb1-e4ca-486a-b47a-e7a4d5b9227b None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.316272 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cbbb1-e4ca-486a-b47a-e7a4d5b9227b None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.317679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 671/1347] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:13.323179 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e544964-925a-492d-b6a4-be19a21dc476 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.323625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e544964-925a-492d-b6a4-be19a21dc476 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.323753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e544964-925a-492d-b6a4-be19a21dc476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.342145 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-1e544964-925a-492d-b6a4-be19a21dc476 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:13.343359 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-1e544964-925a-492d-b6a4-be19a21dc476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:13.351818 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 677/1348] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:13.389777 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cbbb1-e4ca-486a-b47a-e7a4d5b9227b None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:13.401542 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cbbb1-e4ca-486a-b47a-e7a4d5b9227b None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:13.405288 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b1028-6c84-45f5-b3c2-e5fa80476f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:13.405934 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b1028-6c84-45f5-b3c2-e5fa80476f89 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.406218 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b1028-6c84-45f5-b3c2-e5fa80476f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.406496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b1028-6c84-45f5-b3c2-e5fa80476f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.416415 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b1028-6c84-45f5-b3c2-e5fa80476f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:13.417896 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b1028-6c84-45f5-b3c2-e5fa80476f89 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:13.427462 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 672/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:50:18.367189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313f4a4-b5a2-48a8-ab54-2e0066e6525a None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:18.367748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313f4a4-b5a2-48a8-ab54-2e0066e6525a None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:18.367748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313f4a4-b5a2-48a8-ab54-2e0066e6525a None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:18.369568 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 678/1350] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jun 23 10:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:18.374632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a2a0f-4eb4-4782-877e-45696369c7ed None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:18.375412 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a2a0f-4eb4-4782-877e-45696369c7ed None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:18.375846 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a2a0f-4eb4-4782-877e-45696369c7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:18.437090 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-579a2a0f-4eb4-4782-877e-45696369c7ed None None] MFA Rules not processed for user `6ff588aaad264f9cbc5a80e73ef0c09d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:18.438774 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-579a2a0f-4eb4-4782-877e-45696369c7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:18.445282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:18.576196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 673/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jun 23 10:50:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:22.817837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32b8de-174d-4072-be5a-fd6d082062ec None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:22.818453 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32b8de-174d-4072-be5a-fd6d082062ec None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:22.818826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32b8de-174d-4072-be5a-fd6d082062ec None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:22.820205 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 679/1352] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jun 23 10:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:22.825197 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6282ff9-6386-4665-97bc-a4ccddceb57e None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:22.825609 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6282ff9-6386-4665-97bc-a4ccddceb57e None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:22.825866 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6282ff9-6386-4665-97bc-a4ccddceb57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:22.843935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-c6282ff9-6386-4665-97bc-a4ccddceb57e None None] MFA Rules not processed for user `6ff588aaad264f9cbc5a80e73ef0c09d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:22.845184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c6282ff9-6386-4665-97bc-a4ccddceb57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:22.856542 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 674/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jun 23 10:50:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:23.337402 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=13 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:24.412333 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f12ee-bc55-40b1-b2ad-1bdf3d0d4009 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:24.413110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f12ee-bc55-40b1-b2ad-1bdf3d0d4009 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:24.413110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f12ee-bc55-40b1-b2ad-1bdf3d0d4009 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:24.414283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 680/1354] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jun 23 10:50:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:24.419438 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d80d7-0ae4-4d10-822a-256eb101e0d5 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:24.419825 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d80d7-0ae4-4d10-822a-256eb101e0d5 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:24.420143 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d80d7-0ae4-4d10-822a-256eb101e0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:24.439678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-d43d80d7-0ae4-4d10-822a-256eb101e0d5 None None] MFA Rules not processed for user `6ff588aaad264f9cbc5a80e73ef0c09d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:24.441730 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d43d80d7-0ae4-4d10-822a-256eb101e0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:24.451047 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 675/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jun 23 10:50:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:28.163671 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180319f-e7c6-44e3-9078-90b404e751f1 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:28.164205 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180319f-e7c6-44e3-9078-90b404e751f1 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:28.164711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180319f-e7c6-44e3-9078-90b404e751f1 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:28.167261 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 681/1356] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:50:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:28.172540 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779944d-5d08-4a38-8955-85cd95e479f2 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:28.173047 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779944d-5d08-4a38-8955-85cd95e479f2 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:28.173139 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779944d-5d08-4a38-8955-85cd95e479f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:28.191808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-c779944d-5d08-4a38-8955-85cd95e479f2 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:28.193068 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c779944d-5d08-4a38-8955-85cd95e479f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:28.201325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 676/1357] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:28.255886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64d283-957f-438e-af95-6b6b81bbbc2d None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:28.256252 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64d283-957f-438e-af95-6b6b81bbbc2d None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:28.256599 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64d283-957f-438e-af95-6b6b81bbbc2d None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:28.258687 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 682/1358] 10.222.0.20 () {54 vars in 961 bytes} [Thu Jun 23 10:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:28.271993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92b754-8617-4055-95c0-a8aaf69dac5e None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:28.272995 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92b754-8617-4055-95c0-a8aaf69dac5e None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:28.273592 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92b754-8617-4055-95c0-a8aaf69dac5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:28.327188 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-dc92b754-8617-4055-95c0-a8aaf69dac5e None None] MFA Rules not processed for user `39840f048d254831bdb963b38520f706`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:28.328486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-dc92b754-8617-4055-95c0-a8aaf69dac5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:28.420501 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 677/1359] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Jun 23 10:50:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:28.428292 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64d283-957f-438e-af95-6b6b81bbbc2d None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:28.445251 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64d283-957f-438e-af95-6b6b81bbbc2d None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:28.451454 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf4e2f-50d4-4cee-87c2-9c41a5918f4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:28.452331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf4e2f-50d4-4cee-87c2-9c41a5918f4a service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:28.452866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf4e2f-50d4-4cee-87c2-9c41a5918f4a service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:28.453415 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf4e2f-50d4-4cee-87c2-9c41a5918f4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:28.463853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf4e2f-50d4-4cee-87c2-9c41a5918f4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:28.465605 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf4e2f-50d4-4cee-87c2-9c41a5918f4a service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:28.476411 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 683/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:30.781409 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8ee28-9440-4946-976d-f7b9028f8996 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:30.781956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8ee28-9440-4946-976d-f7b9028f8996 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:30.781956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8ee28-9440-4946-976d-f7b9028f8996 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:30.783312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 678/1361] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:30.789227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06073b52-2f14-4c21-9162-7b4fc4f8fc43 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:30.795079 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06073b52-2f14-4c21-9162-7b4fc4f8fc43 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:30.795079 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06073b52-2f14-4c21-9162-7b4fc4f8fc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:30.807669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-06073b52-2f14-4c21-9162-7b4fc4f8fc43 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:30.808886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-06073b52-2f14-4c21-9162-7b4fc4f8fc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:30.816599 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 684/1362] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:30.864419 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8ee28-9440-4946-976d-f7b9028f8996 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:30.881251 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8ee28-9440-4946-976d-f7b9028f8996 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:30.886605 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd1e51-e6c4-480a-ac26-6eeaaef7d776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:30.887256 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd1e51-e6c4-480a-ac26-6eeaaef7d776 service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:30.887542 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd1e51-e6c4-480a-ac26-6eeaaef7d776 service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:30.887821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd1e51-e6c4-480a-ac26-6eeaaef7d776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:30.898109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd1e51-e6c4-480a-ac26-6eeaaef7d776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:30.899764 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd1e51-e6c4-480a-ac26-6eeaaef7d776 service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:30.911236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 679/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:33.444364 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d06ad-0913-4c38-acb9-8a3488d44406 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:33.444957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d06ad-0913-4c38-acb9-8a3488d44406 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:33.445093 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d06ad-0913-4c38-acb9-8a3488d44406 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:33.446479 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 685/1364] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:33.452602 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd1965-7374-45d1-af56-17d96b237150 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:33.454366 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd1965-7374-45d1-af56-17d96b237150 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:33.454366 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd1965-7374-45d1-af56-17d96b237150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:33.472446 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-64dd1965-7374-45d1-af56-17d96b237150 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:33.473689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-64dd1965-7374-45d1-af56-17d96b237150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:33.481624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 680/1365] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:50:33.527941 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea4772-a1f3-412a-8490-51a0df77154b None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:33.528331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea4772-a1f3-412a-8490-51a0df77154b None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:33.528610 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea4772-a1f3-412a-8490-51a0df77154b None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:33.529999 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 686/1366] 10.222.0.20 () {54 vars in 961 bytes} [Thu Jun 23 10:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:33.535253 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f10358-25c3-4881-9b0b-2598028b7ecd None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:33.535547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f10358-25c3-4881-9b0b-2598028b7ecd None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:33.535861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f10358-25c3-4881-9b0b-2598028b7ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:33.555318 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-b9f10358-25c3-4881-9b0b-2598028b7ecd None None] MFA Rules not processed for user `39840f048d254831bdb963b38520f706`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:33.556681 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b9f10358-25c3-4881-9b0b-2598028b7ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:33.570101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 681/1367] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Jun 23 10:50:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:50:33.578234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea4772-a1f3-412a-8490-51a0df77154b None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:33.593448 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea4772-a1f3-412a-8490-51a0df77154b None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:33.598961 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977a852-72ba-41db-accd-3d1a25b53583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:33.599546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977a852-72ba-41db-accd-3d1a25b53583 service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:33.599828 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977a852-72ba-41db-accd-3d1a25b53583 service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:33.600106 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977a852-72ba-41db-accd-3d1a25b53583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:33.608825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977a852-72ba-41db-accd-3d1a25b53583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:33.612355 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977a852-72ba-41db-accd-3d1a25b53583 service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:33.621019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 687/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:35.907418 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04952c0-2a38-42e8-b45b-84c7f7097780 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.907926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04952c0-2a38-42e8-b45b-84c7f7097780 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.908257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04952c0-2a38-42e8-b45b-84c7f7097780 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.910073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 682/1369] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:35.915569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cea2f2-2c1a-4375-9819-5d63d9933ebe None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.916031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cea2f2-2c1a-4375-9819-5d63d9933ebe None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.916135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cea2f2-2c1a-4375-9819-5d63d9933ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.935322 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-45cea2f2-2c1a-4375-9819-5d63d9933ebe None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:35.936516 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-45cea2f2-2c1a-4375-9819-5d63d9933ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:35.948790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 688/1370] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:35.994019 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04952c0-2a38-42e8-b45b-84c7f7097780 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:36.007061 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:36.013578 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04952c0-2a38-42e8-b45b-84c7f7097780 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:36.021407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965aa0db-8874-4a37-9be5-f1a20bbcbb54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:36.022072 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965aa0db-8874-4a37-9be5-f1a20bbcbb54 service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.022365 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965aa0db-8874-4a37-9be5-f1a20bbcbb54 service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.022646 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965aa0db-8874-4a37-9be5-f1a20bbcbb54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.031763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965aa0db-8874-4a37-9be5-f1a20bbcbb54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:36.033403 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965aa0db-8874-4a37-9be5-f1a20bbcbb54 service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:36.052754 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 683/1371] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:36.354021 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d37e9-e50a-4fcb-a6ee-8d683c42cb9d None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.354368 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d37e9-e50a-4fcb-a6ee-8d683c42cb9d None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.354593 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d37e9-e50a-4fcb-a6ee-8d683c42cb9d None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.356304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 689/1372] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:36.362397 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe82f37-1295-4d27-99c5-8485c2e37506 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.362874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe82f37-1295-4d27-99c5-8485c2e37506 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.363357 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe82f37-1295-4d27-99c5-8485c2e37506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.383955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-2fe82f37-1295-4d27-99c5-8485c2e37506 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:36.385350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-2fe82f37-1295-4d27-99c5-8485c2e37506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:36.396694 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 684/1373] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:36.754164 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7664361-0414-4045-95e3-2592ca0633b9 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.754456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7664361-0414-4045-95e3-2592ca0633b9 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.755099 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7664361-0414-4045-95e3-2592ca0633b9 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.757079 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 690/1374] 10.222.0.20 () {54 vars in 963 bytes} [Thu Jun 23 10:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:36.762468 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c374dce-0488-406a-ac88-c0a0549b89d7 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.762870 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c374dce-0488-406a-ac88-c0a0549b89d7 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.763256 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c374dce-0488-406a-ac88-c0a0549b89d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.815748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-7c374dce-0488-406a-ac88-c0a0549b89d7 None None] MFA Rules not processed for user `d804e11eb85e4050adaecfbaaa6e5a12`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:36.817186 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-7c374dce-0488-406a-ac88-c0a0549b89d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:36.883929 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 685/1375] 10.222.0.20 () {58 vars in 1060 bytes} [Thu Jun 23 10:50:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:36.891664 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7664361-0414-4045-95e3-2592ca0633b9 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:36.903016 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7664361-0414-4045-95e3-2592ca0633b9 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:36.906677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860452e-ca21-4e84-a99d-93521275d773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:36.907450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860452e-ca21-4e84-a99d-93521275d773 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.907844 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860452e-ca21-4e84-a99d-93521275d773 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.908227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860452e-ca21-4e84-a99d-93521275d773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.918323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860452e-ca21-4e84-a99d-93521275d773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:36.919903 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860452e-ca21-4e84-a99d-93521275d773 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:36.930149 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 691/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:38.278036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd814d-dec9-4c71-a2ae-538c9110215e None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:38.278574 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd814d-dec9-4c71-a2ae-538c9110215e None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:38.278574 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd814d-dec9-4c71-a2ae-538c9110215e None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:38.279951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 686/1377] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:38.285194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f6cba-5247-431c-aa6b-b5a49de40418 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:38.285615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f6cba-5247-431c-aa6b-b5a49de40418 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:38.285784 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f6cba-5247-431c-aa6b-b5a49de40418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:38.304092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-644f6cba-5247-431c-aa6b-b5a49de40418 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:38.305309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-644f6cba-5247-431c-aa6b-b5a49de40418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:38.312958 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 692/1378] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:50:38.356460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd814d-dec9-4c71-a2ae-538c9110215e None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:38.371298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd814d-dec9-4c71-a2ae-538c9110215e None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:38.376594 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5bcce-581e-495a-bc32-f34aa2edbeba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:38.377250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5bcce-581e-495a-bc32-f34aa2edbeba service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:38.377536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5bcce-581e-495a-bc32-f34aa2edbeba service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:38.377813 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5bcce-581e-495a-bc32-f34aa2edbeba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:38.386508 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5bcce-581e-495a-bc32-f34aa2edbeba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:38.388102 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5bcce-581e-495a-bc32-f34aa2edbeba service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:38.398452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 687/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:40.645045 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa68289-e174-48c5-a5eb-c145b067e591 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:40.645619 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa68289-e174-48c5-a5eb-c145b067e591 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:40.645699 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa68289-e174-48c5-a5eb-c145b067e591 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:40.648060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 693/1380] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:40.653458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d27e7f-c39f-49ca-87d4-cb920355994e None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:40.654259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d27e7f-c39f-49ca-87d4-cb920355994e None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:40.654691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d27e7f-c39f-49ca-87d4-cb920355994e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:40.678828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-d2d27e7f-c39f-49ca-87d4-cb920355994e None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:40.680267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d2d27e7f-c39f-49ca-87d4-cb920355994e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:40.700781 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 688/1381] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:40.743784 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa68289-e174-48c5-a5eb-c145b067e591 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:40.758427 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa68289-e174-48c5-a5eb-c145b067e591 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:40.763701 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a586a-c5f7-47e0-86ec-bb500b248f23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:40.764340 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a586a-c5f7-47e0-86ec-bb500b248f23 service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:40.764630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a586a-c5f7-47e0-86ec-bb500b248f23 service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:40.764941 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a586a-c5f7-47e0-86ec-bb500b248f23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:40.773331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a586a-c5f7-47e0-86ec-bb500b248f23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:40.774908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a586a-c5f7-47e0-86ec-bb500b248f23 service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:40.785135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 694/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:42.998122 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57401b38-0028-4e0d-9d43-122a4c3e4431 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:42.998771 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57401b38-0028-4e0d-9d43-122a4c3e4431 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:42.998771 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57401b38-0028-4e0d-9d43-122a4c3e4431 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:43.000953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 689/1383] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:43.005979 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32fde4-40e1-4194-8013-d2d50086f0b7 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:43.006518 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32fde4-40e1-4194-8013-d2d50086f0b7 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:43.006518 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32fde4-40e1-4194-8013-d2d50086f0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:43.027222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-1b32fde4-40e1-4194-8013-d2d50086f0b7 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:43.028848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-1b32fde4-40e1-4194-8013-d2d50086f0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:43.038035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 695/1384] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:43.080241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57401b38-0028-4e0d-9d43-122a4c3e4431 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:43.095143 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57401b38-0028-4e0d-9d43-122a4c3e4431 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:43.100837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a15ec-5854-4cad-8156-4e003c5ac3f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:43.101469 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a15ec-5854-4cad-8156-4e003c5ac3f0 service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:43.101752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a15ec-5854-4cad-8156-4e003c5ac3f0 service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:43.102033 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a15ec-5854-4cad-8156-4e003c5ac3f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:43.110357 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a15ec-5854-4cad-8156-4e003c5ac3f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:43.111924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a15ec-5854-4cad-8156-4e003c5ac3f0 service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:43.121684 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 690/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:45.240135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3d3a5-c82a-45ce-adaf-e9ecc8c75288 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:45.240570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3d3a5-c82a-45ce-adaf-e9ecc8c75288 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:45.240786 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3d3a5-c82a-45ce-adaf-e9ecc8c75288 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:45.252978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 696/1386] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:45.253100 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a18955-322c-4c49-8d09-f4b8a0a598e4 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:45.253100 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a18955-322c-4c49-8d09-f4b8a0a598e4 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:45.253100 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a18955-322c-4c49-8d09-f4b8a0a598e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:45.267477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-c8a18955-322c-4c49-8d09-f4b8a0a598e4 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:45.269477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c8a18955-322c-4c49-8d09-f4b8a0a598e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:45.278990 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 691/1387] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:50:45.323865 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3d3a5-c82a-45ce-adaf-e9ecc8c75288 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:45.340068 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3d3a5-c82a-45ce-adaf-e9ecc8c75288 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:45.346105 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0712f-c328-4706-85fc-8e05182111bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:45.346761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0712f-c328-4706-85fc-8e05182111bc service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:45.347048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0712f-c328-4706-85fc-8e05182111bc service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:45.347339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0712f-c328-4706-85fc-8e05182111bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:45.357123 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0712f-c328-4706-85fc-8e05182111bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:45.359237 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0712f-c328-4706-85fc-8e05182111bc service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:45.373191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 697/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:47.788041 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619c7bc-30a6-4dce-81b5-852c840318a6 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:47.788661 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619c7bc-30a6-4dce-81b5-852c840318a6 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:47.788661 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619c7bc-30a6-4dce-81b5-852c840318a6 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:47.790112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 692/1389] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:47.796149 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d4a46-43a8-41cc-945d-ec7c6dfd1c92 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:47.796711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d4a46-43a8-41cc-945d-ec7c6dfd1c92 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:47.797137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d4a46-43a8-41cc-945d-ec7c6dfd1c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:47.824310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-6d7d4a46-43a8-41cc-945d-ec7c6dfd1c92 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:47.826662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-6d7d4a46-43a8-41cc-945d-ec7c6dfd1c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:47.838303 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 698/1390] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:47.884051 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619c7bc-30a6-4dce-81b5-852c840318a6 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:47.900926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619c7bc-30a6-4dce-81b5-852c840318a6 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:47.909746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b79a3-9903-4ad5-a49c-c4be5a8050b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:47.910818 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b79a3-9903-4ad5-a49c-c4be5a8050b8 service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:47.911241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b79a3-9903-4ad5-a49c-c4be5a8050b8 service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:47.912427 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b79a3-9903-4ad5-a49c-c4be5a8050b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:47.921481 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b79a3-9903-4ad5-a49c-c4be5a8050b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:47.923117 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b79a3-9903-4ad5-a49c-c4be5a8050b8 service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:47.934813 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 693/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:50.942880 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f8bb0-b948-4376-9995-92ca2cbaabd8 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:50.943420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f8bb0-b948-4376-9995-92ca2cbaabd8 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:50.943539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f8bb0-b948-4376-9995-92ca2cbaabd8 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:50.944867 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 699/1392] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:50.950163 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f6714-a7e1-43b7-a898-5ef87a26efe1 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:50.950598 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f6714-a7e1-43b7-a898-5ef87a26efe1 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:50.950789 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f6714-a7e1-43b7-a898-5ef87a26efe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:50.969226 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-615f6714-a7e1-43b7-a898-5ef87a26efe1 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:50.970446 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-615f6714-a7e1-43b7-a898-5ef87a26efe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:50.979064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 694/1393] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:51.023345 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f8bb0-b948-4376-9995-92ca2cbaabd8 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:51.038915 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f8bb0-b948-4376-9995-92ca2cbaabd8 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:51.044328 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68b5ce-f85f-4ae4-a353-54002944e129 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:51.045013 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68b5ce-f85f-4ae4-a353-54002944e129 service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.045300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68b5ce-f85f-4ae4-a353-54002944e129 service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.045582 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68b5ce-f85f-4ae4-a353-54002944e129 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.054307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68b5ce-f85f-4ae4-a353-54002944e129 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:51.055893 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68b5ce-f85f-4ae4-a353-54002944e129 service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:51.065544 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 700/1394] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:52.499626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d78370-3358-4ee9-b2a0-a1220e6618c0 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:52.500176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d78370-3358-4ee9-b2a0-a1220e6618c0 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:52.500176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d78370-3358-4ee9-b2a0-a1220e6618c0 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:52.501482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 695/1395] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:52.507394 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5dad49-1839-4537-98ec-675b61b99398 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:52.507832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5dad49-1839-4537-98ec-675b61b99398 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:52.507958 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5dad49-1839-4537-98ec-675b61b99398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:52.525331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-0e5dad49-1839-4537-98ec-675b61b99398 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:52.526714 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-0e5dad49-1839-4537-98ec-675b61b99398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:52.534343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 701/1396] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:52.600164 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38f426-d1ea-455a-b67d-1311426db6a8 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:52.600455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38f426-d1ea-455a-b67d-1311426db6a8 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:52.600771 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38f426-d1ea-455a-b67d-1311426db6a8 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:52.602123 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 696/1397] 10.222.0.20 () {54 vars in 962 bytes} [Thu Jun 23 10:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:52.607474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29b698-c7bb-4cb9-a67d-b438a1909e7f None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:52.607764 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29b698-c7bb-4cb9-a67d-b438a1909e7f None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:52.608043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29b698-c7bb-4cb9-a67d-b438a1909e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:52.657070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-2c29b698-c7bb-4cb9-a67d-b438a1909e7f None None] MFA Rules not processed for user `06498e12426947908d5217e2c948519d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:52.658935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-2c29b698-c7bb-4cb9-a67d-b438a1909e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:52.750577 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 702/1398] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Jun 23 10:50:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:52.758364 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38f426-d1ea-455a-b67d-1311426db6a8 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:52.769025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38f426-d1ea-455a-b67d-1311426db6a8 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:52.772667 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0728bbf-c291-4c45-9e43-39bd44255bb3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06498e12426947908d5217e2c948519d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:52.773309 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0728bbf-c291-4c45-9e43-39bd44255bb3 service glance] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:52.773590 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0728bbf-c291-4c45-9e43-39bd44255bb3 service glance] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:52.773867 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0728bbf-c291-4c45-9e43-39bd44255bb3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:52.782967 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0728bbf-c291-4c45-9e43-39bd44255bb3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:52.784363 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0728bbf-c291-4c45-9e43-39bd44255bb3 service glance] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:52.794266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 697/1399] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:50:53.375788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa765c-e9f5-47e6-a6d9-93eed0d14612 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:53.376088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa765c-e9f5-47e6-a6d9-93eed0d14612 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:53.376377 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa765c-e9f5-47e6-a6d9-93eed0d14612 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:53.377824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 703/1400] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:53.384604 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a79c6-e9e5-44bb-91ce-6dd3db77083a None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:53.385224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a79c6-e9e5-44bb-91ce-6dd3db77083a None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:53.385823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a79c6-e9e5-44bb-91ce-6dd3db77083a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:53.407814 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-653a79c6-e9e5-44bb-91ce-6dd3db77083a None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:53.409186 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-653a79c6-e9e5-44bb-91ce-6dd3db77083a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:53.424724 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 698/1401] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:53.467153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa765c-e9f5-47e6-a6d9-93eed0d14612 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:53.475817 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=93 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:53.482882 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa765c-e9f5-47e6-a6d9-93eed0d14612 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:53.489175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b42d69-a66d-44ab-882f-877df6ff5d84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:53.489945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b42d69-a66d-44ab-882f-877df6ff5d84 service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:53.490226 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b42d69-a66d-44ab-882f-877df6ff5d84 service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:53.490502 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b42d69-a66d-44ab-882f-877df6ff5d84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:53.499731 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b42d69-a66d-44ab-882f-877df6ff5d84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:53.501376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b42d69-a66d-44ab-882f-877df6ff5d84 service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:53.513359 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 704/1402] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:53.685494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699ee79-4014-4b9a-b7de-916268c9f406 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:53.686025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699ee79-4014-4b9a-b7de-916268c9f406 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:53.686203 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699ee79-4014-4b9a-b7de-916268c9f406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:53.737156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-d699ee79-4014-4b9a-b7de-916268c9f406 None None] MFA Rules not processed for user `1b03d940626a449dbe904f02f3d70854`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:53.738473 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d699ee79-4014-4b9a-b7de-916268c9f406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:53.752589 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:53.811649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 699/1403] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 23 10:50:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:53.854993 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6af6b-b848-454a-be4c-d4cffe4a78c6 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:53.855283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6af6b-b848-454a-be4c-d4cffe4a78c6 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:53.855561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6af6b-b848-454a-be4c-d4cffe4a78c6 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:53.857237 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 705/1404] 10.222.0.20 () {54 vars in 942 bytes} [Thu Jun 23 10:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:53.864916 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75188e0-9219-4e0b-8735-9b3046e16521 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:53.865212 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75188e0-9219-4e0b-8735-9b3046e16521 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:53.865495 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75188e0-9219-4e0b-8735-9b3046e16521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:53.915013 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-c75188e0-9219-4e0b-8735-9b3046e16521 None None] MFA Rules not processed for user `4a54fa1c326f41e88688404a56b75c30`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:53.916207 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c75188e0-9219-4e0b-8735-9b3046e16521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:53.986687 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 700/1405] 10.222.0.20 () {58 vars in 1039 bytes} [Thu Jun 23 10:50:53 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:53.996394 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6af6b-b848-454a-be4c-d4cffe4a78c6 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:54.012805 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6af6b-b848-454a-be4c-d4cffe4a78c6 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:54.018288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc715639-9968-4342-a353-f19209b7b74f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a54fa1c326f41e88688404a56b75c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:54.027460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc715639-9968-4342-a353-f19209b7b74f service swift] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:54.027460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc715639-9968-4342-a353-f19209b7b74f service swift] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:54.027460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc715639-9968-4342-a353-f19209b7b74f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:54.033233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc715639-9968-4342-a353-f19209b7b74f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:54.035926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc715639-9968-4342-a353-f19209b7b74f service swift] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:54.049951 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 706/1406] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 23 10:50:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:50:55.894786 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5a350-842d-484a-b611-f08b0e9ca62c None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:55.895347 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5a350-842d-484a-b611-f08b0e9ca62c None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:55.895347 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5a350-842d-484a-b611-f08b0e9ca62c None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:55.897420 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 701/1407] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:55.905007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae93a2-bc29-47bb-9046-aa8b0f159baf None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:55.905473 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae93a2-bc29-47bb-9046-aa8b0f159baf None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:55.906279 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae93a2-bc29-47bb-9046-aa8b0f159baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:55.935724 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-53ae93a2-bc29-47bb-9046-aa8b0f159baf None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:55.936991 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-53ae93a2-bc29-47bb-9046-aa8b0f159baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:55.948682 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 707/1408] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:55.992010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5a350-842d-484a-b611-f08b0e9ca62c None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:56.007015 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5a350-842d-484a-b611-f08b0e9ca62c None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:56.013328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cc9cc-efb7-446a-86f0-31a8f54af097 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:56.014113 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cc9cc-efb7-446a-86f0-31a8f54af097 service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:56.014404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cc9cc-efb7-446a-86f0-31a8f54af097 service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:56.014692 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cc9cc-efb7-446a-86f0-31a8f54af097 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:56.024092 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1cc9cc-efb7-446a-86f0-31a8f54af097 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:56.026938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1cc9cc-efb7-446a-86f0-31a8f54af097 service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:56.037668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 702/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:05.927925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=14 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:06.032425 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=71 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:17.990231 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb34e9-84a0-4847-b938-9be4d077a2cb None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:17.990741 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb34e9-84a0-4847-b938-9be4d077a2cb None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:17.990741 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb34e9-84a0-4847-b938-9be4d077a2cb None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:17.992127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 708/1410] 10.222.0.20 () {54 vars in 918 bytes} [Thu Jun 23 10:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:17.997156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d951e3c-bf31-4535-a7dc-0f00035c2bf3 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:17.997612 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d951e3c-bf31-4535-a7dc-0f00035c2bf3 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:17.997738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d951e3c-bf31-4535-a7dc-0f00035c2bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:18.016738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-5d951e3c-bf31-4535-a7dc-0f00035c2bf3 None None] MFA Rules not processed for user `6ff588aaad264f9cbc5a80e73ef0c09d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:18.017960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-5d951e3c-bf31-4535-a7dc-0f00035c2bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:18.026777 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 703/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Jun 23 10:51:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:18.040784 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5c8a0-76c3-4611-870d-1fb01b4d7a00 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:18.041071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5c8a0-76c3-4611-870d-1fb01b4d7a00 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:18.041346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5c8a0-76c3-4611-870d-1fb01b4d7a00 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:18.042694 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 709/1412] 10.222.0.20 () {54 vars in 918 bytes} [Thu Jun 23 10:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:18.047550 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45f92a-9d60-4b19-8db1-eec2190217da None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:18.047843 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45f92a-9d60-4b19-8db1-eec2190217da None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:18.048129 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45f92a-9d60-4b19-8db1-eec2190217da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:18.067786 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-cb45f92a-9d60-4b19-8db1-eec2190217da None None] MFA Rules not processed for user `39840f048d254831bdb963b38520f706`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:18.069019 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-cb45f92a-9d60-4b19-8db1-eec2190217da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:18.078247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 704/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Jun 23 10:51:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:20.701632 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508bfd9-a3fb-4cae-a1f3-d11f9b8d5cc6 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:20.702194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508bfd9-a3fb-4cae-a1f3-d11f9b8d5cc6 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:20.702194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508bfd9-a3fb-4cae-a1f3-d11f9b8d5cc6 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:20.703549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:20.709151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180b307-4e6f-4dec-b5f7-376e29014400 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:20.709556 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180b307-4e6f-4dec-b5f7-376e29014400 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:20.709710 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180b307-4e6f-4dec-b5f7-376e29014400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:20.728796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-5180b307-4e6f-4dec-b5f7-376e29014400 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:20.730022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-5180b307-4e6f-4dec-b5f7-376e29014400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:20.739300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:20.789323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508bfd9-a3fb-4cae-a1f3-d11f9b8d5cc6 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:20.805464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508bfd9-a3fb-4cae-a1f3-d11f9b8d5cc6 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:20.811267 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f603360-ceae-4398-b14c-925fa410fbef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:20.811968 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f603360-ceae-4398-b14c-925fa410fbef service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:20.812311 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f603360-ceae-4398-b14c-925fa410fbef service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:20.812660 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f603360-ceae-4398-b14c-925fa410fbef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:20.822206 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f603360-ceae-4398-b14c-925fa410fbef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:20.824310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f603360-ceae-4398-b14c-925fa410fbef service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:20.836314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 711/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:21.773253 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97741e-d573-49e0-88bf-67bb1e2e1938 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:21.773822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97741e-d573-49e0-88bf-67bb1e2e1938 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:21.773928 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97741e-d573-49e0-88bf-67bb1e2e1938 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:21.775248 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:21.780532 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037cd05-aacb-428c-b989-fc7e81a7f74b None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:21.781004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037cd05-aacb-428c-b989-fc7e81a7f74b None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:21.781152 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037cd05-aacb-428c-b989-fc7e81a7f74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:21.802004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-7037cd05-aacb-428c-b989-fc7e81a7f74b None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:21.803305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-7037cd05-aacb-428c-b989-fc7e81a7f74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:21.811848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:21.966360 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97741e-d573-49e0-88bf-67bb1e2e1938 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:21.981953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97741e-d573-49e0-88bf-67bb1e2e1938 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:21.988411 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33e624-feaf-464a-a6cc-ae026f09030d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:21.989170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33e624-feaf-464a-a6cc-ae026f09030d service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:21.989482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33e624-feaf-464a-a6cc-ae026f09030d service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:21.989805 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33e624-feaf-464a-a6cc-ae026f09030d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:21.998447 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33e624-feaf-464a-a6cc-ae026f09030d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:22.004057 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33e624-feaf-464a-a6cc-ae026f09030d service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:22.010900 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 707/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:22.911778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11034ac-7844-4bd5-b65e-568e49de4b04 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:22.912320 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11034ac-7844-4bd5-b65e-568e49de4b04 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:22.912320 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11034ac-7844-4bd5-b65e-568e49de4b04 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:22.913737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:22.918763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18640b-816a-414e-8423-dfeb4d5ea780 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:22.919174 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18640b-816a-414e-8423-dfeb4d5ea780 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:22.919322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18640b-816a-414e-8423-dfeb4d5ea780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:22.937637 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-4c18640b-816a-414e-8423-dfeb4d5ea780 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:22.938849 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-4c18640b-816a-414e-8423-dfeb4d5ea780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:22.947397 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:23.098243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11034ac-7844-4bd5-b65e-568e49de4b04 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:23.113415 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11034ac-7844-4bd5-b65e-568e49de4b04 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:23.118811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74636e-29cd-40fe-b718-7ab959971090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:23.119456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74636e-29cd-40fe-b718-7ab959971090 service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:23.119736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74636e-29cd-40fe-b718-7ab959971090 service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:23.120011 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74636e-29cd-40fe-b718-7ab959971090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:23.129040 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74636e-29cd-40fe-b718-7ab959971090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:23.130618 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74636e-29cd-40fe-b718-7ab959971090 service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:23.140274 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 714/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:24.008544 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22420da-804b-47a6-8307-7ac1ecd7bfbe None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:24.009114 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22420da-804b-47a6-8307-7ac1ecd7bfbe None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:24.009114 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22420da-804b-47a6-8307-7ac1ecd7bfbe None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:24.011510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:51:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:24.016459 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e5c03-ba67-49f8-a30d-cbacad0416b5 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:24.016862 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e5c03-ba67-49f8-a30d-cbacad0416b5 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:24.017060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e5c03-ba67-49f8-a30d-cbacad0416b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:24.034777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-560e5c03-ba67-49f8-a30d-cbacad0416b5 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:24.035985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-560e5c03-ba67-49f8-a30d-cbacad0416b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:24.043594 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:51:24.195085 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22420da-804b-47a6-8307-7ac1ecd7bfbe None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:24.209160 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22420da-804b-47a6-8307-7ac1ecd7bfbe None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:24.214492 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a24d4d-7cc3-48fa-b537-fd80c6678e89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:24.215127 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a24d4d-7cc3-48fa-b537-fd80c6678e89 service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:24.215414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a24d4d-7cc3-48fa-b537-fd80c6678e89 service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:24.215696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a24d4d-7cc3-48fa-b537-fd80c6678e89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:24.225349 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a24d4d-7cc3-48fa-b537-fd80c6678e89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:24.226955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a24d4d-7cc3-48fa-b537-fd80c6678e89 service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:24.237561 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 710/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:51:25.102407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab4a0a-cdf3-4b7b-8a90-220e721e454a None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:25.102939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab4a0a-cdf3-4b7b-8a90-220e721e454a None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:25.103058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab4a0a-cdf3-4b7b-8a90-220e721e454a None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:25.104361 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:25.109646 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828f446-dc51-4716-a4cc-c5c508820d7f None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:25.110027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828f446-dc51-4716-a4cc-c5c508820d7f None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:25.110216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828f446-dc51-4716-a4cc-c5c508820d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:25.129246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-a828f446-dc51-4716-a4cc-c5c508820d7f None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:25.130446 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-a828f446-dc51-4716-a4cc-c5c508820d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:25.138472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:25.290761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab4a0a-cdf3-4b7b-8a90-220e721e454a None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:25.305669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab4a0a-cdf3-4b7b-8a90-220e721e454a None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:25.311027 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542dab5-6acc-455e-9864-42b5a538d0de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:25.311668 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542dab5-6acc-455e-9864-42b5a538d0de service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:25.311955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542dab5-6acc-455e-9864-42b5a538d0de service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:25.312233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542dab5-6acc-455e-9864-42b5a538d0de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:25.321208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542dab5-6acc-455e-9864-42b5a538d0de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:25.322826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542dab5-6acc-455e-9864-42b5a538d0de service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:25.332753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 717/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:26.203489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728e881-662e-4570-916e-4c0950a6fe18 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:26.204053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728e881-662e-4570-916e-4c0950a6fe18 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:26.204053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728e881-662e-4570-916e-4c0950a6fe18 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:26.205968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:26.210965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3560-9ef1-490c-bab3-e01974221db3 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:26.211381 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3560-9ef1-490c-bab3-e01974221db3 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:26.211525 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3560-9ef1-490c-bab3-e01974221db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:26.229667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-3efa3560-9ef1-490c-bab3-e01974221db3 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:26.231134 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-3efa3560-9ef1-490c-bab3-e01974221db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:26.239117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:26.388936 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728e881-662e-4570-916e-4c0950a6fe18 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:26.404241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728e881-662e-4570-916e-4c0950a6fe18 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:26.410512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d1389-8e20-40c8-b45f-a59ab8cc4081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:26.411155 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d1389-8e20-40c8-b45f-a59ab8cc4081 service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:26.411443 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d1389-8e20-40c8-b45f-a59ab8cc4081 service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:26.411723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d1389-8e20-40c8-b45f-a59ab8cc4081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:26.419671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d1389-8e20-40c8-b45f-a59ab8cc4081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:26.421283 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d1389-8e20-40c8-b45f-a59ab8cc4081 service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:26.430779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 713/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:27.287119 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f29eb-a40b-42e6-9d68-b38cdf9950b1 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:27.287638 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f29eb-a40b-42e6-9d68-b38cdf9950b1 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:27.287638 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f29eb-a40b-42e6-9d68-b38cdf9950b1 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:27.289021 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:51:27.294048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3873c9e-cacb-4fa0-8c6b-1d95b36ee1c7 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:27.294489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3873c9e-cacb-4fa0-8c6b-1d95b36ee1c7 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:27.294611 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3873c9e-cacb-4fa0-8c6b-1d95b36ee1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:27.315119 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-d3873c9e-cacb-4fa0-8c6b-1d95b36ee1c7 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:27.315119 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d3873c9e-cacb-4fa0-8c6b-1d95b36ee1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:27.322499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:27.473590 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f29eb-a40b-42e6-9d68-b38cdf9950b1 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:27.488904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f29eb-a40b-42e6-9d68-b38cdf9950b1 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:27.494539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ceafa1-6fc0-4455-ba62-8b9fbb942e70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:27.495186 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceafa1-6fc0-4455-ba62-8b9fbb942e70 service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:27.495470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceafa1-6fc0-4455-ba62-8b9fbb942e70 service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:27.495747 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceafa1-6fc0-4455-ba62-8b9fbb942e70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:27.504327 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ceafa1-6fc0-4455-ba62-8b9fbb942e70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:27.505965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ceafa1-6fc0-4455-ba62-8b9fbb942e70 service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:27.515251 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 720/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:28.383722 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4013468-9b09-4c48-a418-583e71b2b3e6 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:28.384268 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4013468-9b09-4c48-a418-583e71b2b3e6 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:28.384368 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4013468-9b09-4c48-a418-583e71b2b3e6 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:28.385728 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:28.390539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4beed-76be-4251-8ea1-bc16b7548a7d None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:28.390940 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4beed-76be-4251-8ea1-bc16b7548a7d None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:28.391097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4beed-76be-4251-8ea1-bc16b7548a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:28.408509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-e6e4beed-76be-4251-8ea1-bc16b7548a7d None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:28.409742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e6e4beed-76be-4251-8ea1-bc16b7548a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:28.417334 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:28.568259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4013468-9b09-4c48-a418-583e71b2b3e6 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:28.583900 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4013468-9b09-4c48-a418-583e71b2b3e6 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:28.589335 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268867d-5f26-444a-888f-9566c3b66289 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:28.589974 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268867d-5f26-444a-888f-9566c3b66289 service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:28.590262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268867d-5f26-444a-888f-9566c3b66289 service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:28.590541 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268867d-5f26-444a-888f-9566c3b66289 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:28.599106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268867d-5f26-444a-888f-9566c3b66289 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:28.600717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268867d-5f26-444a-888f-9566c3b66289 service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:28.610283 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 716/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:29.481757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1377be5-4ffc-499b-846d-3c9b8751cf34 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:29.482371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1377be5-4ffc-499b-846d-3c9b8751cf34 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:29.482371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1377be5-4ffc-499b-846d-3c9b8751cf34 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:29.483715 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:29.489451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380dfda-9dbb-4843-bd5d-074945d2249b None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:29.489988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380dfda-9dbb-4843-bd5d-074945d2249b None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:29.489988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380dfda-9dbb-4843-bd5d-074945d2249b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:29.510036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-0380dfda-9dbb-4843-bd5d-074945d2249b None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:29.511959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-0380dfda-9dbb-4843-bd5d-074945d2249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:29.526181 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:29.677328 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1377be5-4ffc-499b-846d-3c9b8751cf34 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:29.692402 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1377be5-4ffc-499b-846d-3c9b8751cf34 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:29.698063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36caef9e-b5ae-48a0-83ca-d8df9ae8780b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:29.698711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caef9e-b5ae-48a0-83ca-d8df9ae8780b service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:29.698995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caef9e-b5ae-48a0-83ca-d8df9ae8780b service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:29.699273 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36caef9e-b5ae-48a0-83ca-d8df9ae8780b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:29.709407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36caef9e-b5ae-48a0-83ca-d8df9ae8780b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:29.711109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36caef9e-b5ae-48a0-83ca-d8df9ae8780b service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:29.721120 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 723/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:31.719235 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6e6b2-3775-43fb-aff8-cb5321ccd352 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:31.719796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6e6b2-3775-43fb-aff8-cb5321ccd352 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:31.719796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6e6b2-3775-43fb-aff8-cb5321ccd352 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:31.721777 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:31.727663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c6245-765e-4484-9d8d-01831184ace2 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:31.728150 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c6245-765e-4484-9d8d-01831184ace2 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:31.728256 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c6245-765e-4484-9d8d-01831184ace2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:31.751827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-587c6245-765e-4484-9d8d-01831184ace2 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:31.753152 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-587c6245-765e-4484-9d8d-01831184ace2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:31.761270 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:31.801811 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6e6b2-3775-43fb-aff8-cb5321ccd352 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:31.813350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6e6b2-3775-43fb-aff8-cb5321ccd352 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:31.817248 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87ba30-86a6-42f9-a912-fb3ce17185a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:31.817809 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87ba30-86a6-42f9-a912-fb3ce17185a6 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:31.818085 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87ba30-86a6-42f9-a912-fb3ce17185a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:31.818357 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87ba30-86a6-42f9-a912-fb3ce17185a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:31.829283 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87ba30-86a6-42f9-a912-fb3ce17185a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:31.830760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87ba30-86a6-42f9-a912-fb3ce17185a6 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:31.842957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 719/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:34.097985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf21fc-9fc5-426e-92f0-9b54a9840c53 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:34.098549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf21fc-9fc5-426e-92f0-9b54a9840c53 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:34.098549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf21fc-9fc5-426e-92f0-9b54a9840c53 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:34.099914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:34.105700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b10842-f8e1-438c-9d15-e31a15577c08 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:34.106139 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b10842-f8e1-438c-9d15-e31a15577c08 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:34.106267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b10842-f8e1-438c-9d15-e31a15577c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:34.125713 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-41b10842-f8e1-438c-9d15-e31a15577c08 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:34.126945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-41b10842-f8e1-438c-9d15-e31a15577c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:34.135732 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:34.176508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf21fc-9fc5-426e-92f0-9b54a9840c53 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:34.187886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf21fc-9fc5-426e-92f0-9b54a9840c53 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:34.191721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b8ad5-7482-448f-af78-22e9f42e608d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:34.198995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b8ad5-7482-448f-af78-22e9f42e608d service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:34.198995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b8ad5-7482-448f-af78-22e9f42e608d service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:34.198995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b8ad5-7482-448f-af78-22e9f42e608d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:34.203344 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b8ad5-7482-448f-af78-22e9f42e608d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:34.204760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b8ad5-7482-448f-af78-22e9f42e608d service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:34.215405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 726/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:36.715023 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9ae88-9f1e-4c82-9c56-1cbf08183bb7 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:36.715575 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9ae88-9f1e-4c82-9c56-1cbf08183bb7 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:36.715575 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9ae88-9f1e-4c82-9c56-1cbf08183bb7 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:36.717108 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:36.725553 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4c1c4-9858-48cf-b593-cf28990f3c89 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:36.726100 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4c1c4-9858-48cf-b593-cf28990f3c89 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:36.726100 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4c1c4-9858-48cf-b593-cf28990f3c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:36.744503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-eaf4c1c4-9858-48cf-b593-cf28990f3c89 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:36.745753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-eaf4c1c4-9858-48cf-b593-cf28990f3c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:36.754773 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:36.794404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9ae88-9f1e-4c82-9c56-1cbf08183bb7 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:36.805910 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9ae88-9f1e-4c82-9c56-1cbf08183bb7 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:36.809622 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f0e02-e304-4d04-af06-1c340ffb5523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:36.810265 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f0e02-e304-4d04-af06-1c340ffb5523 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:36.810552 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f0e02-e304-4d04-af06-1c340ffb5523 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:36.810836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f0e02-e304-4d04-af06-1c340ffb5523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:36.821487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f0e02-e304-4d04-af06-1c340ffb5523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:36.823123 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f0e02-e304-4d04-af06-1c340ffb5523 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:36.833615 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 722/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:39.094501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ce7fd-6546-4825-b12f-1ea957c49f96 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:39.095094 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ce7fd-6546-4825-b12f-1ea957c49f96 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:39.095094 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ce7fd-6546-4825-b12f-1ea957c49f96 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:39.097387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:39.104288 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2562ff-377a-4071-961b-5aba4ad402d0 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:39.105027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2562ff-377a-4071-961b-5aba4ad402d0 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:39.105125 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2562ff-377a-4071-961b-5aba4ad402d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:39.123949 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-fa2562ff-377a-4071-961b-5aba4ad402d0 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:39.125935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-fa2562ff-377a-4071-961b-5aba4ad402d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:39.134588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:39.176316 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ce7fd-6546-4825-b12f-1ea957c49f96 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:39.187537 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ce7fd-6546-4825-b12f-1ea957c49f96 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:39.192238 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3eccc1-886f-4876-ac46-603cf7dbd4b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:39.192952 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3eccc1-886f-4876-ac46-603cf7dbd4b7 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:39.193234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3eccc1-886f-4876-ac46-603cf7dbd4b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:39.193509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3eccc1-886f-4876-ac46-603cf7dbd4b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:39.203264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3eccc1-886f-4876-ac46-603cf7dbd4b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:39.204740 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3eccc1-886f-4876-ac46-603cf7dbd4b7 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:39.215396 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 729/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:41.341729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f544e-ffe5-4458-8fe8-6867f9d9f961 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:41.342331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f544e-ffe5-4458-8fe8-6867f9d9f961 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:41.342331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f544e-ffe5-4458-8fe8-6867f9d9f961 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:41.343675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:41.349318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cb219-bc88-462e-aea1-70d7f90b27b3 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:41.349759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cb219-bc88-462e-aea1-70d7f90b27b3 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:41.349880 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cb219-bc88-462e-aea1-70d7f90b27b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:41.369149 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-b50cb219-bc88-462e-aea1-70d7f90b27b3 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:41.370366 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-b50cb219-bc88-462e-aea1-70d7f90b27b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:41.379008 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:41.417606 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f544e-ffe5-4458-8fe8-6867f9d9f961 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:41.429195 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f544e-ffe5-4458-8fe8-6867f9d9f961 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:41.432749 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d347ea-53c8-43e1-9352-02b1bda4e082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:41.433391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d347ea-53c8-43e1-9352-02b1bda4e082 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:41.433677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d347ea-53c8-43e1-9352-02b1bda4e082 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:41.433958 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d347ea-53c8-43e1-9352-02b1bda4e082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:41.443050 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d347ea-53c8-43e1-9352-02b1bda4e082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:41.444460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d347ea-53c8-43e1-9352-02b1bda4e082 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:41.454090 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 725/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:43.613284 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc848bc-bf74-4a47-8e1e-6db9943cec9c None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:43.613849 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc848bc-bf74-4a47-8e1e-6db9943cec9c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:43.614186 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc848bc-bf74-4a47-8e1e-6db9943cec9c None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:43.616228 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:43.622200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607187b-f2cf-473d-b983-5531602cb290 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:43.622879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607187b-f2cf-473d-b983-5531602cb290 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:43.622879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607187b-f2cf-473d-b983-5531602cb290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:43.641618 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-e607187b-f2cf-473d-b983-5531602cb290 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:43.643460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e607187b-f2cf-473d-b983-5531602cb290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:43.653442 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:43.697672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc848bc-bf74-4a47-8e1e-6db9943cec9c None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:43.709933 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc848bc-bf74-4a47-8e1e-6db9943cec9c None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:43.714025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c1894-86a2-4bcc-8cb2-1f44af0dd835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:43.714905 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c1894-86a2-4bcc-8cb2-1f44af0dd835 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:43.715207 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c1894-86a2-4bcc-8cb2-1f44af0dd835 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:43.715484 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c1894-86a2-4bcc-8cb2-1f44af0dd835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:43.728618 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c1894-86a2-4bcc-8cb2-1f44af0dd835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:43.731367 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c1894-86a2-4bcc-8cb2-1f44af0dd835 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:43.742622 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 732/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:45.981971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07c17a-208b-43f1-bd26-3404290a5a0c None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:45.982484 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07c17a-208b-43f1-bd26-3404290a5a0c None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:45.982484 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07c17a-208b-43f1-bd26-3404290a5a0c None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:45.984066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:45.990137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9345ef-744c-4b0b-adf6-16b5ce7b1706 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:45.990602 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9345ef-744c-4b0b-adf6-16b5ce7b1706 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:45.990719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9345ef-744c-4b0b-adf6-16b5ce7b1706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:45.996834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=70 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:46.008493 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-cb9345ef-744c-4b0b-adf6-16b5ce7b1706 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:46.009724 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-cb9345ef-744c-4b0b-adf6-16b5ce7b1706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:46.017597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:46.056477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07c17a-208b-43f1-bd26-3404290a5a0c None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:46.061988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=73 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:46.068134 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07c17a-208b-43f1-bd26-3404290a5a0c None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:46.071882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fa68e-b05f-43f6-a7c8-9eb75b85c1b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:46.087101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fa68e-b05f-43f6-a7c8-9eb75b85c1b6 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:46.087101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fa68e-b05f-43f6-a7c8-9eb75b85c1b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:46.087101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fa68e-b05f-43f6-a7c8-9eb75b85c1b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:46.087101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fa68e-b05f-43f6-a7c8-9eb75b85c1b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:46.087101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fa68e-b05f-43f6-a7c8-9eb75b85c1b6 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:46.093513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 728/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:48.207645 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df3b36-0532-48e5-a1bc-86fd7d3dd723 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:48.208290 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df3b36-0532-48e5-a1bc-86fd7d3dd723 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:48.208290 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df3b36-0532-48e5-a1bc-86fd7d3dd723 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:48.209637 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:48.215123 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862ef38-26cf-4230-9bd4-1ee1882eaf4c None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:48.215535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862ef38-26cf-4230-9bd4-1ee1882eaf4c None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:48.215717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862ef38-26cf-4230-9bd4-1ee1882eaf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:48.234620 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-9862ef38-26cf-4230-9bd4-1ee1882eaf4c None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:48.236690 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9862ef38-26cf-4230-9bd4-1ee1882eaf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:48.244537 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:48.282495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df3b36-0532-48e5-a1bc-86fd7d3dd723 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:48.294307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df3b36-0532-48e5-a1bc-86fd7d3dd723 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:48.298342 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9960fb-dd1b-4798-8ba6-538ac56e9660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:48.299493 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9960fb-dd1b-4798-8ba6-538ac56e9660 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:48.299781 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9960fb-dd1b-4798-8ba6-538ac56e9660 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:48.300056 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9960fb-dd1b-4798-8ba6-538ac56e9660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:48.309600 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9960fb-dd1b-4798-8ba6-538ac56e9660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:48.311077 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9960fb-dd1b-4798-8ba6-538ac56e9660 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:48.320661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 735/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:50.445833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239dce5-7468-4819-ab1d-9be186f343bc None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:50.446399 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239dce5-7468-4819-ab1d-9be186f343bc None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:50.446399 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239dce5-7468-4819-ab1d-9be186f343bc None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:50.447743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:50.453290 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7232f63-b12f-45aa-bae1-ffd56f213a3c None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:50.453825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7232f63-b12f-45aa-bae1-ffd56f213a3c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:50.453938 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7232f63-b12f-45aa-bae1-ffd56f213a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:50.472658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-c7232f63-b12f-45aa-bae1-ffd56f213a3c None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:50.473861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c7232f63-b12f-45aa-bae1-ffd56f213a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:50.481866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:50.519152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239dce5-7468-4819-ab1d-9be186f343bc None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:50.529734 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239dce5-7468-4819-ab1d-9be186f343bc None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:50.533680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59738fe3-cdc0-4d2f-b7fb-daee255c607d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:50.533886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59738fe3-cdc0-4d2f-b7fb-daee255c607d service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:50.534167 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59738fe3-cdc0-4d2f-b7fb-daee255c607d service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:50.534357 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59738fe3-cdc0-4d2f-b7fb-daee255c607d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:50.543441 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59738fe3-cdc0-4d2f-b7fb-daee255c607d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:50.544895 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59738fe3-cdc0-4d2f-b7fb-daee255c607d service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:50.554451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 731/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:52.632192 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644279c-d7ad-44b0-8d52-98422f38f821 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:52.632742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644279c-d7ad-44b0-8d52-98422f38f821 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:52.632840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644279c-d7ad-44b0-8d52-98422f38f821 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:52.634166 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:52.639376 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132eb6e-5f62-4012-9392-f3dcc8a54866 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:52.639796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132eb6e-5f62-4012-9392-f3dcc8a54866 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:52.639956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132eb6e-5f62-4012-9392-f3dcc8a54866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:52.658248 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-5132eb6e-5f62-4012-9392-f3dcc8a54866 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:52.659752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-5132eb6e-5f62-4012-9392-f3dcc8a54866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:52.667615 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:52.704595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644279c-d7ad-44b0-8d52-98422f38f821 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:52.715752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644279c-d7ad-44b0-8d52-98422f38f821 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:52.719312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc2da5-3a40-48ed-a198-d1b817b5964c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:52.719944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc2da5-3a40-48ed-a198-d1b817b5964c service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:52.720226 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc2da5-3a40-48ed-a198-d1b817b5964c service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:52.720503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc2da5-3a40-48ed-a198-d1b817b5964c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:52.729910 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc2da5-3a40-48ed-a198-d1b817b5964c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:52.731331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc2da5-3a40-48ed-a198-d1b817b5964c service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:52.740944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 738/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:02.653098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=17 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:02.736557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=17 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:13.851164 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733fc4f-1f20-49f5-adf9-36b7b3a68fc7 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:13.851741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733fc4f-1f20-49f5-adf9-36b7b3a68fc7 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:13.851741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733fc4f-1f20-49f5-adf9-36b7b3a68fc7 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:13.853122 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 733/1471] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:52:13.859108 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa15d3-a1fc-49b0-99b3-9dc4242a0195 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:13.859595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa15d3-a1fc-49b0-99b3-9dc4242a0195 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:13.859769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa15d3-a1fc-49b0-99b3-9dc4242a0195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:13.879428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-2efa15d3-a1fc-49b0-99b3-9dc4242a0195 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:13.880574 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-2efa15d3-a1fc-49b0-99b3-9dc4242a0195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:13.888606 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 739/1472] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:13.937608 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937fdf6-39d7-44fe-865c-7ea3b4516df4 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:13.938103 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937fdf6-39d7-44fe-865c-7ea3b4516df4 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:13.938393 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937fdf6-39d7-44fe-865c-7ea3b4516df4 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:13.940502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 734/1473] 10.222.0.20 () {54 vars in 962 bytes} [Thu Jun 23 10:52:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:52:13.945688 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96783e87-1b4d-4e9d-a03f-142e16930e72 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:13.946127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96783e87-1b4d-4e9d-a03f-142e16930e72 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:13.946335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96783e87-1b4d-4e9d-a03f-142e16930e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:13.965233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-96783e87-1b4d-4e9d-a03f-142e16930e72 None None] MFA Rules not processed for user `06498e12426947908d5217e2c948519d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:13.966450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-96783e87-1b4d-4e9d-a03f-142e16930e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:13.973300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 740/1474] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Jun 23 10:52:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:13.981234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937fdf6-39d7-44fe-865c-7ea3b4516df4 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:13.992412 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937fdf6-39d7-44fe-865c-7ea3b4516df4 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:13.996087 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b5973-52e0-48ae-9125-8a066cbc6408 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06498e12426947908d5217e2c948519d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:13.996768 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b5973-52e0-48ae-9125-8a066cbc6408 service glance] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:13.997060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b5973-52e0-48ae-9125-8a066cbc6408 service glance] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:13.997337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b5973-52e0-48ae-9125-8a066cbc6408 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:14.008517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b5973-52e0-48ae-9125-8a066cbc6408 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:14.009980 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b5973-52e0-48ae-9125-8a066cbc6408 service glance] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:14.020031 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 735/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:16.362730 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0992d-06c8-4d1c-b56e-69d964f90969 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:16.363314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0992d-06c8-4d1c-b56e-69d964f90969 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:16.363314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0992d-06c8-4d1c-b56e-69d964f90969 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:16.364689 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 741/1476] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:52:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:52:16.370181 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c015ee3-98fd-4877-bd96-0349af413b40 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:16.370655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c015ee3-98fd-4877-bd96-0349af413b40 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:16.370771 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c015ee3-98fd-4877-bd96-0349af413b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:16.395178 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-4c015ee3-98fd-4877-bd96-0349af413b40 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:16.397268 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-4c015ee3-98fd-4877-bd96-0349af413b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:16.405850 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 736/1477] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:16.431441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0992d-06c8-4d1c-b56e-69d964f90969 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:16.445286 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0992d-06c8-4d1c-b56e-69d964f90969 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:16.449904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0eb031-f0df-4663-978d-e868b75ae27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:16.450742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0eb031-f0df-4663-978d-e868b75ae27b admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:16.451128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0eb031-f0df-4663-978d-e868b75ae27b admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:16.451515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0eb031-f0df-4663-978d-e868b75ae27b admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:16.452362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0eb031-f0df-4663-978d-e868b75ae27b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:16.454331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: WARNING py.warnings [None req-4d0eb031-f0df-4663-978d-e868b75ae27b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:52:16.454331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: warnings.warn(msg) Jun 23 10:52:16.454331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: Jun 23 10:52:16.456120 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0eb031-f0df-4663-978d-e868b75ae27b admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:16.477509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 742/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 23 10:52:16 2022] GET /identity/v3/projects => generated 2553 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:18.567822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c728d-5902-4f12-96ec-78e877cd8621 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:18.568358 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c728d-5902-4f12-96ec-78e877cd8621 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:18.568358 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c728d-5902-4f12-96ec-78e877cd8621 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:18.569767 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 737/1479] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:52:18.575427 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc309e-3ce2-4ceb-864f-640a44a5f321 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:18.575923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc309e-3ce2-4ceb-864f-640a44a5f321 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:18.576033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc309e-3ce2-4ceb-864f-640a44a5f321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:18.594156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-7ffc309e-3ce2-4ceb-864f-640a44a5f321 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:18.595393 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-7ffc309e-3ce2-4ceb-864f-640a44a5f321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:18.603616 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 743/1480] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:18.648350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c728d-5902-4f12-96ec-78e877cd8621 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:18.662877 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c728d-5902-4f12-96ec-78e877cd8621 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:18.668351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70b7cd-cf8e-4ad0-bbeb-19d25a5354fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:18.669036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70b7cd-cf8e-4ad0-bbeb-19d25a5354fe service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:18.669325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70b7cd-cf8e-4ad0-bbeb-19d25a5354fe service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:18.669605 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70b7cd-cf8e-4ad0-bbeb-19d25a5354fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:18.679169 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70b7cd-cf8e-4ad0-bbeb-19d25a5354fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:18.680715 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70b7cd-cf8e-4ad0-bbeb-19d25a5354fe service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:18.691289 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 738/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:21.016595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc5586-30ef-4ad6-bbdc-4584219a323f None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:21.017198 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc5586-30ef-4ad6-bbdc-4584219a323f None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:21.017198 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc5586-30ef-4ad6-bbdc-4584219a323f None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:21.018789 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 744/1482] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:52:21.024233 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03176a31-e7db-466c-aff0-8420d30ca59f None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:21.024706 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03176a31-e7db-466c-aff0-8420d30ca59f None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:21.024836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03176a31-e7db-466c-aff0-8420d30ca59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:21.046458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-03176a31-e7db-466c-aff0-8420d30ca59f None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:21.047696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-03176a31-e7db-466c-aff0-8420d30ca59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:21.056661 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 739/1483] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:21.095134 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc5586-30ef-4ad6-bbdc-4584219a323f None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:21.113204 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc5586-30ef-4ad6-bbdc-4584219a323f None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:21.116759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863db781-100a-49ac-bac2-67d30d616ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:21.117447 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863db781-100a-49ac-bac2-67d30d616ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:21.117732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863db781-100a-49ac-bac2-67d30d616ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:21.118012 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863db781-100a-49ac-bac2-67d30d616ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:21.127765 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863db781-100a-49ac-bac2-67d30d616ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:21.129270 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863db781-100a-49ac-bac2-67d30d616ae1 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:21.142155 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 745/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:23.297937 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c575b8c-058c-4724-957c-59c275cbb1a6 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:23.298469 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c575b8c-058c-4724-957c-59c275cbb1a6 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:23.298469 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c575b8c-058c-4724-957c-59c275cbb1a6 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:23.299816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 740/1485] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:52:23.305468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a6f2f-0f46-414c-8668-c5b30c06c91d None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:23.305972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a6f2f-0f46-414c-8668-c5b30c06c91d None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:23.306074 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a6f2f-0f46-414c-8668-c5b30c06c91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:23.325049 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-240a6f2f-0f46-414c-8668-c5b30c06c91d None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:23.326681 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-240a6f2f-0f46-414c-8668-c5b30c06c91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:23.335832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 746/1486] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:23.376430 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c575b8c-058c-4724-957c-59c275cbb1a6 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:23.387924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c575b8c-058c-4724-957c-59c275cbb1a6 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:23.391527 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b9848-3c92-4496-90b2-df61414952b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:23.392866 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b9848-3c92-4496-90b2-df61414952b1 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:23.393052 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b9848-3c92-4496-90b2-df61414952b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:23.393330 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b9848-3c92-4496-90b2-df61414952b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:23.403197 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b9848-3c92-4496-90b2-df61414952b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:23.404716 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b9848-3c92-4496-90b2-df61414952b1 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:23.414750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 741/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:25.673702 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792896b-a0f4-4083-b594-b5b5dc6d8337 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:25.674539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792896b-a0f4-4083-b594-b5b5dc6d8337 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:25.674539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792896b-a0f4-4083-b594-b5b5dc6d8337 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:25.675947 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 747/1488] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:52:25.681969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bc7fd-fe2a-479e-9eb2-e6f94acde5e3 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:25.682534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bc7fd-fe2a-479e-9eb2-e6f94acde5e3 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:25.682534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bc7fd-fe2a-479e-9eb2-e6f94acde5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:25.703184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-ab0bc7fd-fe2a-479e-9eb2-e6f94acde5e3 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:25.704453 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ab0bc7fd-fe2a-479e-9eb2-e6f94acde5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:25.715386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 742/1489] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:25.758774 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792896b-a0f4-4083-b594-b5b5dc6d8337 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:25.771154 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792896b-a0f4-4083-b594-b5b5dc6d8337 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:25.776328 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff9348-6e27-4e71-9a2f-91a39880548f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:25.777434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff9348-6e27-4e71-9a2f-91a39880548f service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:25.777938 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff9348-6e27-4e71-9a2f-91a39880548f service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:25.778430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff9348-6e27-4e71-9a2f-91a39880548f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:25.796835 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff9348-6e27-4e71-9a2f-91a39880548f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:25.798329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff9348-6e27-4e71-9a2f-91a39880548f service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:25.809815 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 748/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:28.244651 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d23a1a-68ea-4b30-a62e-4f3a936d2ec2 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:28.245301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d23a1a-68ea-4b30-a62e-4f3a936d2ec2 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:28.245301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d23a1a-68ea-4b30-a62e-4f3a936d2ec2 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:28.246597 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 743/1491] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 23 10:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:52:28.252178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d63c9-0306-499c-b474-348e7c7d9d09 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:28.252775 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d63c9-0306-499c-b474-348e7c7d9d09 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:28.252888 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d63c9-0306-499c-b474-348e7c7d9d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:28.271073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-a52d63c9-0306-499c-b474-348e7c7d9d09 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:28.272274 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a52d63c9-0306-499c-b474-348e7c7d9d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:28.280084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 749/1492] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 23 10:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:28.319192 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d23a1a-68ea-4b30-a62e-4f3a936d2ec2 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:28.330966 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d23a1a-68ea-4b30-a62e-4f3a936d2ec2 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:28.334540 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3c497-4f66-4355-ba49-16ac30c75ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:28.335178 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3c497-4f66-4355-ba49-16ac30c75ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:28.335457 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3c497-4f66-4355-ba49-16ac30c75ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:28.335740 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3c497-4f66-4355-ba49-16ac30c75ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:28.344685 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3c497-4f66-4355-ba49-16ac30c75ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:28.346853 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3c497-4f66-4355-ba49-16ac30c75ce6 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:28.356486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 744/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:38.265309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=33 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:38.352086 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=33 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:11.517364 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd476886-6b23-4a96-a92e-e6c92ad609ae None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:11.517960 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd476886-6b23-4a96-a92e-e6c92ad609ae None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:11.517960 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd476886-6b23-4a96-a92e-e6c92ad609ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:11.536188 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-fd476886-6b23-4a96-a92e-e6c92ad609ae None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:54:11.537416 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-fd476886-6b23-4a96-a92e-e6c92ad609ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:11.545671 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 750/1494] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:54:11.555450 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55d0b8-f87a-4aae-9657-cdc9100a2142 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:11.555961 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55d0b8-f87a-4aae-9657-cdc9100a2142 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:11.556060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55d0b8-f87a-4aae-9657-cdc9100a2142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:11.574374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-8b55d0b8-f87a-4aae-9657-cdc9100a2142 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:54:11.575568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-8b55d0b8-f87a-4aae-9657-cdc9100a2142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:11.583314 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 745/1495] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:54:11.588015 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd476886-6b23-4a96-a92e-e6c92ad609ae None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:11.598026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd476886-6b23-4a96-a92e-e6c92ad609ae None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:11.603849 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615d872-d807-4e5f-8076-8156180e442e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:11.604778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615d872-d807-4e5f-8076-8156180e442e admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:11.604909 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615d872-d807-4e5f-8076-8156180e442e admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:11.605099 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615d872-d807-4e5f-8076-8156180e442e admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:11.606484 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615d872-d807-4e5f-8076-8156180e442e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:54:11.606484 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615d872-d807-4e5f-8076-8156180e442e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:11.607178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: WARNING py.warnings [None req-5615d872-d807-4e5f-8076-8156180e442e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:54:11.607178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: warnings.warn(msg) Jun 23 10:54:11.607178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: Jun 23 10:54:11.608063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615d872-d807-4e5f-8076-8156180e442e admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:11.621882 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 751/1496] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:54:11.630226 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55d0b8-f87a-4aae-9657-cdc9100a2142 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:11.640024 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55d0b8-f87a-4aae-9657-cdc9100a2142 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:11.644610 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed3adf-d8d3-400b-afb9-08930e35d321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:11.645296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed3adf-d8d3-400b-afb9-08930e35d321 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:11.645615 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed3adf-d8d3-400b-afb9-08930e35d321 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:11.645909 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed3adf-d8d3-400b-afb9-08930e35d321 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:11.646590 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed3adf-d8d3-400b-afb9-08930e35d321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:11.648483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: WARNING py.warnings [None req-baed3adf-d8d3-400b-afb9-08930e35d321 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:54:11.648483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: warnings.warn(msg) Jun 23 10:54:11.648483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: Jun 23 10:54:11.649711 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed3adf-d8d3-400b-afb9-08930e35d321 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:11.754938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 746/1497] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:54:11 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:54:11.759475 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615d872-d807-4e5f-8076-8156180e442e admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:11.770376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615d872-d807-4e5f-8076-8156180e442e admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:11.828394 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea08660-59ac-4ca9-8d2a-816352c15c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:11.829100 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea08660-59ac-4ca9-8d2a-816352c15c74 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:11.829387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea08660-59ac-4ca9-8d2a-816352c15c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:11.829667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea08660-59ac-4ca9-8d2a-816352c15c74 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:11.830357 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea08660-59ac-4ca9-8d2a-816352c15c74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:11.831423 dv-cinder-846146-4-smb devstack@keystone.service[92004]: WARNING py.warnings [None req-8ea08660-59ac-4ca9-8d2a-816352c15c74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:54:11.831423 dv-cinder-846146-4-smb devstack@keystone.service[92004]: warnings.warn(msg) Jun 23 10:54:11.831423 dv-cinder-846146-4-smb devstack@keystone.service[92004]: Jun 23 10:54:11.832617 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea08660-59ac-4ca9-8d2a-816352c15c74 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:11.914742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 752/1498] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:54:11 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:54:11.920719 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed3adf-d8d3-400b-afb9-08930e35d321 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:11.937272 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed3adf-d8d3-400b-afb9-08930e35d321 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:11.943705 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b59f9-0e9c-487b-b861-0d730eff5ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:11.944591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b59f9-0e9c-487b-b861-0d730eff5ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:11.944915 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b59f9-0e9c-487b-b861-0d730eff5ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:11.945285 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b59f9-0e9c-487b-b861-0d730eff5ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:11.946546 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b59f9-0e9c-487b-b861-0d730eff5ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:11.948175 dv-cinder-846146-4-smb devstack@keystone.service[92003]: WARNING py.warnings [None req-9e3b59f9-0e9c-487b-b861-0d730eff5ce6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:54:11.948175 dv-cinder-846146-4-smb devstack@keystone.service[92003]: warnings.warn(msg) Jun 23 10:54:11.948175 dv-cinder-846146-4-smb devstack@keystone.service[92003]: Jun 23 10:54:11.949642 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b59f9-0e9c-487b-b861-0d730eff5ce6 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:11.966496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 747/1499] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:54:11.970998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea08660-59ac-4ca9-8d2a-816352c15c74 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:11.982115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea08660-59ac-4ca9-8d2a-816352c15c74 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:11.987335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ba6b3-3125-499b-a733-83593846a619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:11.988100 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ba6b3-3125-499b-a733-83593846a619 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:11.988475 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ba6b3-3125-499b-a733-83593846a619 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:11.988876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ba6b3-3125-499b-a733-83593846a619 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:11.989757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ba6b3-3125-499b-a733-83593846a619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:11.990908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: WARNING py.warnings [None req-6c3ba6b3-3125-499b-a733-83593846a619 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:54:11.990908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: warnings.warn(msg) Jun 23 10:54:11.990908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: Jun 23 10:54:11.992683 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ba6b3-3125-499b-a733-83593846a619 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:12.006484 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 753/1500] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:54:12.011124 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b59f9-0e9c-487b-b861-0d730eff5ce6 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:12.023562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b59f9-0e9c-487b-b861-0d730eff5ce6 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:12.028774 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cad217-7067-4428-a815-9863762d46e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:12.029667 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad217-7067-4428-a815-9863762d46e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:12.029976 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad217-7067-4428-a815-9863762d46e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:12.030291 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad217-7067-4428-a815-9863762d46e3 admin admin] PATH_INFO: `/v3/projects/4e20bfbe4ad2419f979ac3543671050a/users/93acd6745e1b449596a0a0fc15cda50d/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:12.046897 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cad217-7067-4428-a815-9863762d46e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e20bfbe4ad2419f979ac3543671050a, user_id=93acd6745e1b449596a0a0fc15cda50d, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:12.048689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: WARNING py.warnings [None req-a3cad217-7067-4428-a815-9863762d46e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:54:12.048689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: warnings.warn(msg) Jun 23 10:54:12.048689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: Jun 23 10:54:12.052198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cad217-7067-4428-a815-9863762d46e3 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:12.119593 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 748/1501] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:54:12 2022] PUT /identity/v3/projects/4e20bfbe4ad2419f979ac3543671050a/users/93acd6745e1b449596a0a0fc15cda50d/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:54:12.131480 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3528820-02dd-4104-91b5-937168d5070c None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:12.131807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3528820-02dd-4104-91b5-937168d5070c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:12.132111 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3528820-02dd-4104-91b5-937168d5070c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:12.159322 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-a3528820-02dd-4104-91b5-937168d5070c None None] MFA Rules not processed for user `93acd6745e1b449596a0a0fc15cda50d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:54:12.160530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a3528820-02dd-4104-91b5-937168d5070c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:12.227605 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 754/1502] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:54:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:54:12.240834 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef6da0-4e74-4b82-a461-4bdf640666b3 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:12.241263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef6da0-4e74-4b82-a461-4bdf640666b3 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:12.241548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef6da0-4e74-4b82-a461-4bdf640666b3 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:12.242904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 749/1503] 10.222.0.20 () {54 vars in 963 bytes} [Thu Jun 23 10:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:54:12.248028 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101729e-c215-4cd3-a5e4-28542dceec35 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:12.248321 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101729e-c215-4cd3-a5e4-28542dceec35 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:12.248621 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101729e-c215-4cd3-a5e4-28542dceec35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:12.266234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-4101729e-c215-4cd3-a5e4-28542dceec35 None None] MFA Rules not processed for user `d804e11eb85e4050adaecfbaaa6e5a12`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:54:12.267424 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4101729e-c215-4cd3-a5e4-28542dceec35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:12.311763 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:12.318878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 755/1504] 10.222.0.20 () {58 vars in 1060 bytes} [Thu Jun 23 10:54:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:54:12.326946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef6da0-4e74-4b82-a461-4bdf640666b3 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:12.338218 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef6da0-4e74-4b82-a461-4bdf640666b3 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:12.341781 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f02e25-ce0d-4551-9131-fdd884ea3e2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:12.342421 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f02e25-ce0d-4551-9131-fdd884ea3e2f service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:12.342711 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f02e25-ce0d-4551-9131-fdd884ea3e2f service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:12.342994 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f02e25-ce0d-4551-9131-fdd884ea3e2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:12.353311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f02e25-ce0d-4551-9131-fdd884ea3e2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:12.354756 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f02e25-ce0d-4551-9131-fdd884ea3e2f service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:12.363934 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 750/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:54:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:54:12.407614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f35d99-9a19-401f-9064-39e5f639c42d None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:12.407902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f35d99-9a19-401f-9064-39e5f639c42d None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:12.408183 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f35d99-9a19-401f-9064-39e5f639c42d None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:12.409507 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 756/1506] 10.222.0.20 () {52 vars in 829 bytes} [Thu Jun 23 10:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:54:12.413321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f02e25-ce0d-4551-9131-fdd884ea3e2f service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:12.475244 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f02e25-ce0d-4551-9131-fdd884ea3e2f service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:12.480627 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587afc9-0966-4337-8b14-0f2f943db190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:12.481531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587afc9-0966-4337-8b14-0f2f943db190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:12.481816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587afc9-0966-4337-8b14-0f2f943db190 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:12.482092 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587afc9-0966-4337-8b14-0f2f943db190 admin admin] PATH_INFO: `/v3/users/93acd6745e1b449596a0a0fc15cda50d` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:12.483383 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587afc9-0966-4337-8b14-0f2f943db190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93acd6745e1b449596a0a0fc15cda50d)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:12.484412 dv-cinder-846146-4-smb devstack@keystone.service[92003]: WARNING py.warnings [None req-c587afc9-0966-4337-8b14-0f2f943db190 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:54:12.484412 dv-cinder-846146-4-smb devstack@keystone.service[92003]: warnings.warn(msg) Jun 23 10:54:12.484412 dv-cinder-846146-4-smb devstack@keystone.service[92003]: Jun 23 10:54:12.485711 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587afc9-0966-4337-8b14-0f2f943db190 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:12.654197 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c587afc9-0966-4337-8b14-0f2f943db190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93acd6745e1b449596a0a0fc15cda50d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:12.666737 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c587afc9-0966-4337-8b14-0f2f943db190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93acd6745e1b449596a0a0fc15cda50d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:12.718981 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c587afc9-0966-4337-8b14-0f2f943db190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93acd6745e1b449596a0a0fc15cda50d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:12.719615 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c587afc9-0966-4337-8b14-0f2f943db190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93acd6745e1b449596a0a0fc15cda50d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:12.720353 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c587afc9-0966-4337-8b14-0f2f943db190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93acd6745e1b449596a0a0fc15cda50d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:12.737851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:12.747734 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 751/1507] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:54:12 2022] DELETE /identity/v3/users/93acd6745e1b449596a0a0fc15cda50d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:54:12.752220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76670f6-20e7-48fc-bf16-bd00982ab7da None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:12.752726 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76670f6-20e7-48fc-bf16-bd00982ab7da None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:12.752838 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76670f6-20e7-48fc-bf16-bd00982ab7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:12.772312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-a76670f6-20e7-48fc-bf16-bd00982ab7da None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:54:12.774046 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a76670f6-20e7-48fc-bf16-bd00982ab7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:12.859349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 757/1508] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:54:12.908296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587afc9-0966-4337-8b14-0f2f943db190 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:12.909795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c587afc9-0966-4337-8b14-0f2f943db190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:12.970698 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587afc9-0966-4337-8b14-0f2f943db190 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:12.974325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b77ec-2841-421d-a78c-5223b3a82000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:12.974989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b77ec-2841-421d-a78c-5223b3a82000 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:12.975277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b77ec-2841-421d-a78c-5223b3a82000 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:12.975610 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b77ec-2841-421d-a78c-5223b3a82000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:12.985162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b77ec-2841-421d-a78c-5223b3a82000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:12.986610 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b77ec-2841-421d-a78c-5223b3a82000 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:13.000376 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 752/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:54:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:54:13.576777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76670f6-20e7-48fc-bf16-bd00982ab7da None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:13.578211 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a76670f6-20e7-48fc-bf16-bd00982ab7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:13.590627 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76670f6-20e7-48fc-bf16-bd00982ab7da None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:13.595141 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14afb2-fb86-43a9-856c-939bd18343d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:13.596013 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14afb2-fb86-43a9-856c-939bd18343d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:13.596293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14afb2-fb86-43a9-856c-939bd18343d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:13.596565 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14afb2-fb86-43a9-856c-939bd18343d0 admin admin] PATH_INFO: `/v3/projects/4e20bfbe4ad2419f979ac3543671050a` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:13.597784 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14afb2-fb86-43a9-856c-939bd18343d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e20bfbe4ad2419f979ac3543671050a)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:13.598810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: WARNING py.warnings [None req-af14afb2-fb86-43a9-856c-939bd18343d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:54:13.598810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: warnings.warn(msg) Jun 23 10:54:13.598810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: Jun 23 10:54:13.599995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14afb2-fb86-43a9-856c-939bd18343d0 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:13.722918 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-af14afb2-fb86-43a9-856c-939bd18343d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e20bfbe4ad2419f979ac3543671050a', 'request_id': 'req-af14afb2-fb86-43a9-856c-939bd18343d0'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:13.827625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-af14afb2-fb86-43a9-856c-939bd18343d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e20bfbe4ad2419f979ac3543671050a', 'request_id': 'req-af14afb2-fb86-43a9-856c-939bd18343d0'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:13.834310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-af14afb2-fb86-43a9-856c-939bd18343d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e20bfbe4ad2419f979ac3543671050a', 'request_id': 'req-af14afb2-fb86-43a9-856c-939bd18343d0'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:13.854607 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-af14afb2-fb86-43a9-856c-939bd18343d0 admin admin] The token cache is being invalidate because project 4e20bfbe4ad2419f979ac3543671050a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:54:13.854965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-af14afb2-fb86-43a9-856c-939bd18343d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:13.855906 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-af14afb2-fb86-43a9-856c-939bd18343d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:13.857497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 758/1510] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:54:13 2022] DELETE /identity/v3/projects/4e20bfbe4ad2419f979ac3543671050a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:54:22.995643 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:23.850558 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:00.224017 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755bb65-3d05-4b95-ae83-6fe8672681a1 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:00.224586 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755bb65-3d05-4b95-ae83-6fe8672681a1 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:00.224586 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755bb65-3d05-4b95-ae83-6fe8672681a1 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:00.226110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:56:00.231366 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bca77-0b38-49cc-ad12-336b3020385a None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:00.231869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bca77-0b38-49cc-ad12-336b3020385a None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:00.231975 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bca77-0b38-49cc-ad12-336b3020385a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:00.251795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-6b1bca77-0b38-49cc-ad12-336b3020385a None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:56:00.253043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-6b1bca77-0b38-49cc-ad12-336b3020385a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:00.316332 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:56:00.475886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755bb65-3d05-4b95-ae83-6fe8672681a1 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:00.477525 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6755bb65-3d05-4b95-ae83-6fe8672681a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:00.558923 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755bb65-3d05-4b95-ae83-6fe8672681a1 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:00.564428 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebaecc3-d275-4a90-b212-30280a3c30d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:00.565158 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebaecc3-d275-4a90-b212-30280a3c30d9 service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:00.565511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebaecc3-d275-4a90-b212-30280a3c30d9 service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:00.565746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebaecc3-d275-4a90-b212-30280a3c30d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:00.575110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebaecc3-d275-4a90-b212-30280a3c30d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:00.576816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebaecc3-d275-4a90-b212-30280a3c30d9 service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:00.587365 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 754/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:56:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:56:01.431551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608ceac-2f99-4935-a973-1b66d4a56d57 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:01.432097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608ceac-2f99-4935-a973-1b66d4a56d57 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:01.432097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608ceac-2f99-4935-a973-1b66d4a56d57 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:01.433530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:56:01.438267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b438d5-1ef4-4f13-a206-a1acc0d45a3d None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:01.438666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b438d5-1ef4-4f13-a206-a1acc0d45a3d None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:01.438854 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b438d5-1ef4-4f13-a206-a1acc0d45a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:01.457367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-b2b438d5-1ef4-4f13-a206-a1acc0d45a3d None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:56:01.458666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b2b438d5-1ef4-4f13-a206-a1acc0d45a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:01.467549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:56:01.633706 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608ceac-2f99-4935-a973-1b66d4a56d57 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:01.648616 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608ceac-2f99-4935-a973-1b66d4a56d57 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:01.654097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bebcc-fb7b-485e-b67f-8558882adec7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:01.654743 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bebcc-fb7b-485e-b67f-8558882adec7 service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:01.655030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bebcc-fb7b-485e-b67f-8558882adec7 service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:01.655314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bebcc-fb7b-485e-b67f-8558882adec7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:01.664479 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bebcc-fb7b-485e-b67f-8558882adec7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:01.666123 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bebcc-fb7b-485e-b67f-8558882adec7 service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:01.675556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 761/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:56:02.025901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aea6d6-f8e3-40b6-ab79-4643540ab8d0 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:02.026138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aea6d6-f8e3-40b6-ab79-4643540ab8d0 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:02.026388 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aea6d6-f8e3-40b6-ab79-4643540ab8d0 None None] PATH_INFO: `/v3` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:02.027704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 756/1517] 10.222.0.48 () {54 vars in 925 bytes} [Thu Jun 23 10:56:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:56:02.034513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce18cf-7690-4a56-b737-a622f3a828a7 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:02.034803 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce18cf-7690-4a56-b737-a622f3a828a7 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:02.035084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce18cf-7690-4a56-b737-a622f3a828a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:02.054452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-52ce18cf-7690-4a56-b737-a622f3a828a7 None None] MFA Rules not processed for user `6ff588aaad264f9cbc5a80e73ef0c09d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:56:02.055691 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-52ce18cf-7690-4a56-b737-a622f3a828a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:02.133141 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 762/1518] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Jun 23 10:56:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:56:06.194683 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10836765-2f3c-44f5-9d49-46db3261f735 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:06.195708 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10836765-2f3c-44f5-9d49-46db3261f735 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:06.196005 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10836765-2f3c-44f5-9d49-46db3261f735 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:06.197462 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 757/1519] 10.222.0.20 () {54 vars in 960 bytes} [Thu Jun 23 10:56:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:56:06.202786 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4ff10-57df-43f7-97d0-b263e2652470 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:06.203313 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4ff10-57df-43f7-97d0-b263e2652470 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:06.203419 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4ff10-57df-43f7-97d0-b263e2652470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:06.221433 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-5bd4ff10-57df-43f7-97d0-b263e2652470 None None] MFA Rules not processed for user `6ff588aaad264f9cbc5a80e73ef0c09d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:56:06.222662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-5bd4ff10-57df-43f7-97d0-b263e2652470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:06.231765 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 763/1520] 10.222.0.20 () {58 vars in 1057 bytes} [Thu Jun 23 10:56:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:56:06.239712 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10836765-2f3c-44f5-9d49-46db3261f735 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:06.254757 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10836765-2f3c-44f5-9d49-46db3261f735 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:06.260455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f20d0f-7746-48cf-9cb9-e427188a4f1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff588aaad264f9cbc5a80e73ef0c09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:06.261132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f20d0f-7746-48cf-9cb9-e427188a4f1b service placement] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:06.261414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f20d0f-7746-48cf-9cb9-e427188a4f1b service placement] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:06.261691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f20d0f-7746-48cf-9cb9-e427188a4f1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:06.270725 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f20d0f-7746-48cf-9cb9-e427188a4f1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:06.272337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f20d0f-7746-48cf-9cb9-e427188a4f1b service placement] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:06.282197 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 758/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:56:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:56:12.940092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5680f52-5428-4834-9568-f8afad7e9555 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:12.940620 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5680f52-5428-4834-9568-f8afad7e9555 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:12.940620 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5680f52-5428-4834-9568-f8afad7e9555 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:12.941986 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:56:12.946966 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f846b-1d6b-4690-a6b9-7a6920b5d31c None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:12.947422 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f846b-1d6b-4690-a6b9-7a6920b5d31c None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:12.947569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f846b-1d6b-4690-a6b9-7a6920b5d31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:12.967124 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-b58f846b-1d6b-4690-a6b9-7a6920b5d31c None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:56:12.968320 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b58f846b-1d6b-4690-a6b9-7a6920b5d31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:12.976445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:56:13.130136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5680f52-5428-4834-9568-f8afad7e9555 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:13.145132 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5680f52-5428-4834-9568-f8afad7e9555 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:13.150650 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a874a-f8cc-4e03-bc4f-015749d952bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:13.151334 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a874a-f8cc-4e03-bc4f-015749d952bd service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:13.151620 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a874a-f8cc-4e03-bc4f-015749d952bd service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:13.151894 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a874a-f8cc-4e03-bc4f-015749d952bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:13.160243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a874a-f8cc-4e03-bc4f-015749d952bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:13.161957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a874a-f8cc-4e03-bc4f-015749d952bd service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:13.171635 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 765/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:56:13.992590 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647cbd6-46f3-4069-95be-5c4dd69e11c4 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:13.993140 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647cbd6-46f3-4069-95be-5c4dd69e11c4 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:13.993140 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647cbd6-46f3-4069-95be-5c4dd69e11c4 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:13.994485 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:56:14.000003 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff1b3a-0dc1-44bd-9d9d-0e27100abea0 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:14.000405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff1b3a-0dc1-44bd-9d9d-0e27100abea0 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:14.000582 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff1b3a-0dc1-44bd-9d9d-0e27100abea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:14.019165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-66ff1b3a-0dc1-44bd-9d9d-0e27100abea0 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:56:14.020352 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-66ff1b3a-0dc1-44bd-9d9d-0e27100abea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:14.028031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:56:14.180594 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647cbd6-46f3-4069-95be-5c4dd69e11c4 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:14.196067 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647cbd6-46f3-4069-95be-5c4dd69e11c4 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:14.201869 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b1849-272b-40ff-a94e-7fa0415fac8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:14.202518 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b1849-272b-40ff-a94e-7fa0415fac8d service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:14.202805 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b1849-272b-40ff-a94e-7fa0415fac8d service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:14.203086 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b1849-272b-40ff-a94e-7fa0415fac8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:14.211590 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b1849-272b-40ff-a94e-7fa0415fac8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:14.213245 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b1849-272b-40ff-a94e-7fa0415fac8d service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:14.222835 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 761/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:56:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:56:18.425262 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963e45a-97e7-40c2-a14f-98245822d7c3 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:18.425853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963e45a-97e7-40c2-a14f-98245822d7c3 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:18.425853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963e45a-97e7-40c2-a14f-98245822d7c3 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:18.427330 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:56:18.433326 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f1935-c0eb-4405-a329-997867faeb47 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:18.433815 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f1935-c0eb-4405-a329-997867faeb47 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:18.434110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f1935-c0eb-4405-a329-997867faeb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:18.453769 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-e51f1935-c0eb-4405-a329-997867faeb47 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:56:18.455009 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e51f1935-c0eb-4405-a329-997867faeb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:18.463276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:56:18.503744 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963e45a-97e7-40c2-a14f-98245822d7c3 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:18.505520 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c963e45a-97e7-40c2-a14f-98245822d7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:18.572044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963e45a-97e7-40c2-a14f-98245822d7c3 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:18.577688 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20ccb6-9139-4205-b1a3-759739d83248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:18.578351 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20ccb6-9139-4205-b1a3-759739d83248 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:18.578668 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20ccb6-9139-4205-b1a3-759739d83248 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:18.578951 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20ccb6-9139-4205-b1a3-759739d83248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:18.588578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20ccb6-9139-4205-b1a3-759739d83248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:18.590784 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20ccb6-9139-4205-b1a3-759739d83248 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:18.595785 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:18.600932 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 768/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:56:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:56:20.738492 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf10af-e4b2-4232-bda8-ec2303e2cb58 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:20.739025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf10af-e4b2-4232-bda8-ec2303e2cb58 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:20.739143 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf10af-e4b2-4232-bda8-ec2303e2cb58 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:20.740482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:56:20.746128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd59dbe-0722-4821-84c1-3e415e2f76eb None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:20.746614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd59dbe-0722-4821-84c1-3e415e2f76eb None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:20.746711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd59dbe-0722-4821-84c1-3e415e2f76eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:20.764890 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-7dd59dbe-0722-4821-84c1-3e415e2f76eb None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:56:20.766113 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-7dd59dbe-0722-4821-84c1-3e415e2f76eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:20.774262 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:56:20.812099 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf10af-e4b2-4232-bda8-ec2303e2cb58 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:20.822720 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf10af-e4b2-4232-bda8-ec2303e2cb58 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:20.826302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b6b89-5881-4b62-b571-feec439be276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:20.826936 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b6b89-5881-4b62-b571-feec439be276 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:20.827218 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b6b89-5881-4b62-b571-feec439be276 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:20.827494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b6b89-5881-4b62-b571-feec439be276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:20.836600 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b6b89-5881-4b62-b571-feec439be276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:20.838044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b6b89-5881-4b62-b571-feec439be276 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:20.848200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 764/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:56:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:56:24.614084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9fc02-038a-43de-916b-af945b872b7d None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:24.614774 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9fc02-038a-43de-916b-af945b872b7d None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:24.614774 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9fc02-038a-43de-916b-af945b872b7d None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:24.616060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:56:24.623705 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9dc7a8-76b4-4f93-8ecb-30478ef56645 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:24.624242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9dc7a8-76b4-4f93-8ecb-30478ef56645 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:24.624242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9dc7a8-76b4-4f93-8ecb-30478ef56645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:24.631031 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=62 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:24.648870 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-dc9dc7a8-76b4-4f93-8ecb-30478ef56645 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:56:24.650098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-dc9dc7a8-76b4-4f93-8ecb-30478ef56645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:24.658324 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:56:24.981121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9fc02-038a-43de-916b-af945b872b7d None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:24.982991 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-05a9fc02-038a-43de-916b-af945b872b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:25.055202 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9fc02-038a-43de-916b-af945b872b7d None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:25.060065 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e664da2-46cd-419a-80f9-e8af2ad3d0ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:25.060664 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e664da2-46cd-419a-80f9-e8af2ad3d0ff service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:25.061248 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e664da2-46cd-419a-80f9-e8af2ad3d0ff service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:25.061533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e664da2-46cd-419a-80f9-e8af2ad3d0ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:25.072766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e664da2-46cd-419a-80f9-e8af2ad3d0ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:25.075025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e664da2-46cd-419a-80f9-e8af2ad3d0ff service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:25.086667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 771/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:56:27.229518 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69053f26-1b06-492e-adaa-69848a4d8c10 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:27.230202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69053f26-1b06-492e-adaa-69848a4d8c10 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:27.230202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69053f26-1b06-492e-adaa-69848a4d8c10 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:27.231685 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:56:27.238181 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daa7d4-ebfa-48ed-8fc5-963616f1b662 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:27.238793 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daa7d4-ebfa-48ed-8fc5-963616f1b662 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:27.238793 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daa7d4-ebfa-48ed-8fc5-963616f1b662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:27.259669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-c2daa7d4-ebfa-48ed-8fc5-963616f1b662 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:56:27.261778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c2daa7d4-ebfa-48ed-8fc5-963616f1b662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:27.269974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:56:27.597954 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69053f26-1b06-492e-adaa-69848a4d8c10 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:27.599701 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-69053f26-1b06-492e-adaa-69848a4d8c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:27.618272 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69053f26-1b06-492e-adaa-69848a4d8c10 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:27.623170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1765d-8345-408e-bc68-688848b4da97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:27.623835 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1765d-8345-408e-bc68-688848b4da97 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:27.624121 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1765d-8345-408e-bc68-688848b4da97 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:27.624399 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1765d-8345-408e-bc68-688848b4da97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:27.634453 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1765d-8345-408e-bc68-688848b4da97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:27.636610 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1765d-8345-408e-bc68-688848b4da97 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:27.647308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 767/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:56:37.252169 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=32 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:37.642367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=8 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:00.008270 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7704430-fe0f-4587-ab09-f0529647ba7b None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.010018 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7704430-fe0f-4587-ab09-f0529647ba7b None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.010018 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7704430-fe0f-4587-ab09-f0529647ba7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.040703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-e7704430-fe0f-4587-ab09-f0529647ba7b None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:00.041985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e7704430-fe0f-4587-ab09-f0529647ba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:00.057469 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 773/1540] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:58:00.069000 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35a782-84df-4a3a-b437-24f43c82f08a None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.069829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35a782-84df-4a3a-b437-24f43c82f08a None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.070725 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35a782-84df-4a3a-b437-24f43c82f08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.107176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-1f35a782-84df-4a3a-b437-24f43c82f08a None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:00.108959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-1f35a782-84df-4a3a-b437-24f43c82f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:00.132010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 768/1541] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:00.142707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7704430-fe0f-4587-ab09-f0529647ba7b None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:00.158967 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7704430-fe0f-4587-ab09-f0529647ba7b None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:00.164418 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabfa2f-207c-4e82-8716-7e813779b091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:00.165596 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabfa2f-207c-4e82-8716-7e813779b091 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.166778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabfa2f-207c-4e82-8716-7e813779b091 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.167295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabfa2f-207c-4e82-8716-7e813779b091 admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.168864 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabfa2f-207c-4e82-8716-7e813779b091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:58:00.169455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabfa2f-207c-4e82-8716-7e813779b091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:00.170678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac675edc-0e47-4039-b116-0bedbd930d45 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.170981 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac675edc-0e47-4039-b116-0bedbd930d45 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.171274 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac675edc-0e47-4039-b116-0bedbd930d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.172263 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabfa2f-207c-4e82-8716-7e813779b091 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:00.192341 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 774/1542] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:58:00.204969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabfa2f-207c-4e82-8716-7e813779b091 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:00.207346 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-ac675edc-0e47-4039-b116-0bedbd930d45 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:00.208661 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ac675edc-0e47-4039-b116-0bedbd930d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:00.219153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabfa2f-207c-4e82-8716-7e813779b091 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:00.228911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 769/1543] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:00.230496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009db8ce-02f6-4940-9bcc-18f83db24237 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.230909 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009db8ce-02f6-4940-9bcc-18f83db24237 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.231214 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009db8ce-02f6-4940-9bcc-18f83db24237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.231703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c32ada-798d-4344-be24-381da4fe2854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:00.232779 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c32ada-798d-4344-be24-381da4fe2854 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.233376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c32ada-798d-4344-be24-381da4fe2854 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.233892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c32ada-798d-4344-be24-381da4fe2854 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.234928 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c32ada-798d-4344-be24-381da4fe2854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:00.236310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: WARNING py.warnings [None req-37c32ada-798d-4344-be24-381da4fe2854 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:58:00.236310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: warnings.warn(msg) Jun 23 10:58:00.236310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: Jun 23 10:58:00.238028 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c32ada-798d-4344-be24-381da4fe2854 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:00.273169 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-009db8ce-02f6-4940-9bcc-18f83db24237 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:00.275216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-009db8ce-02f6-4940-9bcc-18f83db24237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:00.293125 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 770/1544] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:00.294626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac2b04-f605-4702-b2a7-744dca1b6bd1 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.294996 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac2b04-f605-4702-b2a7-744dca1b6bd1 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.295334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac2b04-f605-4702-b2a7-744dca1b6bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.325003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-63ac2b04-f605-4702-b2a7-744dca1b6bd1 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:00.326339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-63ac2b04-f605-4702-b2a7-744dca1b6bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:00.340137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 775/1545] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/projects => generated 393 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:58:00.342222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225ccac-50b8-49d5-ac31-b2ace150bc10 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.347784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 771/1546] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:00.347784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f4116-749b-4bb1-93d2-fb682b553626 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.347784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f4116-749b-4bb1-93d2-fb682b553626 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.347784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f4116-749b-4bb1-93d2-fb682b553626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.349255 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225ccac-50b8-49d5-ac31-b2ace150bc10 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.354130 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225ccac-50b8-49d5-ac31-b2ace150bc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.372893 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-9225ccac-50b8-49d5-ac31-b2ace150bc10 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:00.374501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-9225ccac-50b8-49d5-ac31-b2ace150bc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:00.378750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-7f8f4116-749b-4bb1-93d2-fb682b553626 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:00.380126 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-7f8f4116-749b-4bb1-93d2-fb682b553626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:00.445296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 776/1547] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:00.447246 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655b2eb-52a9-4f58-84dd-71688a0e0507 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.447759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655b2eb-52a9-4f58-84dd-71688a0e0507 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.448223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655b2eb-52a9-4f58-84dd-71688a0e0507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.457448 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 772/1548] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:00.458307 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f4116-749b-4bb1-93d2-fb682b553626 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:00.468220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-6655b2eb-52a9-4f58-84dd-71688a0e0507 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:00.469160 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f4116-749b-4bb1-93d2-fb682b553626 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:00.469623 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-6655b2eb-52a9-4f58-84dd-71688a0e0507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:00.473847 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f20c3-ade0-48fb-9bba-29683c69f893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:00.474531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f20c3-ade0-48fb-9bba-29683c69f893 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.474824 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f20c3-ade0-48fb-9bba-29683c69f893 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.475361 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f20c3-ade0-48fb-9bba-29683c69f893 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.476063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f20c3-ade0-48fb-9bba-29683c69f893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:00.477797 dv-cinder-846146-4-smb devstack@keystone.service[92003]: WARNING py.warnings [None req-967f20c3-ade0-48fb-9bba-29683c69f893 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:58:00.477797 dv-cinder-846146-4-smb devstack@keystone.service[92003]: warnings.warn(msg) Jun 23 10:58:00.477797 dv-cinder-846146-4-smb devstack@keystone.service[92003]: Jun 23 10:58:00.479184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 777/1549] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:00.479325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f20c3-ade0-48fb-9bba-29683c69f893 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:00.480264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5dd62-fd5a-46fa-8c35-927c377f2af8 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.480555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5dd62-fd5a-46fa-8c35-927c377f2af8 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.480872 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5dd62-fd5a-46fa-8c35-927c377f2af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.499452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-91f5dd62-fd5a-46fa-8c35-927c377f2af8 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:00.501252 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-91f5dd62-fd5a-46fa-8c35-927c377f2af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:00.508860 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 778/1550] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:00.509779 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5dd62-fd5a-46fa-8c35-927c377f2af8 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:00.522805 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5dd62-fd5a-46fa-8c35-927c377f2af8 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:00.528012 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad58a98-a628-4091-a3ae-bf535f0daa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:00.528714 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad58a98-a628-4091-a3ae-bf535f0daa49 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.529003 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad58a98-a628-4091-a3ae-bf535f0daa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.529283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad58a98-a628-4091-a3ae-bf535f0daa49 admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.530080 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad58a98-a628-4091-a3ae-bf535f0daa49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:58:00.530391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad58a98-a628-4091-a3ae-bf535f0daa49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:00.532053 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad58a98-a628-4091-a3ae-bf535f0daa49 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:00.547230 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 779/1551] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:58:00.549387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd5bdd-d5f7-4841-86aa-0d913533f31d None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.549906 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd5bdd-d5f7-4841-86aa-0d913533f31d None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.550307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd5bdd-d5f7-4841-86aa-0d913533f31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.557152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 773/1552] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:00.557152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbaa4c-b0b7-491f-81bc-0d038a364af9 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.557152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbaa4c-b0b7-491f-81bc-0d038a364af9 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.557628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbaa4c-b0b7-491f-81bc-0d038a364af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.579230 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-32dd5bdd-d5f7-4841-86aa-0d913533f31d None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:00.581262 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-32dd5bdd-d5f7-4841-86aa-0d913533f31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:00.585988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-73fbaa4c-b0b7-491f-81bc-0d038a364af9 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:00.587964 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-73fbaa4c-b0b7-491f-81bc-0d038a364af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:00.593436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 780/1553] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:00.594824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd5bdd-d5f7-4841-86aa-0d913533f31d None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:00.615031 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 774/1554] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:00.615031 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2683557-79b5-46ed-ac3d-53b95656c1d8 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.615031 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2683557-79b5-46ed-ac3d-53b95656c1d8 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.615031 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2683557-79b5-46ed-ac3d-53b95656c1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.615570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd5bdd-d5f7-4841-86aa-0d913533f31d None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:00.623113 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25acdd9-e2a1-4398-85c4-409aee88c439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:00.623821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25acdd9-e2a1-4398-85c4-409aee88c439 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.624135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25acdd9-e2a1-4398-85c4-409aee88c439 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.624409 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25acdd9-e2a1-4398-85c4-409aee88c439 admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.625189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25acdd9-e2a1-4398-85c4-409aee88c439 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:58:00.625498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25acdd9-e2a1-4398-85c4-409aee88c439 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:00.627121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25acdd9-e2a1-4398-85c4-409aee88c439 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:00.637727 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-f2683557-79b5-46ed-ac3d-53b95656c1d8 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:00.638975 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-f2683557-79b5-46ed-ac3d-53b95656c1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:00.639848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 781/1555] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:58:00.641469 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168f63f-2196-41d6-a678-c5c5a5abc2d1 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.641682 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168f63f-2196-41d6-a678-c5c5a5abc2d1 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.641944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168f63f-2196-41d6-a678-c5c5a5abc2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.654054 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 775/1556] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:00.657798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df176f-7e52-4900-aa3e-679a4871afae None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.657798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df176f-7e52-4900-aa3e-679a4871afae None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.657798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df176f-7e52-4900-aa3e-679a4871afae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.664153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-f168f63f-2196-41d6-a678-c5c5a5abc2d1 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:00.668942 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f168f63f-2196-41d6-a678-c5c5a5abc2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:00.675093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-23df176f-7e52-4900-aa3e-679a4871afae None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:00.676249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-23df176f-7e52-4900-aa3e-679a4871afae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:00.684376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 782/1557] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:00.685392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 776/1558] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:00.685924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df176f-7e52-4900-aa3e-679a4871afae None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:00.689334 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168f63f-2196-41d6-a678-c5c5a5abc2d1 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:00.697668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df176f-7e52-4900-aa3e-679a4871afae None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:00.701010 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168f63f-2196-41d6-a678-c5c5a5abc2d1 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:00.703063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae501c4-4aff-4b2d-8016-858958bcbd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:00.703873 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae501c4-4aff-4b2d-8016-858958bcbd89 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.704343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae501c4-4aff-4b2d-8016-858958bcbd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.704811 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae501c4-4aff-4b2d-8016-858958bcbd89 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.705669 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae501c4-4aff-4b2d-8016-858958bcbd89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:00.705865 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903bf6dc-7c69-4ad7-8acd-2fa9b22bf366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:00.706514 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bf6dc-7c69-4ad7-8acd-2fa9b22bf366 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.706797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bf6dc-7c69-4ad7-8acd-2fa9b22bf366 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.707070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bf6dc-7c69-4ad7-8acd-2fa9b22bf366 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.707806 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903bf6dc-7c69-4ad7-8acd-2fa9b22bf366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:00.708414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae501c4-4aff-4b2d-8016-858958bcbd89 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:00.709470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903bf6dc-7c69-4ad7-8acd-2fa9b22bf366 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:00.720943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 783/1559] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:00.722264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7cd2-c416-4b68-9a66-8c5338bdf9a8 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.722560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7cd2-c416-4b68-9a66-8c5338bdf9a8 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.722840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7cd2-c416-4b68-9a66-8c5338bdf9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.745778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-331d7cd2-c416-4b68-9a66-8c5338bdf9a8 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:00.747009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-331d7cd2-c416-4b68-9a66-8c5338bdf9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:00.754886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 784/1560] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:00.759318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e58ae-8156-4833-aeb6-104607550bad None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.759318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e58ae-8156-4833-aeb6-104607550bad None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.759318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e58ae-8156-4833-aeb6-104607550bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.775993 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-129e58ae-8156-4833-aeb6-104607550bad None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:00.777237 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-129e58ae-8156-4833-aeb6-104607550bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:00.785128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 785/1561] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:00.785899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e58ae-8156-4833-aeb6-104607550bad None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:00.800457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e58ae-8156-4833-aeb6-104607550bad None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:00.805770 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74499800-e47d-4780-92f0-2348d64aef13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:00.806546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74499800-e47d-4780-92f0-2348d64aef13 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.806890 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74499800-e47d-4780-92f0-2348d64aef13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.807143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74499800-e47d-4780-92f0-2348d64aef13 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.807863 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74499800-e47d-4780-92f0-2348d64aef13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:00.809775 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74499800-e47d-4780-92f0-2348d64aef13 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:00.824334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 777/1562] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:00.827694 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae501c4-4aff-4b2d-8016-858958bcbd89 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:00.888514 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae501c4-4aff-4b2d-8016-858958bcbd89 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:00.893065 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c921d08-bc6d-4ec7-94a0-fdc6c4b9fb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:00.893734 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c921d08-bc6d-4ec7-94a0-fdc6c4b9fb36 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.894022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c921d08-bc6d-4ec7-94a0-fdc6c4b9fb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.894304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c921d08-bc6d-4ec7-94a0-fdc6c4b9fb36 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.895035 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c921d08-bc6d-4ec7-94a0-fdc6c4b9fb36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:58:00.895344 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c921d08-bc6d-4ec7-94a0-fdc6c4b9fb36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:00.896372 dv-cinder-846146-4-smb devstack@keystone.service[92003]: WARNING py.warnings [None req-5c921d08-bc6d-4ec7-94a0-fdc6c4b9fb36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:58:00.896372 dv-cinder-846146-4-smb devstack@keystone.service[92003]: warnings.warn(msg) Jun 23 10:58:00.896372 dv-cinder-846146-4-smb devstack@keystone.service[92003]: Jun 23 10:58:00.897305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c921d08-bc6d-4ec7-94a0-fdc6c4b9fb36 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:00.909944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 786/1563] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:00 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:00.909944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74499800-e47d-4780-92f0-2348d64aef13 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:00.912576 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 778/1564] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:58:00.912576 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c921d08-bc6d-4ec7-94a0-fdc6c4b9fb36 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:00.922038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c921d08-bc6d-4ec7-94a0-fdc6c4b9fb36 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:00.927410 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:00.932722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:00.975652 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74499800-e47d-4780-92f0-2348d64aef13 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:00.980348 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41c2ed-6ea0-4d16-bf30-314d916c11bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:00.981368 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41c2ed-6ea0-4d16-bf30-314d916c11bb admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.981826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41c2ed-6ea0-4d16-bf30-314d916c11bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.982588 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41c2ed-6ea0-4d16-bf30-314d916c11bb admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.983365 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41c2ed-6ea0-4d16-bf30-314d916c11bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:58:00.983675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41c2ed-6ea0-4d16-bf30-314d916c11bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:00.984565 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6b37a-1535-4aa7-a7de-f81a4ee65c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:00.985329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41c2ed-6ea0-4d16-bf30-314d916c11bb admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:00.985684 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6b37a-1535-4aa7-a7de-f81a4ee65c90 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:00.985967 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6b37a-1535-4aa7-a7de-f81a4ee65c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:00.986246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6b37a-1535-4aa7-a7de-f81a4ee65c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:00.986983 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6b37a-1535-4aa7-a7de-f81a4ee65c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:58:00.987289 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6b37a-1535-4aa7-a7de-f81a4ee65c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:00.989122 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6b37a-1535-4aa7-a7de-f81a4ee65c90 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:00.997906 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 787/1565] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:58:00.998758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41c2ed-6ea0-4d16-bf30-314d916c11bb admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:01.006144 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 779/1566] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:58:01.006144 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6b37a-1535-4aa7-a7de-f81a4ee65c90 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:01.009663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41c2ed-6ea0-4d16-bf30-314d916c11bb admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:01.014383 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bbaf0-1c6a-47d1-aec8-da6c98184ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:01.015056 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bbaf0-1c6a-47d1-aec8-da6c98184ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:01.015659 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bbaf0-1c6a-47d1-aec8-da6c98184ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:01.015659 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bbaf0-1c6a-47d1-aec8-da6c98184ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:01.016540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bbaf0-1c6a-47d1-aec8-da6c98184ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:01.017799 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6b37a-1535-4aa7-a7de-f81a4ee65c90 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:01.018326 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bbaf0-1c6a-47d1-aec8-da6c98184ac3 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:01.022666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279e8f7-7ae3-4b82-a285-34327e166b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:01.023327 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279e8f7-7ae3-4b82-a285-34327e166b52 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:01.023614 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279e8f7-7ae3-4b82-a285-34327e166b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:01.023892 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279e8f7-7ae3-4b82-a285-34327e166b52 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:01.024896 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279e8f7-7ae3-4b82-a285-34327e166b52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:58:01.025275 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279e8f7-7ae3-4b82-a285-34327e166b52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:01.027225 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279e8f7-7ae3-4b82-a285-34327e166b52 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:01.032138 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 788/1567] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:01.032138 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bbaf0-1c6a-47d1-aec8-da6c98184ac3 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:01.041578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bbaf0-1c6a-47d1-aec8-da6c98184ac3 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:01.044035 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 780/1568] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:58:01.044780 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279e8f7-7ae3-4b82-a285-34327e166b52 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:01.047697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817af9d-f096-49fb-8bb1-39e5ce07fb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:01.048381 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817af9d-f096-49fb-8bb1-39e5ce07fb31 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:01.048701 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817af9d-f096-49fb-8bb1-39e5ce07fb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:01.048988 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817af9d-f096-49fb-8bb1-39e5ce07fb31 admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:01.049733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817af9d-f096-49fb-8bb1-39e5ce07fb31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:58:01.050046 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817af9d-f096-49fb-8bb1-39e5ce07fb31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:01.051848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817af9d-f096-49fb-8bb1-39e5ce07fb31 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:01.055010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279e8f7-7ae3-4b82-a285-34327e166b52 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:01.060550 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b94f1-03f3-4664-9eb0-cf27197ce276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:01.064828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b94f1-03f3-4664-9eb0-cf27197ce276 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:01.064828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b94f1-03f3-4664-9eb0-cf27197ce276 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:01.064828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b94f1-03f3-4664-9eb0-cf27197ce276 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:01.064828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b94f1-03f3-4664-9eb0-cf27197ce276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:01.064828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b94f1-03f3-4664-9eb0-cf27197ce276 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:01.066035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 789/1569] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:58:01.066949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817af9d-f096-49fb-8bb1-39e5ce07fb31 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:01.082725 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817af9d-f096-49fb-8bb1-39e5ce07fb31 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:01.087854 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3794a96-dfcd-440b-8a95-baf59109b1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:01.088315 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3794a96-dfcd-440b-8a95-baf59109b1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:01.088601 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3794a96-dfcd-440b-8a95-baf59109b1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:01.088910 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3794a96-dfcd-440b-8a95-baf59109b1e8 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:01.089608 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3794a96-dfcd-440b-8a95-baf59109b1e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:01.091553 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3794a96-dfcd-440b-8a95-baf59109b1e8 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:01.159063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 781/1570] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:01 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:01.159925 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b94f1-03f3-4664-9eb0-cf27197ce276 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:01.171010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b94f1-03f3-4664-9eb0-cf27197ce276 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:01.175219 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 790/1571] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:01 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:01.175219 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3794a96-dfcd-440b-8a95-baf59109b1e8 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:01.179056 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958790b9-e8cc-4189-9db6-3667e630bafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:01.179749 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958790b9-e8cc-4189-9db6-3667e630bafe admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:01.180038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958790b9-e8cc-4189-9db6-3667e630bafe admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:01.180918 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958790b9-e8cc-4189-9db6-3667e630bafe admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:01.182088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958790b9-e8cc-4189-9db6-3667e630bafe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:01.184041 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958790b9-e8cc-4189-9db6-3667e630bafe admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:01.186538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3794a96-dfcd-440b-8a95-baf59109b1e8 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:01.191505 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23077780-5cd3-460a-85c9-aa36be0c254f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:01.192173 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23077780-5cd3-460a-85c9-aa36be0c254f admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:01.192474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23077780-5cd3-460a-85c9-aa36be0c254f admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:01.192783 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23077780-5cd3-460a-85c9-aa36be0c254f admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:01.193482 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23077780-5cd3-460a-85c9-aa36be0c254f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:01.195462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23077780-5cd3-460a-85c9-aa36be0c254f admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:01.267344 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 782/1572] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:01 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:01.268256 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958790b9-e8cc-4189-9db6-3667e630bafe admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:01.293165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 791/1573] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:01 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:01.293997 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23077780-5cd3-460a-85c9-aa36be0c254f admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:01.332780 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958790b9-e8cc-4189-9db6-3667e630bafe admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:01.363010 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23077780-5cd3-460a-85c9-aa36be0c254f admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:01.368538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f53109-7543-4e05-a960-c957747f9cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:01.369475 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f53109-7543-4e05-a960-c957747f9cff admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:01.369751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f53109-7543-4e05-a960-c957747f9cff admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:01.370026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f53109-7543-4e05-a960-c957747f9cff admin admin] PATH_INFO: `/v3/projects/867aa0f259454aed9d5aa4e67c76476b/users/935cd7d4575941148be2d56a9fbdb88a/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:01.385309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f53109-7543-4e05-a960-c957747f9cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=867aa0f259454aed9d5aa4e67c76476b, user_id=935cd7d4575941148be2d56a9fbdb88a, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:01.386512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: WARNING py.warnings [None req-50f53109-7543-4e05-a960-c957747f9cff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:58:01.386512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: warnings.warn(msg) Jun 23 10:58:01.386512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: Jun 23 10:58:01.388842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f53109-7543-4e05-a960-c957747f9cff admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:01.390527 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:01.397067 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9095d-ff53-43bb-ab8e-c71b76e4cd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:01.397963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9095d-ff53-43bb-ab8e-c71b76e4cd8f admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:01.398427 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9095d-ff53-43bb-ab8e-c71b76e4cd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:01.401029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9095d-ff53-43bb-ab8e-c71b76e4cd8f admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:01.401029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9095d-ff53-43bb-ab8e-c71b76e4cd8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:01.401497 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9095d-ff53-43bb-ab8e-c71b76e4cd8f admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:01.448349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 792/1574] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:01 2022] PUT /identity/v3/projects/867aa0f259454aed9d5aa4e67c76476b/users/935cd7d4575941148be2d56a9fbdb88a/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:01.449353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f53109-7543-4e05-a960-c957747f9cff admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:01.485391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:01.513010 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f53109-7543-4e05-a960-c957747f9cff admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:01.517894 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a101f-2685-4169-a9f6-af9595c5cf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:01.518534 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a101f-2685-4169-a9f6-af9595c5cf82 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:01.518821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a101f-2685-4169-a9f6-af9595c5cf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:01.519097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a101f-2685-4169-a9f6-af9595c5cf82 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:01.519802 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a101f-2685-4169-a9f6-af9595c5cf82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:01.521818 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a101f-2685-4169-a9f6-af9595c5cf82 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:01.544456 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 783/1575] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:01 2022] POST /identity/v3/projects => generated 383 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:01.545336 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9095d-ff53-43bb-ab8e-c71b76e4cd8f admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:01.610663 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9095d-ff53-43bb-ab8e-c71b76e4cd8f admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:01.611882 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 793/1576] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:01 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:01.612846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a101f-2685-4169-a9f6-af9595c5cf82 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:01.678571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a101f-2685-4169-a9f6-af9595c5cf82 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:01.680052 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe7afd-33d7-41ee-85d3-5b72f475a925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:01.680893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe7afd-33d7-41ee-85d3-5b72f475a925 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:01.681180 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe7afd-33d7-41ee-85d3-5b72f475a925 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:01.681462 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe7afd-33d7-41ee-85d3-5b72f475a925 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:01.682155 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe7afd-33d7-41ee-85d3-5b72f475a925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:01.684135 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe7afd-33d7-41ee-85d3-5b72f475a925 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:01.684342 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89380e-17be-4b70-ab1f-900de04b05e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:01.685060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89380e-17be-4b70-ab1f-900de04b05e0 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:01.685354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89380e-17be-4b70-ab1f-900de04b05e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:01.685639 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89380e-17be-4b70-ab1f-900de04b05e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:01.686560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89380e-17be-4b70-ab1f-900de04b05e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:01.688190 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89380e-17be-4b70-ab1f-900de04b05e0 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:01.698845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 794/1577] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:01.699842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89380e-17be-4b70-ab1f-900de04b05e0 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:01.709570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89380e-17be-4b70-ab1f-900de04b05e0 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:01.715179 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b86c7-3873-45bf-98c0-c85ef51bb82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:01.715348 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b86c7-3873-45bf-98c0-c85ef51bb82b admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:01.715639 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b86c7-3873-45bf-98c0-c85ef51bb82b admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:01.715930 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b86c7-3873-45bf-98c0-c85ef51bb82b admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:01.716666 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b86c7-3873-45bf-98c0-c85ef51bb82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:01.718276 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b86c7-3873-45bf-98c0-c85ef51bb82b admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:01.729184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 795/1578] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:01.730116 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b86c7-3873-45bf-98c0-c85ef51bb82b admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:01.739588 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b86c7-3873-45bf-98c0-c85ef51bb82b admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:01.744312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095a462-a1a3-455d-9637-4fd21905498c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:01.745199 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095a462-a1a3-455d-9637-4fd21905498c admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:01.745351 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095a462-a1a3-455d-9637-4fd21905498c admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:01.745548 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095a462-a1a3-455d-9637-4fd21905498c admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:01.746234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095a462-a1a3-455d-9637-4fd21905498c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:01.748132 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095a462-a1a3-455d-9637-4fd21905498c admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:01.771405 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 784/1579] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:01 2022] POST /identity/v3/projects => generated 373 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:01.772146 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe7afd-33d7-41ee-85d3-5b72f475a925 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:01.833718 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe7afd-33d7-41ee-85d3-5b72f475a925 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:01.838990 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccc4a1-fbc0-4b2d-a0cb-745720a0070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:01.839664 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccc4a1-fbc0-4b2d-a0cb-745720a0070d admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:01.839991 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccc4a1-fbc0-4b2d-a0cb-745720a0070d admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:01.840275 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccc4a1-fbc0-4b2d-a0cb-745720a0070d admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:01.840999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeccc4a1-fbc0-4b2d-a0cb-745720a0070d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:01.841187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 796/1580] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:01 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:01.842501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52f2d3-900d-4a73-a173-c82ad3e93109 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:01.842800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52f2d3-900d-4a73-a173-c82ad3e93109 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:01.843001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeccc4a1-fbc0-4b2d-a0cb-745720a0070d admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:01.843115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52f2d3-900d-4a73-a173-c82ad3e93109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:01.860895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-da52f2d3-900d-4a73-a173-c82ad3e93109 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:01.862104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-da52f2d3-900d-4a73-a173-c82ad3e93109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:01.870017 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 797/1581] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:01.870797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52f2d3-900d-4a73-a173-c82ad3e93109 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:01.880549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52f2d3-900d-4a73-a173-c82ad3e93109 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:01.885935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd3556-a032-4313-a244-dd08d24c1b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:01.886754 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd3556-a032-4313-a244-dd08d24c1b3c admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:01.886987 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd3556-a032-4313-a244-dd08d24c1b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:01.887265 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd3556-a032-4313-a244-dd08d24c1b3c admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:01.888002 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd3556-a032-4313-a244-dd08d24c1b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:01.889940 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd3556-a032-4313-a244-dd08d24c1b3c admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:01.939697 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 785/1582] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:01 2022] POST /identity/v3/users => generated 282 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:01.940777 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccc4a1-fbc0-4b2d-a0cb-745720a0070d admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:01.947781 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:01.951739 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccc4a1-fbc0-4b2d-a0cb-745720a0070d admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:01.956500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5c02b-88b9-45b7-a934-ed26267a5fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:01.961234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5c02b-88b9-45b7-a934-ed26267a5fab admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:01.961234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5c02b-88b9-45b7-a934-ed26267a5fab admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:01.961234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5c02b-88b9-45b7-a934-ed26267a5fab admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:01.961234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5c02b-88b9-45b7-a934-ed26267a5fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:01.961234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5c02b-88b9-45b7-a934-ed26267a5fab admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.008131 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 798/1583] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:01 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:02.009929 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd3556-a032-4313-a244-dd08d24c1b3c admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.020683 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd3556-a032-4313-a244-dd08d24c1b3c admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.026214 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b380f7-1d8a-42af-b79f-b68fc8ebf36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.026856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b380f7-1d8a-42af-b79f-b68fc8ebf36a admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.027142 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b380f7-1d8a-42af-b79f-b68fc8ebf36a admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.027420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b380f7-1d8a-42af-b79f-b68fc8ebf36a admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.028164 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b380f7-1d8a-42af-b79f-b68fc8ebf36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.032120 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b380f7-1d8a-42af-b79f-b68fc8ebf36a admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.038050 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 786/1584] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:01 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:02.038050 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5c02b-88b9-45b7-a934-ed26267a5fab admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.041162 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 799/1585] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:02.041888 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b380f7-1d8a-42af-b79f-b68fc8ebf36a admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.048318 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5c02b-88b9-45b7-a934-ed26267a5fab admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.051921 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b380f7-1d8a-42af-b79f-b68fc8ebf36a admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.056911 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d8911-15c3-4100-81a8-241a2dfabeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.057061 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16d93f-eba9-44f1-a9cf-9d455f925779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.057598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d8911-15c3-4100-81a8-241a2dfabeb9 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.057711 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16d93f-eba9-44f1-a9cf-9d455f925779 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.057949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d8911-15c3-4100-81a8-241a2dfabeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.058061 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16d93f-eba9-44f1-a9cf-9d455f925779 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.058236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16d93f-eba9-44f1-a9cf-9d455f925779 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.058388 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d8911-15c3-4100-81a8-241a2dfabeb9 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.058963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d8911-15c3-4100-81a8-241a2dfabeb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.059082 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16d93f-eba9-44f1-a9cf-9d455f925779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.060617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16d93f-eba9-44f1-a9cf-9d455f925779 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.060923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d8911-15c3-4100-81a8-241a2dfabeb9 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.074566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 787/1586] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:02.075437 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16d93f-eba9-44f1-a9cf-9d455f925779 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.085266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16d93f-eba9-44f1-a9cf-9d455f925779 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.091222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7faa56-88d8-4c93-a09b-d73e2fbacd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.091932 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7faa56-88d8-4c93-a09b-d73e2fbacd0d admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.092218 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7faa56-88d8-4c93-a09b-d73e2fbacd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.092502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7faa56-88d8-4c93-a09b-d73e2fbacd0d admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.093309 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7faa56-88d8-4c93-a09b-d73e2fbacd0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.099210 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7faa56-88d8-4c93-a09b-d73e2fbacd0d admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.105688 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 788/1587] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:02.106528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7faa56-88d8-4c93-a09b-d73e2fbacd0d admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.153746 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 800/1588] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:02 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:02.154594 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d8911-15c3-4100-81a8-241a2dfabeb9 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.162887 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7faa56-88d8-4c93-a09b-d73e2fbacd0d admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.164193 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d8911-15c3-4100-81a8-241a2dfabeb9 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.167250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43cab6-95de-4067-b456-6bc08176c72e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.167934 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43cab6-95de-4067-b456-6bc08176c72e service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.168286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43cab6-95de-4067-b456-6bc08176c72e service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.168565 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43cab6-95de-4067-b456-6bc08176c72e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.169824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbc27e-e524-4c36-96f8-5fc5175da0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.170561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbc27e-e524-4c36-96f8-5fc5175da0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.170921 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbc27e-e524-4c36-96f8-5fc5175da0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.171269 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbc27e-e524-4c36-96f8-5fc5175da0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.172096 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbc27e-e524-4c36-96f8-5fc5175da0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.173745 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbc27e-e524-4c36-96f8-5fc5175da0e8 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.178329 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43cab6-95de-4067-b456-6bc08176c72e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.179843 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43cab6-95de-4067-b456-6bc08176c72e service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.185271 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 801/1589] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:02.186122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbc27e-e524-4c36-96f8-5fc5175da0e8 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.192444 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 789/1590] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:02.193426 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43cab6-95de-4067-b456-6bc08176c72e service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.196096 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbc27e-e524-4c36-96f8-5fc5175da0e8 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.202569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7db3b9-e641-4f94-819e-ede89e22d4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.203259 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7db3b9-e641-4f94-819e-ede89e22d4ff admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.203500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43cab6-95de-4067-b456-6bc08176c72e service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.203640 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7db3b9-e641-4f94-819e-ede89e22d4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.203825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7db3b9-e641-4f94-819e-ede89e22d4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.204554 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7db3b9-e641-4f94-819e-ede89e22d4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.206587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7db3b9-e641-4f94-819e-ede89e22d4ff admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.208407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676adec1-cb16-4ac5-bb91-a5d3c251b84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.209229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676adec1-cb16-4ac5-bb91-a5d3c251b84a admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.209584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676adec1-cb16-4ac5-bb91-a5d3c251b84a admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.209926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676adec1-cb16-4ac5-bb91-a5d3c251b84a admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.210844 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676adec1-cb16-4ac5-bb91-a5d3c251b84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.215532 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676adec1-cb16-4ac5-bb91-a5d3c251b84a admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.218455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 802/1591] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:02.220924 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7db3b9-e641-4f94-819e-ede89e22d4ff admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.230439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 790/1592] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:02.230439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676adec1-cb16-4ac5-bb91-a5d3c251b84a admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.234446 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7db3b9-e641-4f94-819e-ede89e22d4ff admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.239035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dc53c-0ca3-4e44-9e43-5025be79bf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.239938 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dc53c-0ca3-4e44-9e43-5025be79bf35 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.240228 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dc53c-0ca3-4e44-9e43-5025be79bf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.240510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dc53c-0ca3-4e44-9e43-5025be79bf35 admin admin] PATH_INFO: `/v3/projects/8fb81215065b41dba1db019ec89fa8b2/users/c3f7f25cf67c40b5a03f4f692a198146/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.248931 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676adec1-cb16-4ac5-bb91-a5d3c251b84a admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.249519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:02.254417 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe74f8-ad78-45f3-942a-5679c5e7b933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.260037 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe74f8-ad78-45f3-942a-5679c5e7b933 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.260037 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe74f8-ad78-45f3-942a-5679c5e7b933 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.260037 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe74f8-ad78-45f3-942a-5679c5e7b933 admin admin] PATH_INFO: `/v3/projects/2069f994dd544669ab561848b4a42e36/users/ff368431091d41ea898afc9b081eee6d/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.260457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7dc53c-0ca3-4e44-9e43-5025be79bf35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb81215065b41dba1db019ec89fa8b2, user_id=c3f7f25cf67c40b5a03f4f692a198146, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.261499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7dc53c-0ca3-4e44-9e43-5025be79bf35 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.271512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe74f8-ad78-45f3-942a-5679c5e7b933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2069f994dd544669ab561848b4a42e36, user_id=ff368431091d41ea898afc9b081eee6d, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.274915 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe74f8-ad78-45f3-942a-5679c5e7b933 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.341266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 803/1593] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:02 2022] PUT /identity/v3/projects/8fb81215065b41dba1db019ec89fa8b2/users/c3f7f25cf67c40b5a03f4f692a198146/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:02.342123 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dc53c-0ca3-4e44-9e43-5025be79bf35 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.399962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 791/1594] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:02 2022] PUT /identity/v3/projects/2069f994dd544669ab561848b4a42e36/users/ff368431091d41ea898afc9b081eee6d/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:02.401532 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe74f8-ad78-45f3-942a-5679c5e7b933 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.415513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dc53c-0ca3-4e44-9e43-5025be79bf35 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.491200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe74f8-ad78-45f3-942a-5679c5e7b933 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.496192 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb234aff-3d2e-4bdd-85c1-f8942d08dffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.496908 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb234aff-3d2e-4bdd-85c1-f8942d08dffb admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.497201 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb234aff-3d2e-4bdd-85c1-f8942d08dffb admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.497481 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb234aff-3d2e-4bdd-85c1-f8942d08dffb admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.498276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb234aff-3d2e-4bdd-85c1-f8942d08dffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.499911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb234aff-3d2e-4bdd-85c1-f8942d08dffb admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.510243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 792/1595] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:02.515445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb234aff-3d2e-4bdd-85c1-f8942d08dffb admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.521316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb234aff-3d2e-4bdd-85c1-f8942d08dffb admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.521559 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1b5e7-d995-4d20-9436-354603ea9b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.522529 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1b5e7-d995-4d20-9436-354603ea9b19 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.522836 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1b5e7-d995-4d20-9436-354603ea9b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.523306 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1b5e7-d995-4d20-9436-354603ea9b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.524988 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1b5e7-d995-4d20-9436-354603ea9b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.526813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1b5e7-d995-4d20-9436-354603ea9b19 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.527009 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53806b6-c4dc-4ed2-9cad-526fd8cb56b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.527960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53806b6-c4dc-4ed2-9cad-526fd8cb56b4 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.527960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53806b6-c4dc-4ed2-9cad-526fd8cb56b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.528305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53806b6-c4dc-4ed2-9cad-526fd8cb56b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.529044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53806b6-c4dc-4ed2-9cad-526fd8cb56b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.530650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53806b6-c4dc-4ed2-9cad-526fd8cb56b4 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.542872 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 793/1596] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:02.543760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53806b6-c4dc-4ed2-9cad-526fd8cb56b4 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.550676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 804/1597] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:02.550676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1b5e7-d995-4d20-9436-354603ea9b19 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.559544 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53806b6-c4dc-4ed2-9cad-526fd8cb56b4 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.561764 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1b5e7-d995-4d20-9436-354603ea9b19 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.565706 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325dffa-62e2-47d8-b81d-ac90da2c432c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.567141 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325dffa-62e2-47d8-b81d-ac90da2c432c admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.567356 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b548f-2e24-43c5-bacf-77dc921ca24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.567480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325dffa-62e2-47d8-b81d-ac90da2c432c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.567480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325dffa-62e2-47d8-b81d-ac90da2c432c admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.567662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b548f-2e24-43c5-bacf-77dc921ca24e admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.567875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b548f-2e24-43c5-bacf-77dc921ca24e admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.568161 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b548f-2e24-43c5-bacf-77dc921ca24e admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.568691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325dffa-62e2-47d8-b81d-ac90da2c432c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.569138 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b548f-2e24-43c5-bacf-77dc921ca24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.570638 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325dffa-62e2-47d8-b81d-ac90da2c432c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.571810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b548f-2e24-43c5-bacf-77dc921ca24e admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.584022 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 805/1598] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:02.585516 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19faa9-31b5-4753-9aca-341694d4db75 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.585812 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19faa9-31b5-4753-9aca-341694d4db75 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.586092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19faa9-31b5-4753-9aca-341694d4db75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.591347 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 794/1599] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:02.593103 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf526db-def0-4f3e-92e7-a8830b7441ba None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.593476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf526db-def0-4f3e-92e7-a8830b7441ba None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.593761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf526db-def0-4f3e-92e7-a8830b7441ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.612687 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-fa19faa9-31b5-4753-9aca-341694d4db75 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:02.612687 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-fa19faa9-31b5-4753-9aca-341694d4db75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:02.623121 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-5cf526db-def0-4f3e-92e7-a8830b7441ba None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:02.624154 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:02.628269 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 806/1600] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:02.628269 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19faa9-31b5-4753-9aca-341694d4db75 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.629268 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-5cf526db-def0-4f3e-92e7-a8830b7441ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:02.637265 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19faa9-31b5-4753-9aca-341694d4db75 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.639429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 795/1601] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:02.640244 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf526db-def0-4f3e-92e7-a8830b7441ba None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.643045 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabac44-6622-472b-9184-6cd40d21cb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.644867 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabac44-6622-472b-9184-6cd40d21cb51 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.644867 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabac44-6622-472b-9184-6cd40d21cb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.644867 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabac44-6622-472b-9184-6cd40d21cb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.646085 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabac44-6622-472b-9184-6cd40d21cb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.647263 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabac44-6622-472b-9184-6cd40d21cb51 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.651434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf526db-def0-4f3e-92e7-a8830b7441ba None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.656809 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7638cd-6592-43a2-822f-cb24ae3a560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.657885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7638cd-6592-43a2-822f-cb24ae3a560a admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.658156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7638cd-6592-43a2-822f-cb24ae3a560a admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.658453 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7638cd-6592-43a2-822f-cb24ae3a560a admin admin] PATH_INFO: `/v3/projects/fd51118c47904dec808ca1f9e0bbacb8/users/25aab3924ce4498898ef341be81353e7/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.661640 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 807/1602] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:02.662800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabac44-6622-472b-9184-6cd40d21cb51 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.674645 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabac44-6622-472b-9184-6cd40d21cb51 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.679921 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cdb34-316c-4e3c-b814-191dca622688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.681941 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cdb34-316c-4e3c-b814-191dca622688 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.682465 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cdb34-316c-4e3c-b814-191dca622688 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.682609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cdb34-316c-4e3c-b814-191dca622688 admin admin] PATH_INFO: `/v3/projects/acf3d1ff5ada4aa6aed279f1ccad98fc/users/9de3607d4fe14a2c9160366f21cec170/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.688902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7638cd-6592-43a2-822f-cb24ae3a560a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd51118c47904dec808ca1f9e0bbacb8, user_id=25aab3924ce4498898ef341be81353e7, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.696141 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7638cd-6592-43a2-822f-cb24ae3a560a admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.699442 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cdb34-316c-4e3c-b814-191dca622688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf3d1ff5ada4aa6aed279f1ccad98fc, user_id=9de3607d4fe14a2c9160366f21cec170, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.702242 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cdb34-316c-4e3c-b814-191dca622688 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.786760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 808/1603] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:02 2022] PUT /identity/v3/projects/acf3d1ff5ada4aa6aed279f1ccad98fc/users/9de3607d4fe14a2c9160366f21cec170/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:02.787765 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cdb34-316c-4e3c-b814-191dca622688 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.805110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 796/1604] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:02 2022] PUT /identity/v3/projects/fd51118c47904dec808ca1f9e0bbacb8/users/25aab3924ce4498898ef341be81353e7/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:02.805110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7638cd-6592-43a2-822f-cb24ae3a560a admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:02.864916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:02.888094 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cdb34-316c-4e3c-b814-191dca622688 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.905731 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7638cd-6592-43a2-822f-cb24ae3a560a admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:02.912060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1df44-f6b0-4555-9512-a1ea703cc848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.913012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1df44-f6b0-4555-9512-a1ea703cc848 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.913300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1df44-f6b0-4555-9512-a1ea703cc848 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.913584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1df44-f6b0-4555-9512-a1ea703cc848 admin admin] PATH_INFO: `/v3/projects/8bdabc98a2c745bf80153d7fed1faddb/users/f94a5449ff13429aaf2e39ea98bc340c/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.934036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1df44-f6b0-4555-9512-a1ea703cc848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bdabc98a2c745bf80153d7fed1faddb, user_id=f94a5449ff13429aaf2e39ea98bc340c, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.936910 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1df44-f6b0-4555-9512-a1ea703cc848 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:02.966014 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e220d-67e1-4594-8275-4172d9d34273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:02.967194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e220d-67e1-4594-8275-4172d9d34273 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:02.967846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e220d-67e1-4594-8275-4172d9d34273 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:02.968337 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e220d-67e1-4594-8275-4172d9d34273 admin admin] PATH_INFO: `/v3/projects/eec3f3dcd90246b1a893afa783f2d2aa/users/d4ffb26d86d64d81bea84268e10386fc/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:02.988058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e220d-67e1-4594-8275-4172d9d34273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec3f3dcd90246b1a893afa783f2d2aa, user_id=d4ffb26d86d64d81bea84268e10386fc, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:02.993468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e220d-67e1-4594-8275-4172d9d34273 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:03.011467 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 797/1605] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:02 2022] PUT /identity/v3/projects/8bdabc98a2c745bf80153d7fed1faddb/users/f94a5449ff13429aaf2e39ea98bc340c/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:03.012957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1df44-f6b0-4555-9512-a1ea703cc848 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:03.067551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 809/1606] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:02 2022] PUT /identity/v3/projects/eec3f3dcd90246b1a893afa783f2d2aa/users/d4ffb26d86d64d81bea84268e10386fc/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:03.067551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e220d-67e1-4594-8275-4172d9d34273 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:03.069946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-793e220d-67e1-4594-8275-4172d9d34273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:03.078873 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1df44-f6b0-4555-9512-a1ea703cc848 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:03.135871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c6ba7-a1eb-4a0a-b529-4a18ae597ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:03.136369 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e220d-67e1-4594-8275-4172d9d34273 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:03.136547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c6ba7-a1eb-4a0a-b529-4a18ae597ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:03.136879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c6ba7-a1eb-4a0a-b529-4a18ae597ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:03.137162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c6ba7-a1eb-4a0a-b529-4a18ae597ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:03.141162 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a37bf-56d2-439f-a694-55512e173e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:03.141838 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a37bf-56d2-439f-a694-55512e173e03 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:03.142229 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a37bf-56d2-439f-a694-55512e173e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:03.142398 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a37bf-56d2-439f-a694-55512e173e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:03.169633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:03.203765 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c6ba7-a1eb-4a0a-b529-4a18ae597ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:03.205283 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c6ba7-a1eb-4a0a-b529-4a18ae597ed0 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:03.207229 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a37bf-56d2-439f-a694-55512e173e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:03.208672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a37bf-56d2-439f-a694-55512e173e03 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:03.215387 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 798/1607] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:03.216181 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c6ba7-a1eb-4a0a-b529-4a18ae597ed0 service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:03.218928 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 810/1608] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:03.220233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dda27f-8c7a-4e7c-9da2-4e24fab9a8fc None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:03.220527 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dda27f-8c7a-4e7c-9da2-4e24fab9a8fc None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:03.220840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dda27f-8c7a-4e7c-9da2-4e24fab9a8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:03.226520 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c6ba7-a1eb-4a0a-b529-4a18ae597ed0 service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:03.232084 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de6e6f-78a2-4584-b12f-437c3d1d9c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:03.233129 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de6e6f-78a2-4584-b12f-437c3d1d9c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:03.233425 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de6e6f-78a2-4584-b12f-437c3d1d9c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:03.233725 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de6e6f-78a2-4584-b12f-437c3d1d9c57 admin admin] PATH_INFO: `/v3/projects/c75e726f601b4cb9904a4ae26c1ba797/users/948afb941609473fb7478f388e4370ae/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:03.251397 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-f2dda27f-8c7a-4e7c-9da2-4e24fab9a8fc None None] MFA Rules not processed for user `9de3607d4fe14a2c9160366f21cec170`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:03.253310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f2dda27f-8c7a-4e7c-9da2-4e24fab9a8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:03.254662 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de6e6f-78a2-4584-b12f-437c3d1d9c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c75e726f601b4cb9904a4ae26c1ba797, user_id=948afb941609473fb7478f388e4370ae, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:03.257372 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de6e6f-78a2-4584-b12f-437c3d1d9c57 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:03.259597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:03.331707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 811/1609] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:03 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:03.333880 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34241093-a11c-4351-a73c-fbd2b82aeaae None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:03.338154 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34241093-a11c-4351-a73c-fbd2b82aeaae None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:03.338154 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34241093-a11c-4351-a73c-fbd2b82aeaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:03.349087 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 799/1610] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:03 2022] PUT /identity/v3/projects/c75e726f601b4cb9904a4ae26c1ba797/users/948afb941609473fb7478f388e4370ae/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:03.349087 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95888f26-95a0-4d8d-abda-cd9603da804c None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:03.349087 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95888f26-95a0-4d8d-abda-cd9603da804c None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:03.349087 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95888f26-95a0-4d8d-abda-cd9603da804c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:03.371512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-34241093-a11c-4351-a73c-fbd2b82aeaae None None] MFA Rules not processed for user `25aab3924ce4498898ef341be81353e7`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:03.373809 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-34241093-a11c-4351-a73c-fbd2b82aeaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:03.393466 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-95888f26-95a0-4d8d-abda-cd9603da804c None None] MFA Rules not processed for user `f94a5449ff13429aaf2e39ea98bc340c`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:03.395934 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-95888f26-95a0-4d8d-abda-cd9603da804c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:03.490966 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 812/1611] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:03.493550 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57550d86-444e-4e8a-9c3d-f7688a4bc8bb None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:03.494084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57550d86-444e-4e8a-9c3d-f7688a4bc8bb None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:03.494601 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57550d86-444e-4e8a-9c3d-f7688a4bc8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:03.513498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-57550d86-444e-4e8a-9c3d-f7688a4bc8bb None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:03.514796 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-57550d86-444e-4e8a-9c3d-f7688a4bc8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:03.521348 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 800/1612] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:03.524105 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95888f26-95a0-4d8d-abda-cd9603da804c None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:03.629666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95888f26-95a0-4d8d-abda-cd9603da804c None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:03.639624 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 813/1613] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:03.641658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccdaf5-36e4-42a0-8f78-5726ad6cb9bd None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:03.642459 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e291cc-cb28-47e3-b61c-b232a44deffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:03.643746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e291cc-cb28-47e3-b61c-b232a44deffc admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:03.644263 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccdaf5-36e4-42a0-8f78-5726ad6cb9bd None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:03.645038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e291cc-cb28-47e3-b61c-b232a44deffc admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:03.645176 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccdaf5-36e4-42a0-8f78-5726ad6cb9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:03.645491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e291cc-cb28-47e3-b61c-b232a44deffc admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:03.646958 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e291cc-cb28-47e3-b61c-b232a44deffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:03.654873 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e291cc-cb28-47e3-b61c-b232a44deffc admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:03.705752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-d6ccdaf5-36e4-42a0-8f78-5726ad6cb9bd None None] MFA Rules not processed for user `948afb941609473fb7478f388e4370ae`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:03.707345 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-d6ccdaf5-36e4-42a0-8f78-5726ad6cb9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:03.763296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:03.775826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 801/1614] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:03 2022] POST /identity/v3/projects => generated 363 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:03.777149 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e291cc-cb28-47e3-b61c-b232a44deffc admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:03.805058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:03.823959 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 814/1615] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:03.825334 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427199e-2a22-4ef5-a4e1-d1c0ef084a70 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:03.825671 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427199e-2a22-4ef5-a4e1-d1c0ef084a70 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:03.825945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427199e-2a22-4ef5-a4e1-d1c0ef084a70 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:03.832253 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 815/1616] 10.222.0.20 () {54 vars in 961 bytes} [Thu Jun 23 10:58:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:58:03.833208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427199e-2a22-4ef5-a4e1-d1c0ef084a70 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:03.870343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e291cc-cb28-47e3-b61c-b232a44deffc admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:03.894790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f8476-34ce-48a8-a1c0-8e58e881f5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:03.895869 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f8476-34ce-48a8-a1c0-8e58e881f5e7 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:03.896297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f8476-34ce-48a8-a1c0-8e58e881f5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:03.896757 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f8476-34ce-48a8-a1c0-8e58e881f5e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:03.897667 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f8476-34ce-48a8-a1c0-8e58e881f5e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:03.908430 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f8476-34ce-48a8-a1c0-8e58e881f5e7 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:03.915414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427199e-2a22-4ef5-a4e1-d1c0ef084a70 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:03.920607 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e3f21-7887-45e2-ba40-d7036d4d4806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:03.921323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e3f21-7887-45e2-ba40-d7036d4d4806 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:03.921654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e3f21-7887-45e2-ba40-d7036d4d4806 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:03.921935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e3f21-7887-45e2-ba40-d7036d4d4806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:03.935945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e3f21-7887-45e2-ba40-d7036d4d4806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:03.937570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e3f21-7887-45e2-ba40-d7036d4d4806 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:03.950858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 816/1617] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:03.951869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e3f21-7887-45e2-ba40-d7036d4d4806 service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:03.979997 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e3f21-7887-45e2-ba40-d7036d4d4806 service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:03.997619 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf12959-d180-48c3-a69f-749b373f0d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:03.998372 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf12959-d180-48c3-a69f-749b373f0d4d admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:03.998653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf12959-d180-48c3-a69f-749b373f0d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:03.998927 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf12959-d180-48c3-a69f-749b373f0d4d admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:03.999631 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf12959-d180-48c3-a69f-749b373f0d4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:04.001649 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf12959-d180-48c3-a69f-749b373f0d4d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:04.129717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 802/1618] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:03 2022] POST /identity/v3/projects => generated 375 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:04.129717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17b02f-6987-4970-94d2-9fbe20a3e641 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:04.130572 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17b02f-6987-4970-94d2-9fbe20a3e641 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:04.131004 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17b02f-6987-4970-94d2-9fbe20a3e641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:04.154326 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 817/1619] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:03 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:04.159439 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f351ae-d0df-44bf-a564-8f63dab39246 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:04.159738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f351ae-d0df-44bf-a564-8f63dab39246 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:04.160024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f351ae-d0df-44bf-a564-8f63dab39246 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:04.163758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 818/1620] 10.222.0.20 () {54 vars in 961 bytes} [Thu Jun 23 10:58:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:58:04.168867 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-dc17b02f-6987-4970-94d2-9fbe20a3e641 None None] MFA Rules not processed for user `39840f048d254831bdb963b38520f706`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:04.170618 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-dc17b02f-6987-4970-94d2-9fbe20a3e641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:04.174020 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f351ae-d0df-44bf-a564-8f63dab39246 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:04.259993 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f351ae-d0df-44bf-a564-8f63dab39246 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:04.265510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16755c-b5df-4a9b-ac52-6820528f3826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:04.266214 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16755c-b5df-4a9b-ac52-6820528f3826 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:04.266678 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16755c-b5df-4a9b-ac52-6820528f3826 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:04.266966 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16755c-b5df-4a9b-ac52-6820528f3826 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:04.267682 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16755c-b5df-4a9b-ac52-6820528f3826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:04.269681 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16755c-b5df-4a9b-ac52-6820528f3826 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:04.287723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 803/1621] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Jun 23 10:58:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:04.289811 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17b02f-6987-4970-94d2-9fbe20a3e641 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:04.302018 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17b02f-6987-4970-94d2-9fbe20a3e641 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:04.308112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6927178-db0a-4ed2-81bb-97df35eec67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:04.308838 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6927178-db0a-4ed2-81bb-97df35eec67d admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:04.309125 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6927178-db0a-4ed2-81bb-97df35eec67d admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:04.309403 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6927178-db0a-4ed2-81bb-97df35eec67d admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:04.310175 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6927178-db0a-4ed2-81bb-97df35eec67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:04.311896 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6927178-db0a-4ed2-81bb-97df35eec67d admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:04.323296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 804/1622] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:04.325289 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57026e44-519a-4b60-af7b-f16dbd364f34 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:04.325585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57026e44-519a-4b60-af7b-f16dbd364f34 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:04.325870 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57026e44-519a-4b60-af7b-f16dbd364f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:04.354888 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-57026e44-519a-4b60-af7b-f16dbd364f34 None None] MFA Rules not processed for user `39840f048d254831bdb963b38520f706`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:04.356274 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-57026e44-519a-4b60-af7b-f16dbd364f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:04.366583 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 805/1623] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Jun 23 10:58:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:04.382914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 819/1624] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:04 2022] POST /identity/v3/users => generated 294 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:04.383817 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16755c-b5df-4a9b-ac52-6820528f3826 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:04.384746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57026e44-519a-4b60-af7b-f16dbd364f34 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:04.398218 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57026e44-519a-4b60-af7b-f16dbd364f34 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:04.405560 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da050fe-ccde-4e42-8f4f-37e9b450f3bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:04.406681 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da050fe-ccde-4e42-8f4f-37e9b450f3bb service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:04.407128 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da050fe-ccde-4e42-8f4f-37e9b450f3bb service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:04.407507 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da050fe-ccde-4e42-8f4f-37e9b450f3bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:04.439528 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16755c-b5df-4a9b-ac52-6820528f3826 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:04.447919 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21200b2e-5965-4c9d-a928-147fb54c8241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:04.449013 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21200b2e-5965-4c9d-a928-147fb54c8241 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:04.449405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21200b2e-5965-4c9d-a928-147fb54c8241 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:04.449787 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21200b2e-5965-4c9d-a928-147fb54c8241 admin admin] PATH_INFO: `/v3/projects/3fcda83493474b05b280136b9095b029/users/7aa6791b2f844a13a71a1ef2b0c32951/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:04.486713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21200b2e-5965-4c9d-a928-147fb54c8241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fcda83493474b05b280136b9095b029, user_id=7aa6791b2f844a13a71a1ef2b0c32951, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:04.489670 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21200b2e-5965-4c9d-a928-147fb54c8241 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:04.500987 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da050fe-ccde-4e42-8f4f-37e9b450f3bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:04.503666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da050fe-ccde-4e42-8f4f-37e9b450f3bb service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:04.540430 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 806/1625] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:04.544297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da050fe-ccde-4e42-8f4f-37e9b450f3bb service nova] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:04.582677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da050fe-ccde-4e42-8f4f-37e9b450f3bb service nova] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:04.586802 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 820/1626] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:04 2022] PUT /identity/v3/projects/3fcda83493474b05b280136b9095b029/users/7aa6791b2f844a13a71a1ef2b0c32951/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:04.587663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21200b2e-5965-4c9d-a928-147fb54c8241 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:04.639628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:04.696581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da42c7-298b-4c1e-b21a-dad839fdf000 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:04.697913 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da42c7-298b-4c1e-b21a-dad839fdf000 service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:04.698367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da42c7-298b-4c1e-b21a-dad839fdf000 service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:04.698948 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da42c7-298b-4c1e-b21a-dad839fdf000 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:04.710164 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:04.725261 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21200b2e-5965-4c9d-a928-147fb54c8241 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:04.733760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e078278-e2b8-4de6-9db9-57f3ee965072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:04.735023 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e078278-e2b8-4de6-9db9-57f3ee965072 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:04.735567 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e078278-e2b8-4de6-9db9-57f3ee965072 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:04.736595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e078278-e2b8-4de6-9db9-57f3ee965072 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:04.738114 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e078278-e2b8-4de6-9db9-57f3ee965072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:04.740451 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e078278-e2b8-4de6-9db9-57f3ee965072 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:04.757056 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 821/1627] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:04.759492 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e078278-e2b8-4de6-9db9-57f3ee965072 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:04.771418 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e078278-e2b8-4de6-9db9-57f3ee965072 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:04.777326 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c775d-01a3-4ce5-9382-fec960e27404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:04.778481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c775d-01a3-4ce5-9382-fec960e27404 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:04.779059 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c775d-01a3-4ce5-9382-fec960e27404 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:04.780176 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c775d-01a3-4ce5-9382-fec960e27404 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:04.782278 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c775d-01a3-4ce5-9382-fec960e27404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:04.784456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c775d-01a3-4ce5-9382-fec960e27404 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:04.804538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 822/1628] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:04.805849 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c775d-01a3-4ce5-9382-fec960e27404 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:04.809241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da42c7-298b-4c1e-b21a-dad839fdf000 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:04.811777 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da42c7-298b-4c1e-b21a-dad839fdf000 service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:04.840217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c775d-01a3-4ce5-9382-fec960e27404 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:04.840658 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 807/1629] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:04.841750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da42c7-298b-4c1e-b21a-dad839fdf000 service nova] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:04.858053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da42c7-298b-4c1e-b21a-dad839fdf000 service nova] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:04.873634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0476d2a-ef02-4f1c-bcf4-d6292655ab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:04.875525 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0476d2a-ef02-4f1c-bcf4-d6292655ab75 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:04.879758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0476d2a-ef02-4f1c-bcf4-d6292655ab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:04.879758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0476d2a-ef02-4f1c-bcf4-d6292655ab75 admin admin] PATH_INFO: `/v3/projects/7c3878b844d14ec59073b471eb767506/users/8747c8f0aea548168501fa50da3d074b/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:04.882886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44a92c-b2ea-4d63-9bbb-e5c1c1b91ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:04.888046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44a92c-b2ea-4d63-9bbb-e5c1c1b91ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:04.893125 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44a92c-b2ea-4d63-9bbb-e5c1c1b91ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:04.893125 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44a92c-b2ea-4d63-9bbb-e5c1c1b91ddc admin admin] PATH_INFO: `/v3/projects/3fcda83493474b05b280136b9095b029/users/7aa6791b2f844a13a71a1ef2b0c32951/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:04.905819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44a92c-b2ea-4d63-9bbb-e5c1c1b91ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fcda83493474b05b280136b9095b029, user_id=7aa6791b2f844a13a71a1ef2b0c32951, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:04.912824 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44a92c-b2ea-4d63-9bbb-e5c1c1b91ddc admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:04.939599 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0476d2a-ef02-4f1c-bcf4-d6292655ab75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3878b844d14ec59073b471eb767506, user_id=8747c8f0aea548168501fa50da3d074b, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:04.939903 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0476d2a-ef02-4f1c-bcf4-d6292655ab75 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:04.955613 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 808/1630] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:04 2022] PUT /identity/v3/projects/3fcda83493474b05b280136b9095b029/users/7aa6791b2f844a13a71a1ef2b0c32951/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:04.970834 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7d8c0-af8c-4abf-9843-66433515e2e5 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:04.970834 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7d8c0-af8c-4abf-9843-66433515e2e5 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:04.970834 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7d8c0-af8c-4abf-9843-66433515e2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:05.046112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-5ab7d8c0-af8c-4abf-9843-66433515e2e5 None None] MFA Rules not processed for user `7aa6791b2f844a13a71a1ef2b0c32951`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:05.047665 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-5ab7d8c0-af8c-4abf-9843-66433515e2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:05.090414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 823/1631] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:04 2022] PUT /identity/v3/projects/7c3878b844d14ec59073b471eb767506/users/8747c8f0aea548168501fa50da3d074b/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:05.093821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d308046-2d97-4ed1-b733-1125eb7aa404 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:05.093821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d308046-2d97-4ed1-b733-1125eb7aa404 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:05.093821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d308046-2d97-4ed1-b733-1125eb7aa404 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:05.103343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 824/1632] 10.222.0.20 () {54 vars in 912 bytes} [Thu Jun 23 10:58:05 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:58:05.107164 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d308046-2d97-4ed1-b733-1125eb7aa404 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:05.186895 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 809/1633] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:04 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:05.190066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe7eba-bfe9-4667-bc52-363e870eb14c None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:05.190066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe7eba-bfe9-4667-bc52-363e870eb14c None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:05.190066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe7eba-bfe9-4667-bc52-363e870eb14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:05.276889 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-66fe7eba-bfe9-4667-bc52-363e870eb14c None None] MFA Rules not processed for user `39840f048d254831bdb963b38520f706`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:05.276889 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-66fe7eba-bfe9-4667-bc52-363e870eb14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:05.333119 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d308046-2d97-4ed1-b733-1125eb7aa404 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:05.345085 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba103a-6d03-4be8-943e-75ad4cf63436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:05.345598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba103a-6d03-4be8-943e-75ad4cf63436 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:05.345951 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba103a-6d03-4be8-943e-75ad4cf63436 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:05.346347 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba103a-6d03-4be8-943e-75ad4cf63436 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:05.347858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba103a-6d03-4be8-943e-75ad4cf63436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:05.357218 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba103a-6d03-4be8-943e-75ad4cf63436 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:05.384435 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 825/1634] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:05.385470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba103a-6d03-4be8-943e-75ad4cf63436 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:05.390914 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 810/1635] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 23 10:58:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:05.391985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe7eba-bfe9-4667-bc52-363e870eb14c None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:05.419099 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe7eba-bfe9-4667-bc52-363e870eb14c None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:05.431310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41f1da-3719-4ad4-9e40-5100a11362e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:05.432617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41f1da-3719-4ad4-9e40-5100a11362e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:05.433117 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41f1da-3719-4ad4-9e40-5100a11362e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:05.433546 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41f1da-3719-4ad4-9e40-5100a11362e5 admin admin] PATH_INFO: `/v3/projects/7c3878b844d14ec59073b471eb767506/users/8747c8f0aea548168501fa50da3d074b/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:05.436240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41f1da-3719-4ad4-9e40-5100a11362e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3878b844d14ec59073b471eb767506, user_id=8747c8f0aea548168501fa50da3d074b, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:05.440801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41f1da-3719-4ad4-9e40-5100a11362e5 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:05.454438 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 811/1636] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:05 2022] PUT /identity/v3/projects/7c3878b844d14ec59073b471eb767506/users/8747c8f0aea548168501fa50da3d074b/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:05.455393 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41f1da-3719-4ad4-9e40-5100a11362e5 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:05.540946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba103a-6d03-4be8-943e-75ad4cf63436 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:05.582069 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41f1da-3719-4ad4-9e40-5100a11362e5 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:05.593467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:05.598933 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b789dd-6564-467d-8f81-eb738c4770d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:05.600314 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b789dd-6564-467d-8f81-eb738c4770d2 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:05.600872 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b789dd-6564-467d-8f81-eb738c4770d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:05.601379 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b789dd-6564-467d-8f81-eb738c4770d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:05.617542 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:05.631108 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbcc52-81c2-4c87-bff7-e15f6624fdfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:05.631988 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbcc52-81c2-4c87-bff7-e15f6624fdfa service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:05.633144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbcc52-81c2-4c87-bff7-e15f6624fdfa service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:05.633800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbcc52-81c2-4c87-bff7-e15f6624fdfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:05.722548 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbcc52-81c2-4c87-bff7-e15f6624fdfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:05.724096 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbcc52-81c2-4c87-bff7-e15f6624fdfa service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:05.735968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b789dd-6564-467d-8f81-eb738c4770d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:05.740218 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b789dd-6564-467d-8f81-eb738c4770d2 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:05.756018 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 826/1637] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:05 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:05.760885 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cabfe-82f6-453f-873a-162426401939 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:05.761183 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cabfe-82f6-453f-873a-162426401939 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:05.761481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cabfe-82f6-453f-873a-162426401939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:05.769349 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 812/1638] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:05.769349 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a739a17-d983-4924-ade0-6bb9983eb87d None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:05.769349 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a739a17-d983-4924-ade0-6bb9983eb87d None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:05.769349 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a739a17-d983-4924-ade0-6bb9983eb87d None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:05.781796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 813/1639] 10.222.0.20 () {54 vars in 912 bytes} [Thu Jun 23 10:58:05 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:58:05.787416 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9ed1-88ee-4aba-9240-a4ff66dd891a None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:05.788392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9ed1-88ee-4aba-9240-a4ff66dd891a None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:05.788392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9ed1-88ee-4aba-9240-a4ff66dd891a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:05.811723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-5b7a9ed1-88ee-4aba-9240-a4ff66dd891a None None] MFA Rules not processed for user `39840f048d254831bdb963b38520f706`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:05.812906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-5b7a9ed1-88ee-4aba-9240-a4ff66dd891a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:05.831785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 814/1640] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 23 10:58:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:58:05.834812 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-225cabfe-82f6-453f-873a-162426401939 None None] MFA Rules not processed for user `8747c8f0aea548168501fa50da3d074b`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:05.835710 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-225cabfe-82f6-453f-873a-162426401939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:05.920169 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a9ed1-88ee-4aba-9240-a4ff66dd891a None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:05.941611 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a9ed1-88ee-4aba-9240-a4ff66dd891a None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:05.955541 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675c6f0-899d-4eb8-8f6a-c448ec984b31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:05.962327 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675c6f0-899d-4eb8-8f6a-c448ec984b31 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:05.962327 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675c6f0-899d-4eb8-8f6a-c448ec984b31 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:05.968982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675c6f0-899d-4eb8-8f6a-c448ec984b31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:06.007502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675c6f0-899d-4eb8-8f6a-c448ec984b31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:06.012034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675c6f0-899d-4eb8-8f6a-c448ec984b31 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:06.014554 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 827/1641] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:06.053019 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 815/1642] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:58:07.465417 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cabfe-82f6-453f-873a-162426401939 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:07.481535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cabfe-82f6-453f-873a-162426401939 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:07.487430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d44919-e22e-4751-9f27-b05fa2e9574a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:07.489516 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d44919-e22e-4751-9f27-b05fa2e9574a service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:07.490252 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d44919-e22e-4751-9f27-b05fa2e9574a service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:07.490917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d44919-e22e-4751-9f27-b05fa2e9574a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:07.848403 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d44919-e22e-4751-9f27-b05fa2e9574a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:07.848403 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d44919-e22e-4751-9f27-b05fa2e9574a service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:07.848403 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 828/1643] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:07.885935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675c6f0-899d-4eb8-8f6a-c448ec984b31 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:07.885935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675c6f0-899d-4eb8-8f6a-c448ec984b31 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:07.885935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46386758-a264-446c-a287-e96426d01f12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:07.885935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46386758-a264-446c-a287-e96426d01f12 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:07.890382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46386758-a264-446c-a287-e96426d01f12 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:07.890382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46386758-a264-446c-a287-e96426d01f12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:07.916843 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:08.017293 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46386758-a264-446c-a287-e96426d01f12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:08.019733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46386758-a264-446c-a287-e96426d01f12 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:08.042656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 816/1644] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:07 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:11.501232 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d44919-e22e-4751-9f27-b05fa2e9574a service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:11.509394 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:11.687819 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d44919-e22e-4751-9f27-b05fa2e9574a service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:11.700512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705c16f-1a9f-41b0-abbf-eb28e99d4a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:11.701460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705c16f-1a9f-41b0-abbf-eb28e99d4a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:11.701749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705c16f-1a9f-41b0-abbf-eb28e99d4a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:11.702029 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705c16f-1a9f-41b0-abbf-eb28e99d4a34 admin admin] PATH_INFO: `/v3/users/948afb941609473fb7478f388e4370ae` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:11.703984 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705c16f-1a9f-41b0-abbf-eb28e99d4a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=948afb941609473fb7478f388e4370ae)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:11.705083 dv-cinder-846146-4-smb devstack@keystone.service[92004]: WARNING py.warnings [None req-8705c16f-1a9f-41b0-abbf-eb28e99d4a34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:58:11.705083 dv-cinder-846146-4-smb devstack@keystone.service[92004]: warnings.warn(msg) Jun 23 10:58:11.705083 dv-cinder-846146-4-smb devstack@keystone.service[92004]: Jun 23 10:58:11.706377 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705c16f-1a9f-41b0-abbf-eb28e99d4a34 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:12.061584 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8705c16f-1a9f-41b0-abbf-eb28e99d4a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948afb941609473fb7478f388e4370ae'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:12.096335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8705c16f-1a9f-41b0-abbf-eb28e99d4a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948afb941609473fb7478f388e4370ae'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:12.098225 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8705c16f-1a9f-41b0-abbf-eb28e99d4a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948afb941609473fb7478f388e4370ae'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:12.193021 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8705c16f-1a9f-41b0-abbf-eb28e99d4a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948afb941609473fb7478f388e4370ae'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:12.193662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8705c16f-1a9f-41b0-abbf-eb28e99d4a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948afb941609473fb7478f388e4370ae'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:12.255716 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 829/1645] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:58:11 2022] DELETE /identity/v3/users/948afb941609473fb7478f388e4370ae => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:58:12.260501 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958f2bf-3299-4f6e-88bb-67f2e14b9339 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:12.269857 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958f2bf-3299-4f6e-88bb-67f2e14b9339 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:12.269857 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958f2bf-3299-4f6e-88bb-67f2e14b9339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:12.297275 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-1958f2bf-3299-4f6e-88bb-67f2e14b9339 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:12.299860 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-1958f2bf-3299-4f6e-88bb-67f2e14b9339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:12.321241 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705c16f-1a9f-41b0-abbf-eb28e99d4a34 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:12.325123 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8705c16f-1a9f-41b0-abbf-eb28e99d4a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:12.429520 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 817/1646] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:12.452730 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958f2bf-3299-4f6e-88bb-67f2e14b9339 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:12.454591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-1958f2bf-3299-4f6e-88bb-67f2e14b9339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:12.571773 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958f2bf-3299-4f6e-88bb-67f2e14b9339 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:12.579636 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705c16f-1a9f-41b0-abbf-eb28e99d4a34 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:12.587029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3f8af-8018-4450-a129-5cdc696dee63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:12.588040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3f8af-8018-4450-a129-5cdc696dee63 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:12.588933 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3f8af-8018-4450-a129-5cdc696dee63 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:12.589124 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3f8af-8018-4450-a129-5cdc696dee63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:12.591505 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d7b98-99c2-428c-966a-643237446b6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:12.592402 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d7b98-99c2-428c-966a-643237446b6d service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:12.593001 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d7b98-99c2-428c-966a-643237446b6d service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:12.593510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d7b98-99c2-428c-966a-643237446b6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:12.604187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-3b3d7b98-99c2-428c-966a-643237446b6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:12.628462 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3f8af-8018-4450-a129-5cdc696dee63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:12.630261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3f8af-8018-4450-a129-5cdc696dee63 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:12.643505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 818/1647] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:58:12.712929 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:12.764464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d7b98-99c2-428c-966a-643237446b6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:12.766873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d7b98-99c2-428c-966a-643237446b6d service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:12.780526 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 830/1648] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:14.102991 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3f8af-8018-4450-a129-5cdc696dee63 service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:14.105620 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9af3f8af-8018-4450-a129-5cdc696dee63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:14.125887 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3f8af-8018-4450-a129-5cdc696dee63 service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:14.161173 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42275097-245b-45a1-bf42-cb512cf448e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:14.162121 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42275097-245b-45a1-bf42-cb512cf448e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:14.162413 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42275097-245b-45a1-bf42-cb512cf448e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:14.162747 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42275097-245b-45a1-bf42-cb512cf448e7 admin admin] PATH_INFO: `/v3/users/9de3607d4fe14a2c9160366f21cec170` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:14.167565 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42275097-245b-45a1-bf42-cb512cf448e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de3607d4fe14a2c9160366f21cec170)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:14.169603 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42275097-245b-45a1-bf42-cb512cf448e7 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:14.271481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d7b98-99c2-428c-966a-643237446b6d service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:14.273519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-3b3d7b98-99c2-428c-966a-643237446b6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:14.293596 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d7b98-99c2-428c-966a-643237446b6d service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:14.312506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d7ebd-0d2c-4019-89d1-b98cf052e981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:14.322918 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d7ebd-0d2c-4019-89d1-b98cf052e981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:14.326810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d7ebd-0d2c-4019-89d1-b98cf052e981 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:14.326810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d7ebd-0d2c-4019-89d1-b98cf052e981 admin admin] PATH_INFO: `/v3/users/f94a5449ff13429aaf2e39ea98bc340c` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:14.326810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d7ebd-0d2c-4019-89d1-b98cf052e981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f94a5449ff13429aaf2e39ea98bc340c)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:14.329526 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d7ebd-0d2c-4019-89d1-b98cf052e981 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:14.538247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-42275097-245b-45a1-bf42-cb512cf448e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de3607d4fe14a2c9160366f21cec170'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:14.566022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-42275097-245b-45a1-bf42-cb512cf448e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de3607d4fe14a2c9160366f21cec170'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:14.575058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:14.671462 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-42275097-245b-45a1-bf42-cb512cf448e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de3607d4fe14a2c9160366f21cec170'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:14.672339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-42275097-245b-45a1-bf42-cb512cf448e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de3607d4fe14a2c9160366f21cec170'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:14.673219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-42275097-245b-45a1-bf42-cb512cf448e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de3607d4fe14a2c9160366f21cec170'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:14.691971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-831d7ebd-0d2c-4019-89d1-b98cf052e981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f94a5449ff13429aaf2e39ea98bc340c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:14.729307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-831d7ebd-0d2c-4019-89d1-b98cf052e981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f94a5449ff13429aaf2e39ea98bc340c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:14.731426 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-831d7ebd-0d2c-4019-89d1-b98cf052e981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f94a5449ff13429aaf2e39ea98bc340c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:14.746094 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 819/1649] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:58:14 2022] DELETE /identity/v3/users/9de3607d4fe14a2c9160366f21cec170 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:14.748458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0e8c3-cfd7-4668-a9cb-22af53f1649a None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:14.749181 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0e8c3-cfd7-4668-a9cb-22af53f1649a None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:14.749578 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0e8c3-cfd7-4668-a9cb-22af53f1649a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:14.798234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-c0e0e8c3-cfd7-4668-a9cb-22af53f1649a None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:14.801909 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c0e0e8c3-cfd7-4668-a9cb-22af53f1649a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:14.855208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-831d7ebd-0d2c-4019-89d1-b98cf052e981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f94a5449ff13429aaf2e39ea98bc340c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:14.855926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-831d7ebd-0d2c-4019-89d1-b98cf052e981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f94a5449ff13429aaf2e39ea98bc340c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:14.903267 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 831/1650] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:58:14 2022] DELETE /identity/v3/users/f94a5449ff13429aaf2e39ea98bc340c => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:14.908408 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d7ebd-0d2c-4019-89d1-b98cf052e981 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:14.918890 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-831d7ebd-0d2c-4019-89d1-b98cf052e981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:14.921279 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 820/1651] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:14.923221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a5d27-e0af-4805-b081-977dd4118173 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:14.926328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a5d27-e0af-4805-b081-977dd4118173 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:14.926328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a5d27-e0af-4805-b081-977dd4118173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:14.963924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-034a5d27-e0af-4805-b081-977dd4118173 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:14.968580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-034a5d27-e0af-4805-b081-977dd4118173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:15.084001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 821/1652] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:15.085630 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a5d27-e0af-4805-b081-977dd4118173 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:15.087836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-034a5d27-e0af-4805-b081-977dd4118173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:15.097729 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d7ebd-0d2c-4019-89d1-b98cf052e981 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:15.113140 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115d77c-eefd-4883-9d07-423a254cc692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:15.114070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115d77c-eefd-4883-9d07-423a254cc692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:15.114357 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115d77c-eefd-4883-9d07-423a254cc692 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:15.114963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115d77c-eefd-4883-9d07-423a254cc692 admin admin] PATH_INFO: `/v3/projects/c75e726f601b4cb9904a4ae26c1ba797` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:15.118651 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115d77c-eefd-4883-9d07-423a254cc692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c75e726f601b4cb9904a4ae26c1ba797)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:15.120802 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115d77c-eefd-4883-9d07-423a254cc692 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:15.249431 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a5d27-e0af-4805-b081-977dd4118173 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:15.262967 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c525d-56bd-4a02-b37c-7176a6910b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:15.263755 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c525d-56bd-4a02-b37c-7176a6910b7b service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:15.264046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c525d-56bd-4a02-b37c-7176a6910b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:15.264334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c525d-56bd-4a02-b37c-7176a6910b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:15.278299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c525d-56bd-4a02-b37c-7176a6910b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:15.279165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c525d-56bd-4a02-b37c-7176a6910b7b service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:15.305186 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 822/1653] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:15.306939 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c525d-56bd-4a02-b37c-7176a6910b7b service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:15.312707 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-916c525d-56bd-4a02-b37c-7176a6910b7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:15.334083 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:15.339889 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f115d77c-eefd-4883-9d07-423a254cc692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c75e726f601b4cb9904a4ae26c1ba797', 'request_id': 'req-f115d77c-eefd-4883-9d07-423a254cc692'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:15.343599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c525d-56bd-4a02-b37c-7176a6910b7b service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:15.448753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f115d77c-eefd-4883-9d07-423a254cc692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c75e726f601b4cb9904a4ae26c1ba797', 'request_id': 'req-f115d77c-eefd-4883-9d07-423a254cc692'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:15.459237 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f115d77c-eefd-4883-9d07-423a254cc692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c75e726f601b4cb9904a4ae26c1ba797', 'request_id': 'req-f115d77c-eefd-4883-9d07-423a254cc692'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:15.474675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9df47-3a0e-4da7-933b-db193871732b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:15.475742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9df47-3a0e-4da7-933b-db193871732b service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:15.476154 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9df47-3a0e-4da7-933b-db193871732b service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:15.476540 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9df47-3a0e-4da7-933b-db193871732b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:15.513831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f115d77c-eefd-4883-9d07-423a254cc692 admin admin] The token cache is being invalidate because project c75e726f601b4cb9904a4ae26c1ba797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:58:15.514104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f115d77c-eefd-4883-9d07-423a254cc692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:15.519448 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f115d77c-eefd-4883-9d07-423a254cc692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:15.525667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 832/1654] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:58:14 2022] DELETE /identity/v3/projects/c75e726f601b4cb9904a4ae26c1ba797 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:15.538873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100db352-6685-4067-9fa3-58f9c65519ae None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:15.538873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100db352-6685-4067-9fa3-58f9c65519ae None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:15.538873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100db352-6685-4067-9fa3-58f9c65519ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:15.606669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-100db352-6685-4067-9fa3-58f9c65519ae None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:15.609843 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-100db352-6685-4067-9fa3-58f9c65519ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:15.690450 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9df47-3a0e-4da7-933b-db193871732b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:15.693881 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9df47-3a0e-4da7-933b-db193871732b service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:15.745889 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 823/1655] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:15.815856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 833/1656] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:15.827501 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b58d8-6cfe-4893-9390-fae48f5f4004 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:15.832827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b58d8-6cfe-4893-9390-fae48f5f4004 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:15.838038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b58d8-6cfe-4893-9390-fae48f5f4004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:15.880695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-f84b58d8-6cfe-4893-9390-fae48f5f4004 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:15.882304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-f84b58d8-6cfe-4893-9390-fae48f5f4004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:15.909713 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 824/1657] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:15.910672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100db352-6685-4067-9fa3-58f9c65519ae None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:15.946857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100db352-6685-4067-9fa3-58f9c65519ae None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:15.957759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4343668-65f7-447b-823b-9a8f141ebd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:15.962182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4343668-65f7-447b-823b-9a8f141ebd4c admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:15.963486 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4343668-65f7-447b-823b-9a8f141ebd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:15.964576 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4343668-65f7-447b-823b-9a8f141ebd4c admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:15.980058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4343668-65f7-447b-823b-9a8f141ebd4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:58:15.980058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4343668-65f7-447b-823b-9a8f141ebd4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:15.980058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4343668-65f7-447b-823b-9a8f141ebd4c admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:16.018709 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 834/1658] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:58:16.023312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b58d8-6cfe-4893-9390-fae48f5f4004 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:16.038428 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b58d8-6cfe-4893-9390-fae48f5f4004 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:16.050251 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a3ed1-c033-468d-a9bd-5a8ae37b1450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:16.050942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a3ed1-c033-468d-a9bd-5a8ae37b1450 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:16.051957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a3ed1-c033-468d-a9bd-5a8ae37b1450 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:16.051957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a3ed1-c033-468d-a9bd-5a8ae37b1450 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:16.052294 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a3ed1-c033-468d-a9bd-5a8ae37b1450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:16.054190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a3ed1-c033-468d-a9bd-5a8ae37b1450 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:16.195688 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 825/1659] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:16 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:16.202663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4343668-65f7-447b-823b-9a8f141ebd4c admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:16.220427 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4343668-65f7-447b-823b-9a8f141ebd4c admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:16.374441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7f554-0307-4c04-8a5e-93a46ad106fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:16.375223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7f554-0307-4c04-8a5e-93a46ad106fd admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:16.375506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7f554-0307-4c04-8a5e-93a46ad106fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:16.375780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7f554-0307-4c04-8a5e-93a46ad106fd admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:16.379129 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7f554-0307-4c04-8a5e-93a46ad106fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:16.392926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7f554-0307-4c04-8a5e-93a46ad106fd admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:16.525276 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 835/1660] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:16 2022] POST /identity/v3/users => generated 284 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:16.527007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a3ed1-c033-468d-a9bd-5a8ae37b1450 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:16.553254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a3ed1-c033-468d-a9bd-5a8ae37b1450 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:16.561769 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80000c33-4f54-4e2a-8d8e-a3100f28bdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:16.562598 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80000c33-4f54-4e2a-8d8e-a3100f28bdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:16.562888 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80000c33-4f54-4e2a-8d8e-a3100f28bdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:16.563484 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80000c33-4f54-4e2a-8d8e-a3100f28bdd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:16.564224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80000c33-4f54-4e2a-8d8e-a3100f28bdd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:16.565947 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80000c33-4f54-4e2a-8d8e-a3100f28bdd5 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:16.597353 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 826/1661] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:16.599318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7f554-0307-4c04-8a5e-93a46ad106fd admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:16.627058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7f554-0307-4c04-8a5e-93a46ad106fd admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:16.640934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133fc1d-4e2e-49e0-b200-998920cde3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:16.641753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133fc1d-4e2e-49e0-b200-998920cde3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:16.642112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133fc1d-4e2e-49e0-b200-998920cde3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:16.642504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133fc1d-4e2e-49e0-b200-998920cde3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:16.643388 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133fc1d-4e2e-49e0-b200-998920cde3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:16.645199 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133fc1d-4e2e-49e0-b200-998920cde3a8 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:16.659539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:16.678693 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 836/1662] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:16.683388 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80000c33-4f54-4e2a-8d8e-a3100f28bdd5 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:16.699022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80000c33-4f54-4e2a-8d8e-a3100f28bdd5 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:16.712258 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774a3ec-dde8-425e-9ac2-56397be7079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:16.713717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774a3ec-dde8-425e-9ac2-56397be7079b admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:16.713717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774a3ec-dde8-425e-9ac2-56397be7079b admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:16.719411 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774a3ec-dde8-425e-9ac2-56397be7079b admin admin] PATH_INFO: `/v3/projects/b7bf3fe96f6e48ad88c61c3997e899c3/users/608acd4ad4f447bf99953aa5f8c0afe8/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:16.766792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774a3ec-dde8-425e-9ac2-56397be7079b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7bf3fe96f6e48ad88c61c3997e899c3, user_id=608acd4ad4f447bf99953aa5f8c0afe8, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:16.770445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774a3ec-dde8-425e-9ac2-56397be7079b admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:16.903351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 827/1663] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:16 2022] PUT /identity/v3/projects/b7bf3fe96f6e48ad88c61c3997e899c3/users/608acd4ad4f447bf99953aa5f8c0afe8/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:16.916659 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8ec42-b810-4d3f-b0e3-32611904d923 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:16.917013 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8ec42-b810-4d3f-b0e3-32611904d923 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:16.917368 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8ec42-b810-4d3f-b0e3-32611904d923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:16.994302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-26c8ec42-b810-4d3f-b0e3-32611904d923 None None] MFA Rules not processed for user `608acd4ad4f447bf99953aa5f8c0afe8`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:16.996572 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-26c8ec42-b810-4d3f-b0e3-32611904d923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:17.056730 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774a3ec-dde8-425e-9ac2-56397be7079b admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:17.059340 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-0774a3ec-dde8-425e-9ac2-56397be7079b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:17.156198 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 837/1664] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:17.169314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8ec42-b810-4d3f-b0e3-32611904d923 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:17.172369 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-26c8ec42-b810-4d3f-b0e3-32611904d923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:17.241142 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774a3ec-dde8-425e-9ac2-56397be7079b admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:17.241142 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ebdb0-d761-4bbb-ada7-7b915a896efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:17.241142 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ebdb0-d761-4bbb-ada7-7b915a896efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:17.241142 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ebdb0-d761-4bbb-ada7-7b915a896efb admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:17.241566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ebdb0-d761-4bbb-ada7-7b915a896efb admin admin] PATH_INFO: `/v3/projects/acf3d1ff5ada4aa6aed279f1ccad98fc` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:17.241566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ebdb0-d761-4bbb-ada7-7b915a896efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=acf3d1ff5ada4aa6aed279f1ccad98fc)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:17.241566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: WARNING py.warnings [None req-9e2ebdb0-d761-4bbb-ada7-7b915a896efb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:58:17.241566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: warnings.warn(msg) Jun 23 10:58:17.241566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: Jun 23 10:58:17.242964 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ebdb0-d761-4bbb-ada7-7b915a896efb admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:17.334332 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:17.343996 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8ec42-b810-4d3f-b0e3-32611904d923 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:17.349564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c4c18-349e-4c39-9018-3e0138c0be0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:17.350675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c4c18-349e-4c39-9018-3e0138c0be0c service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:17.350959 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c4c18-349e-4c39-9018-3e0138c0be0c service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:17.351320 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c4c18-349e-4c39-9018-3e0138c0be0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:17.362681 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c4c18-349e-4c39-9018-3e0138c0be0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:17.364213 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c4c18-349e-4c39-9018-3e0138c0be0c service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:17.375049 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 838/1665] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:17.376707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f142a2-c348-4c5b-a14e-299c0a844ff6 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:17.376941 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f142a2-c348-4c5b-a14e-299c0a844ff6 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:17.377234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f142a2-c348-4c5b-a14e-299c0a844ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:17.440421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-e0f142a2-c348-4c5b-a14e-299c0a844ff6 None None] MFA Rules not processed for user `d4ffb26d86d64d81bea84268e10386fc`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:17.443448 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e0f142a2-c348-4c5b-a14e-299c0a844ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:17.476154 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-9e2ebdb0-d761-4bbb-ada7-7b915a896efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf3d1ff5ada4aa6aed279f1ccad98fc', 'request_id': 'req-9e2ebdb0-d761-4bbb-ada7-7b915a896efb'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:17.485801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-9e2ebdb0-d761-4bbb-ada7-7b915a896efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf3d1ff5ada4aa6aed279f1ccad98fc', 'request_id': 'req-9e2ebdb0-d761-4bbb-ada7-7b915a896efb'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:17.508088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:17.594205 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 839/1666] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:17.603071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-9e2ebdb0-d761-4bbb-ada7-7b915a896efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf3d1ff5ada4aa6aed279f1ccad98fc', 'request_id': 'req-9e2ebdb0-d761-4bbb-ada7-7b915a896efb'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:17.615303 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f142a2-c348-4c5b-a14e-299c0a844ff6 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:17.622177 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e0f142a2-c348-4c5b-a14e-299c0a844ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:17.671449 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-9e2ebdb0-d761-4bbb-ada7-7b915a896efb admin admin] The token cache is being invalidate because project acf3d1ff5ada4aa6aed279f1ccad98fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:58:17.677158 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-9e2ebdb0-d761-4bbb-ada7-7b915a896efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:17.677158 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-9e2ebdb0-d761-4bbb-ada7-7b915a896efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:17.677158 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 828/1667] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:58:17 2022] DELETE /identity/v3/projects/acf3d1ff5ada4aa6aed279f1ccad98fc => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:58:17.679378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ebdb0-d761-4bbb-ada7-7b915a896efb admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:17.684895 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9e2ebdb0-d761-4bbb-ada7-7b915a896efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:17.820565 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f142a2-c348-4c5b-a14e-299c0a844ff6 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:17.837731 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaed18c-ed41-46b9-93c8-9c4d59a37ba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:17.843350 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaed18c-ed41-46b9-93c8-9c4d59a37ba6 service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:17.843350 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaed18c-ed41-46b9-93c8-9c4d59a37ba6 service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:17.843350 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaed18c-ed41-46b9-93c8-9c4d59a37ba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:17.843350 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-acaed18c-ed41-46b9-93c8-9c4d59a37ba6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:17.868685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaed18c-ed41-46b9-93c8-9c4d59a37ba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:17.870379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaed18c-ed41-46b9-93c8-9c4d59a37ba6 service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:17.873734 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ebdb0-d761-4bbb-ada7-7b915a896efb admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:17.880297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bec63-00fd-4d43-aa45-0fb8dc71f32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:17.881518 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bec63-00fd-4d43-aa45-0fb8dc71f32a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:17.881953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bec63-00fd-4d43-aa45-0fb8dc71f32a admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:17.882370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bec63-00fd-4d43-aa45-0fb8dc71f32a admin admin] PATH_INFO: `/v3/users/7aa6791b2f844a13a71a1ef2b0c32951` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:17.885627 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bec63-00fd-4d43-aa45-0fb8dc71f32a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa6791b2f844a13a71a1ef2b0c32951)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:17.892402 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 840/1668] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:17.900458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bec63-00fd-4d43-aa45-0fb8dc71f32a admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:17.902030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaed18c-ed41-46b9-93c8-9c4d59a37ba6 service nova] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:17.903621 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-acaed18c-ed41-46b9-93c8-9c4d59a37ba6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:17.962421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaed18c-ed41-46b9-93c8-9c4d59a37ba6 service nova] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:17.982561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249eb8d-5b05-4c3f-93b9-90ab77022c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:17.983562 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249eb8d-5b05-4c3f-93b9-90ab77022c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:17.983773 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249eb8d-5b05-4c3f-93b9-90ab77022c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:17.984055 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249eb8d-5b05-4c3f-93b9-90ab77022c9a admin admin] PATH_INFO: `/v3/projects/8bdabc98a2c745bf80153d7fed1faddb` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:17.987716 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249eb8d-5b05-4c3f-93b9-90ab77022c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bdabc98a2c745bf80153d7fed1faddb)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:17.989709 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249eb8d-5b05-4c3f-93b9-90ab77022c9a admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:18.251236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-1249eb8d-5b05-4c3f-93b9-90ab77022c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bdabc98a2c745bf80153d7fed1faddb', 'request_id': 'req-1249eb8d-5b05-4c3f-93b9-90ab77022c9a'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:18.376302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-1249eb8d-5b05-4c3f-93b9-90ab77022c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bdabc98a2c745bf80153d7fed1faddb', 'request_id': 'req-1249eb8d-5b05-4c3f-93b9-90ab77022c9a'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:18.385567 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-1249eb8d-5b05-4c3f-93b9-90ab77022c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bdabc98a2c745bf80153d7fed1faddb', 'request_id': 'req-1249eb8d-5b05-4c3f-93b9-90ab77022c9a'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:18.405122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-1249eb8d-5b05-4c3f-93b9-90ab77022c9a admin admin] The token cache is being invalidate because project 8bdabc98a2c745bf80153d7fed1faddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:58:18.405398 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-1249eb8d-5b05-4c3f-93b9-90ab77022c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:18.413568 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-1249eb8d-5b05-4c3f-93b9-90ab77022c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:18.419343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 841/1669] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:58:17 2022] DELETE /identity/v3/projects/8bdabc98a2c745bf80153d7fed1faddb => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:18.419343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5fd59-a3ec-40a0-aacc-e1d0e8ea16a5 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:18.419343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5fd59-a3ec-40a0-aacc-e1d0e8ea16a5 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:18.419343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5fd59-a3ec-40a0-aacc-e1d0e8ea16a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:18.488083 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-4bf5fd59-a3ec-40a0-aacc-e1d0e8ea16a5 None None] MFA Rules not processed for user `935cd7d4575941148be2d56a9fbdb88a`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:18.490870 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4bf5fd59-a3ec-40a0-aacc-e1d0e8ea16a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:18.495059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c29bec63-00fd-4d43-aa45-0fb8dc71f32a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa6791b2f844a13a71a1ef2b0c32951'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:18.510323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c29bec63-00fd-4d43-aa45-0fb8dc71f32a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa6791b2f844a13a71a1ef2b0c32951'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:18.604334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c29bec63-00fd-4d43-aa45-0fb8dc71f32a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa6791b2f844a13a71a1ef2b0c32951'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:18.605805 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c29bec63-00fd-4d43-aa45-0fb8dc71f32a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa6791b2f844a13a71a1ef2b0c32951'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:18.606575 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c29bec63-00fd-4d43-aa45-0fb8dc71f32a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa6791b2f844a13a71a1ef2b0c32951'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:18.665366 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 829/1670] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:58:17 2022] DELETE /identity/v3/users/7aa6791b2f844a13a71a1ef2b0c32951 => generated 0 bytes in 987 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:18.672044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2529c-b7a0-4f08-9a72-0e0519425454 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:18.678520 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2529c-b7a0-4f08-9a72-0e0519425454 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:18.679094 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2529c-b7a0-4f08-9a72-0e0519425454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:18.710173 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 842/1671] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:18.710173 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bf526-51ae-42a2-bfe1-a8af5623b69a None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:18.710173 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bf526-51ae-42a2-bfe1-a8af5623b69a None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:18.710173 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bf526-51ae-42a2-bfe1-a8af5623b69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:18.745911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-10b2529c-b7a0-4f08-9a72-0e0519425454 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:18.747496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-10b2529c-b7a0-4f08-9a72-0e0519425454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:18.798636 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-a82bf526-51ae-42a2-bfe1-a8af5623b69a None None] MFA Rules not processed for user `ff368431091d41ea898afc9b081eee6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:18.800399 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a82bf526-51ae-42a2-bfe1-a8af5623b69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:18.915491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 830/1672] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:18.916864 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9d4a7-1adc-417a-a739-3c94a244deec None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:18.917157 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9d4a7-1adc-417a-a739-3c94a244deec None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:18.917436 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9d4a7-1adc-417a-a739-3c94a244deec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:18.963383 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-5ea9d4a7-1adc-417a-a739-3c94a244deec None None] MFA Rules not processed for user `935cd7d4575941148be2d56a9fbdb88a`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:18.964542 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-5ea9d4a7-1adc-417a-a739-3c94a244deec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:19.000532 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 843/1673] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:19.003038 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8346f2-9b69-42f1-a87b-5072018ec92d None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:19.003499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8346f2-9b69-42f1-a87b-5072018ec92d None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:19.005243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8346f2-9b69-42f1-a87b-5072018ec92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:19.006509 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:19.064819 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-8e8346f2-9b69-42f1-a87b-5072018ec92d None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:19.066110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8e8346f2-9b69-42f1-a87b-5072018ec92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:19.102901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 844/1674] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:19.115299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ae031-c77c-4969-a337-7c526e7353cc None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:19.115299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ae031-c77c-4969-a337-7c526e7353cc None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:19.115299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ae031-c77c-4969-a337-7c526e7353cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:19.115594 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 831/1675] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:19.115594 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9d4a7-1adc-417a-a739-3c94a244deec None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:19.148323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9d4a7-1adc-417a-a739-3c94a244deec None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:19.166981 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692118ca-1eb0-4888-87ac-c0e0bca11355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:19.166981 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692118ca-1eb0-4888-87ac-c0e0bca11355 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:19.167223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-ca3ae031-c77c-4969-a337-7c526e7353cc None None] MFA Rules not processed for user `ff368431091d41ea898afc9b081eee6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:19.167315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692118ca-1eb0-4888-87ac-c0e0bca11355 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:19.167315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692118ca-1eb0-4888-87ac-c0e0bca11355 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:19.167315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692118ca-1eb0-4888-87ac-c0e0bca11355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:58:19.167724 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692118ca-1eb0-4888-87ac-c0e0bca11355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:19.168802 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ca3ae031-c77c-4969-a337-7c526e7353cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:19.169845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692118ca-1eb0-4888-87ac-c0e0bca11355 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:19.183830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 845/1676] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:19.183830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ae031-c77c-4969-a337-7c526e7353cc None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:19.183830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ca3ae031-c77c-4969-a337-7c526e7353cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:19.221006 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 832/1677] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:58:19.221006 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692118ca-1eb0-4888-87ac-c0e0bca11355 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:19.222655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-692118ca-1eb0-4888-87ac-c0e0bca11355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:19.394867 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ae031-c77c-4969-a337-7c526e7353cc None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:19.407489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135b91c-6a2b-4a66-8805-e80c74416b1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:19.409317 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135b91c-6a2b-4a66-8805-e80c74416b1d service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:19.409651 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135b91c-6a2b-4a66-8805-e80c74416b1d service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:19.409987 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135b91c-6a2b-4a66-8805-e80c74416b1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:19.434375 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135b91c-6a2b-4a66-8805-e80c74416b1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:19.440277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135b91c-6a2b-4a66-8805-e80c74416b1d service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:19.466828 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 846/1678] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:19.467674 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135b91c-6a2b-4a66-8805-e80c74416b1d service nova] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:19.484867 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692118ca-1eb0-4888-87ac-c0e0bca11355 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:19.485570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135b91c-6a2b-4a66-8805-e80c74416b1d service nova] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:19.485816 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1c0f6-3832-4ee3-ba70-f06ea2dec5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:19.486440 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1c0f6-3832-4ee3-ba70-f06ea2dec5fb admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:19.486728 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1c0f6-3832-4ee3-ba70-f06ea2dec5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:19.487008 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1c0f6-3832-4ee3-ba70-f06ea2dec5fb admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:19.487709 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1c0f6-3832-4ee3-ba70-f06ea2dec5fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:19.490276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f568d0-6dbc-4772-9082-b66a21c347f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:19.490418 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1c0f6-3832-4ee3-ba70-f06ea2dec5fb admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:19.490938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f568d0-6dbc-4772-9082-b66a21c347f0 service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:19.491228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f568d0-6dbc-4772-9082-b66a21c347f0 service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:19.491564 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f568d0-6dbc-4772-9082-b66a21c347f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:19.514511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f568d0-6dbc-4772-9082-b66a21c347f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:19.517548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f568d0-6dbc-4772-9082-b66a21c347f0 service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:19.529519 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 833/1679] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:19.536915 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:19.628889 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 847/1680] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:19 2022] POST /identity/v3/projects => generated 405 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:19.630945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f568d0-6dbc-4772-9082-b66a21c347f0 service nova] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:19.673634 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f568d0-6dbc-4772-9082-b66a21c347f0 service nova] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:19.871345 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbd038-5d12-4b76-a6ff-c613a5738f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:19.872453 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbd038-5d12-4b76-a6ff-c613a5738f8c admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:19.873998 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbd038-5d12-4b76-a6ff-c613a5738f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:19.874532 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbd038-5d12-4b76-a6ff-c613a5738f8c admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:19.875540 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbd038-5d12-4b76-a6ff-c613a5738f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:19.878194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbd038-5d12-4b76-a6ff-c613a5738f8c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:20.025216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 834/1681] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:19 2022] POST /identity/v3/users => generated 303 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:20.030531 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1c0f6-3832-4ee3-ba70-f06ea2dec5fb admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:20.049055 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1c0f6-3832-4ee3-ba70-f06ea2dec5fb admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:20.062859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6a6d8-7b62-44ae-a13a-911415ff5e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:20.064029 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6a6d8-7b62-44ae-a13a-911415ff5e55 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:20.064567 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6a6d8-7b62-44ae-a13a-911415ff5e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:20.069421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6a6d8-7b62-44ae-a13a-911415ff5e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:20.069421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6a6d8-7b62-44ae-a13a-911415ff5e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:20.069421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6a6d8-7b62-44ae-a13a-911415ff5e55 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:20.130098 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 848/1682] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:20.131758 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbd038-5d12-4b76-a6ff-c613a5738f8c admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:20.163656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbd038-5d12-4b76-a6ff-c613a5738f8c admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:20.183028 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4613d4-3681-4be5-a453-9506cc195b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:20.188311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4613d4-3681-4be5-a453-9506cc195b57 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:20.188311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4613d4-3681-4be5-a453-9506cc195b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:20.188311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4613d4-3681-4be5-a453-9506cc195b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:20.190321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4613d4-3681-4be5-a453-9506cc195b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:20.197699 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4613d4-3681-4be5-a453-9506cc195b57 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:20.222204 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 835/1683] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:20.226665 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6a6d8-7b62-44ae-a13a-911415ff5e55 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:20.244135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6a6d8-7b62-44ae-a13a-911415ff5e55 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:20.259941 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcbcc4-18fc-430e-b0b5-3cbd5670db9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:20.260915 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcbcc4-18fc-430e-b0b5-3cbd5670db9d admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:20.261200 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcbcc4-18fc-430e-b0b5-3cbd5670db9d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:20.264419 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcbcc4-18fc-430e-b0b5-3cbd5670db9d admin admin] PATH_INFO: `/v3/projects/bbaf0c8e80e0466bb2537f53793c54b5/users/dad0f1d0452945a68a73c97cd8270500/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:20.300607 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcbcc4-18fc-430e-b0b5-3cbd5670db9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbaf0c8e80e0466bb2537f53793c54b5, user_id=dad0f1d0452945a68a73c97cd8270500, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:20.303717 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcbcc4-18fc-430e-b0b5-3cbd5670db9d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:20.319898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4613d4-3681-4be5-a453-9506cc195b57 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:20.321971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-1a4613d4-3681-4be5-a453-9506cc195b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:20.363468 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4613d4-3681-4be5-a453-9506cc195b57 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:20.368882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7acca0-a05f-4e26-ac99-c970e1a738f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:20.369832 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7acca0-a05f-4e26-ac99-c970e1a738f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:20.370063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7acca0-a05f-4e26-ac99-c970e1a738f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:20.370348 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7acca0-a05f-4e26-ac99-c970e1a738f0 admin admin] PATH_INFO: `/v3/projects/3fcda83493474b05b280136b9095b029` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:20.373797 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7acca0-a05f-4e26-ac99-c970e1a738f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fcda83493474b05b280136b9095b029)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:20.375768 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7acca0-a05f-4e26-ac99-c970e1a738f0 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:20.445531 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 849/1684] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:20 2022] PUT /identity/v3/projects/bbaf0c8e80e0466bb2537f53793c54b5/users/dad0f1d0452945a68a73c97cd8270500/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:20.448216 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1d538-8675-4255-ab80-6a41d1cb2c73 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:20.449490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1d538-8675-4255-ab80-6a41d1cb2c73 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:20.449925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1d538-8675-4255-ab80-6a41d1cb2c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:20.569629 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:20.573495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-8bd1d538-8675-4255-ab80-6a41d1cb2c73 None None] MFA Rules not processed for user `dad0f1d0452945a68a73c97cd8270500`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:20.574763 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8bd1d538-8675-4255-ab80-6a41d1cb2c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:20.626098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-cd7acca0-a05f-4e26-ac99-c970e1a738f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fcda83493474b05b280136b9095b029', 'request_id': 'req-cd7acca0-a05f-4e26-ac99-c970e1a738f0'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:20.636267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-cd7acca0-a05f-4e26-ac99-c970e1a738f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fcda83493474b05b280136b9095b029', 'request_id': 'req-cd7acca0-a05f-4e26-ac99-c970e1a738f0'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:20.729897 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-cd7acca0-a05f-4e26-ac99-c970e1a738f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fcda83493474b05b280136b9095b029', 'request_id': 'req-cd7acca0-a05f-4e26-ac99-c970e1a738f0'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:20.782323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-cd7acca0-a05f-4e26-ac99-c970e1a738f0 admin admin] The token cache is being invalidate because project 3fcda83493474b05b280136b9095b029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:58:20.783220 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-cd7acca0-a05f-4e26-ac99-c970e1a738f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:20.784773 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-cd7acca0-a05f-4e26-ac99-c970e1a738f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:20.796351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 836/1685] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:58:20 2022] DELETE /identity/v3/projects/3fcda83493474b05b280136b9095b029 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:58:20.798221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a8996-f385-47f3-bece-658872ef2b74 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:20.801512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a8996-f385-47f3-bece-658872ef2b74 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:20.805772 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a8996-f385-47f3-bece-658872ef2b74 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:20.807984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 837/1686] 10.222.0.20 () {54 vars in 912 bytes} [Thu Jun 23 10:58:20 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:58:20.813389 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed46f3-bd6e-4276-8f3c-31547ca96ef9 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:20.814887 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed46f3-bd6e-4276-8f3c-31547ca96ef9 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:20.815255 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed46f3-bd6e-4276-8f3c-31547ca96ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:20.822685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 850/1687] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:20 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:20.824263 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a590403-d7da-4792-afa5-030df3dc90c4 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:20.824559 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a590403-d7da-4792-afa5-030df3dc90c4 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:20.824959 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a590403-d7da-4792-afa5-030df3dc90c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:20.881859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-d2ed46f3-bd6e-4276-8f3c-31547ca96ef9 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:20.886717 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-4a590403-d7da-4792-afa5-030df3dc90c4 None None] MFA Rules not processed for user `0348261a78984c62aced60af2768688e`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:20.886818 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d2ed46f3-bd6e-4276-8f3c-31547ca96ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:20.888045 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4a590403-d7da-4792-afa5-030df3dc90c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:21.040110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 851/1688] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 23 10:58:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:21.042898 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a590403-d7da-4792-afa5-030df3dc90c4 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:21.045667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4a590403-d7da-4792-afa5-030df3dc90c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:21.083093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 838/1689] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:21.084701 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2cc93-cbaf-42e9-b398-6848bec826ed None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:21.084967 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2cc93-cbaf-42e9-b398-6848bec826ed None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:21.085248 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2cc93-cbaf-42e9-b398-6848bec826ed None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:21.090066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 839/1690] 10.222.0.20 () {54 vars in 912 bytes} [Thu Jun 23 10:58:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:58:21.091596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab156a1-1f84-4e37-84d0-269847fbedd0 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:21.091898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab156a1-1f84-4e37-84d0-269847fbedd0 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:21.092181 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab156a1-1f84-4e37-84d0-269847fbedd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:21.108722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a590403-d7da-4792-afa5-030df3dc90c4 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:21.111309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99092554-7877-466d-b595-9c80b0a0a2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:21.114158 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99092554-7877-466d-b595-9c80b0a0a2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:21.114708 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99092554-7877-466d-b595-9c80b0a0a2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:21.115182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99092554-7877-466d-b595-9c80b0a0a2e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:21.116138 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99092554-7877-466d-b595-9c80b0a0a2e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:21.120584 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99092554-7877-466d-b595-9c80b0a0a2e9 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:21.134359 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-8ab156a1-1f84-4e37-84d0-269847fbedd0 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:21.135678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-8ab156a1-1f84-4e37-84d0-269847fbedd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:21.144750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 840/1691] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:21.146673 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970a0a3-f777-4cdf-b3f7-1154348b5fc6 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:21.147184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970a0a3-f777-4cdf-b3f7-1154348b5fc6 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:21.147666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970a0a3-f777-4cdf-b3f7-1154348b5fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:21.189711 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-7970a0a3-f777-4cdf-b3f7-1154348b5fc6 None None] MFA Rules not processed for user `0348261a78984c62aced60af2768688e`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:21.190994 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-7970a0a3-f777-4cdf-b3f7-1154348b5fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:21.207844 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 841/1692] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 23 10:58:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:21.214925 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970a0a3-f777-4cdf-b3f7-1154348b5fc6 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:21.216656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-7970a0a3-f777-4cdf-b3f7-1154348b5fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:21.241208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970a0a3-f777-4cdf-b3f7-1154348b5fc6 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:21.246686 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 852/1693] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:21 2022] POST /identity/v3/projects => generated 405 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:21.252168 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99092554-7877-466d-b595-9c80b0a0a2e9 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:21.362007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a6649-4f58-470b-8cfb-d0dd112ea8ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:21.362911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a6649-4f58-470b-8cfb-d0dd112ea8ae service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:21.363362 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a6649-4f58-470b-8cfb-d0dd112ea8ae service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:21.363940 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a6649-4f58-470b-8cfb-d0dd112ea8ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:21.377477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a6649-4f58-470b-8cfb-d0dd112ea8ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:21.379623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a6649-4f58-470b-8cfb-d0dd112ea8ae service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:21.401447 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 842/1694] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:21.402548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a6649-4f58-470b-8cfb-d0dd112ea8ae service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:21.490185 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99092554-7877-466d-b595-9c80b0a0a2e9 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:21.505557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd53a31-babd-4c5c-bab5-1f3b623bdb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:21.506268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd53a31-babd-4c5c-bab5-1f3b623bdb4d admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:21.506559 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd53a31-babd-4c5c-bab5-1f3b623bdb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:21.507008 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd53a31-babd-4c5c-bab5-1f3b623bdb4d admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:21.507633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd53a31-babd-4c5c-bab5-1f3b623bdb4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:58:21.508790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd53a31-babd-4c5c-bab5-1f3b623bdb4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:21.510502 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd53a31-babd-4c5c-bab5-1f3b623bdb4d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:21.541467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 853/1695] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:58:21.541467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd53a31-babd-4c5c-bab5-1f3b623bdb4d admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:21.553613 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-0fd53a31-babd-4c5c-bab5-1f3b623bdb4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:21.554204 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a6649-4f58-470b-8cfb-d0dd112ea8ae service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:21.574798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ea8ec-7cbc-47b0-962b-89653edcafe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:21.577610 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ea8ec-7cbc-47b0-962b-89653edcafe3 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:21.577610 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ea8ec-7cbc-47b0-962b-89653edcafe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:21.577610 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ea8ec-7cbc-47b0-962b-89653edcafe3 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:21.577864 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd53a31-babd-4c5c-bab5-1f3b623bdb4d admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:21.577945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ea8ec-7cbc-47b0-962b-89653edcafe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:21.582571 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ea8ec-7cbc-47b0-962b-89653edcafe3 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:21.596240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc62340-8799-4c0c-b50c-6bf124d897b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:21.597118 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc62340-8799-4c0c-b50c-6bf124d897b9 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:21.597383 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc62340-8799-4c0c-b50c-6bf124d897b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:21.597670 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc62340-8799-4c0c-b50c-6bf124d897b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:21.617068 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc62340-8799-4c0c-b50c-6bf124d897b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:21.619634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc62340-8799-4c0c-b50c-6bf124d897b9 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:21.644547 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 854/1696] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:21.648193 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539666e6-bf1e-47d6-af81-098f30890c85 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:21.649976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539666e6-bf1e-47d6-af81-098f30890c85 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:21.650855 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539666e6-bf1e-47d6-af81-098f30890c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:21.696250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 843/1697] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:21 2022] POST /identity/v3/users => generated 309 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:21.696250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ea8ec-7cbc-47b0-962b-89653edcafe3 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:21.722243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ea8ec-7cbc-47b0-962b-89653edcafe3 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:21.726907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-539666e6-bf1e-47d6-af81-098f30890c85 None None] MFA Rules not processed for user `c3f7f25cf67c40b5a03f4f692a198146`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:21.728156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-539666e6-bf1e-47d6-af81-098f30890c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:21.736411 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa59af-5aba-41b9-9659-224bff9c917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:21.737256 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa59af-5aba-41b9-9659-224bff9c917a admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:21.737843 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa59af-5aba-41b9-9659-224bff9c917a admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:21.738284 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa59af-5aba-41b9-9659-224bff9c917a admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:21.739630 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa59af-5aba-41b9-9659-224bff9c917a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:21.743785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa59af-5aba-41b9-9659-224bff9c917a admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:21.892762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 855/1698] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:21.893861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539666e6-bf1e-47d6-af81-098f30890c85 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:21.905535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 844/1699] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:21 2022] POST /identity/v3/projects => generated 367 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:21.910320 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa59af-5aba-41b9-9659-224bff9c917a admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:21.919765 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539666e6-bf1e-47d6-af81-098f30890c85 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:21.980136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:22.065182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6b17c-a597-4b34-9f3d-1bef6532ac0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:22.065971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6b17c-a597-4b34-9f3d-1bef6532ac0e admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:22.066253 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6b17c-a597-4b34-9f3d-1bef6532ac0e admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:22.066537 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6b17c-a597-4b34-9f3d-1bef6532ac0e admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:22.067616 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6b17c-a597-4b34-9f3d-1bef6532ac0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:22.071790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6b17c-a597-4b34-9f3d-1bef6532ac0e admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:22.101399 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 856/1700] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:22.106035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6b17c-a597-4b34-9f3d-1bef6532ac0e admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:22.132603 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6b17c-a597-4b34-9f3d-1bef6532ac0e admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:22.142301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa59af-5aba-41b9-9659-224bff9c917a admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:22.151068 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46858fa7-823d-4824-9358-2f4b385a4474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:22.153243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46858fa7-823d-4824-9358-2f4b385a4474 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:22.153243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46858fa7-823d-4824-9358-2f4b385a4474 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:22.153243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46858fa7-823d-4824-9358-2f4b385a4474 admin admin] PATH_INFO: `/v3/projects/e677f28a5ff04ca2aa1d1266368f9747/users/5b40c1e6211840edac214214b4a752d7/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:22.159581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ba3c2-376d-465c-a583-f4a174077847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:22.161036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ba3c2-376d-465c-a583-f4a174077847 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:22.161036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ba3c2-376d-465c-a583-f4a174077847 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:22.161036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ba3c2-376d-465c-a583-f4a174077847 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:22.164398 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ba3c2-376d-465c-a583-f4a174077847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:22.178187 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ba3c2-376d-465c-a583-f4a174077847 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:22.200897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46858fa7-823d-4824-9358-2f4b385a4474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e677f28a5ff04ca2aa1d1266368f9747, user_id=5b40c1e6211840edac214214b4a752d7, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:22.207233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46858fa7-823d-4824-9358-2f4b385a4474 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:22.317476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 845/1701] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:21 2022] POST /identity/v3/users => generated 284 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:22.318823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ba3c2-376d-465c-a583-f4a174077847 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:22.350644 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 857/1702] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:22 2022] PUT /identity/v3/projects/e677f28a5ff04ca2aa1d1266368f9747/users/5b40c1e6211840edac214214b4a752d7/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:22.353777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46858fa7-823d-4824-9358-2f4b385a4474 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:22.355982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ba3c2-376d-465c-a583-f4a174077847 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:22.491882 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46858fa7-823d-4824-9358-2f4b385a4474 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:22.505583 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b457ac-f763-452e-abfe-1fe5b94aa2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:22.507004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b457ac-f763-452e-abfe-1fe5b94aa2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:22.507004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b457ac-f763-452e-abfe-1fe5b94aa2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:22.507004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b457ac-f763-452e-abfe-1fe5b94aa2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:22.511121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b457ac-f763-452e-abfe-1fe5b94aa2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:22.511121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b457ac-f763-452e-abfe-1fe5b94aa2e3 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:22.533184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 858/1703] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:58:22.535907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b457ac-f763-452e-abfe-1fe5b94aa2e3 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:22.558262 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b457ac-f763-452e-abfe-1fe5b94aa2e3 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:22.569137 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827074c-de29-45b7-8025-1e832ce97c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:22.569772 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827074c-de29-45b7-8025-1e832ce97c4a admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:22.570066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827074c-de29-45b7-8025-1e832ce97c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:22.570348 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827074c-de29-45b7-8025-1e832ce97c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:22.571455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827074c-de29-45b7-8025-1e832ce97c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:22.572998 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827074c-de29-45b7-8025-1e832ce97c4a admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:22.581509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfcf4e-d780-47a6-b23a-849624551852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:22.582537 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfcf4e-d780-47a6-b23a-849624551852 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:22.582823 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfcf4e-d780-47a6-b23a-849624551852 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:22.583107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfcf4e-d780-47a6-b23a-849624551852 admin admin] PATH_INFO: `/v3/projects/e677f28a5ff04ca2aa1d1266368f9747/users/5b40c1e6211840edac214214b4a752d7/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:22.585311 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfcf4e-d780-47a6-b23a-849624551852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e677f28a5ff04ca2aa1d1266368f9747, user_id=5b40c1e6211840edac214214b4a752d7, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:22.588200 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfcf4e-d780-47a6-b23a-849624551852 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:22.598740 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 846/1704] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:22.604822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827074c-de29-45b7-8025-1e832ce97c4a admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:22.627088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 859/1705] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:22 2022] PUT /identity/v3/projects/e677f28a5ff04ca2aa1d1266368f9747/users/5b40c1e6211840edac214214b4a752d7/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:22.647403 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bb12f-927a-47db-8b86-9d15d5df5a95 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:22.647403 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bb12f-927a-47db-8b86-9d15d5df5a95 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:22.647403 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bb12f-927a-47db-8b86-9d15d5df5a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:22.647632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827074c-de29-45b7-8025-1e832ce97c4a admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:22.725936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-6f6bb12f-927a-47db-8b86-9d15d5df5a95 None None] MFA Rules not processed for user `5b40c1e6211840edac214214b4a752d7`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:22.727898 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-6f6bb12f-927a-47db-8b86-9d15d5df5a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:22.857286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:22.882371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3f6d2-931e-49a8-97a9-81dfaa3483d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:22.883688 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3f6d2-931e-49a8-97a9-81dfaa3483d0 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:22.884179 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3f6d2-931e-49a8-97a9-81dfaa3483d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:22.884768 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3f6d2-931e-49a8-97a9-81dfaa3483d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:22.885486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3f6d2-931e-49a8-97a9-81dfaa3483d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:22.887266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3f6d2-931e-49a8-97a9-81dfaa3483d0 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:22.944556 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 847/1706] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:22.947684 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3f6d2-931e-49a8-97a9-81dfaa3483d0 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:22.957125 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-06a3f6d2-931e-49a8-97a9-81dfaa3483d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:22.971803 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 860/1707] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:22 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:22.992155 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d4a04-6974-4e5e-8e7f-ff21e05b3dfb None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:22.993566 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d4a04-6974-4e5e-8e7f-ff21e05b3dfb None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:22.994028 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d4a04-6974-4e5e-8e7f-ff21e05b3dfb None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:22.995629 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 861/1708] 10.222.0.20 () {54 vars in 960 bytes} [Thu Jun 23 10:58:22 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:58:22.996415 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d4a04-6974-4e5e-8e7f-ff21e05b3dfb None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:23.038411 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d4a04-6974-4e5e-8e7f-ff21e05b3dfb None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:23.057795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cde71-a235-44c2-b113-e84eaad0c6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:23.061176 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cde71-a235-44c2-b113-e84eaad0c6d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:23.065326 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cde71-a235-44c2-b113-e84eaad0c6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:23.065919 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cde71-a235-44c2-b113-e84eaad0c6d4 admin admin] PATH_INFO: `/v3/projects/c52c4a9b0a26454a852f9fd3e299519d/users/414da3a602194594bacf47e33f98d1c9/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:23.108627 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cde71-a235-44c2-b113-e84eaad0c6d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52c4a9b0a26454a852f9fd3e299519d, user_id=414da3a602194594bacf47e33f98d1c9, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:23.115383 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cde71-a235-44c2-b113-e84eaad0c6d4 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:23.123197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:23.193766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3f6d2-931e-49a8-97a9-81dfaa3483d0 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:23.203200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31133e26-a6ea-485a-9276-06d314f14c7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:23.203946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31133e26-a6ea-485a-9276-06d314f14c7d service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:23.204242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31133e26-a6ea-485a-9276-06d314f14c7d service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:23.204522 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31133e26-a6ea-485a-9276-06d314f14c7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:23.223789 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 862/1709] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:22 2022] PUT /identity/v3/projects/c52c4a9b0a26454a852f9fd3e299519d/users/414da3a602194594bacf47e33f98d1c9/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:23.236884 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1b7fa-f7a0-482e-b787-56de2d505f49 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:23.237279 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1b7fa-f7a0-482e-b787-56de2d505f49 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:23.238254 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1b7fa-f7a0-482e-b787-56de2d505f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:23.316906 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-e4c1b7fa-f7a0-482e-b787-56de2d505f49 None None] MFA Rules not processed for user `6ff588aaad264f9cbc5a80e73ef0c09d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:23.329494 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e4c1b7fa-f7a0-482e-b787-56de2d505f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:23.370357 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31133e26-a6ea-485a-9276-06d314f14c7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:23.377340 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31133e26-a6ea-485a-9276-06d314f14c7d service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:23.412806 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 848/1710] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:23.413781 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31133e26-a6ea-485a-9276-06d314f14c7d service nova] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:23.416845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-31133e26-a6ea-485a-9276-06d314f14c7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:23.635072 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31133e26-a6ea-485a-9276-06d314f14c7d service nova] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:23.666994 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 863/1711] 10.222.0.20 () {58 vars in 1057 bytes} [Thu Jun 23 10:58:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:23.667811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1b7fa-f7a0-482e-b787-56de2d505f49 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:23.673571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e4c1b7fa-f7a0-482e-b787-56de2d505f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:23.705506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1b7fa-f7a0-482e-b787-56de2d505f49 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:23.715972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddfaad-b242-4c9c-ba22-64129265de10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff588aaad264f9cbc5a80e73ef0c09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:23.719416 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddfaad-b242-4c9c-ba22-64129265de10 service placement] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:23.719416 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddfaad-b242-4c9c-ba22-64129265de10 service placement] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:23.719416 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddfaad-b242-4c9c-ba22-64129265de10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:23.720590 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e9ddfaad-b242-4c9c-ba22-64129265de10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:23.737521 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddfaad-b242-4c9c-ba22-64129265de10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:23.756855 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4a4c3-19f4-458e-98ea-b57a03837e67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:23.757637 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4a4c3-19f4-458e-98ea-b57a03837e67 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:23.758608 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4a4c3-19f4-458e-98ea-b57a03837e67 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:23.761109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddfaad-b242-4c9c-ba22-64129265de10 service placement] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:23.761239 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4a4c3-19f4-458e-98ea-b57a03837e67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:23.785100 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 864/1712] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:23.786616 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151fa95-df57-4b12-b756-dae457e8ab0c None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:23.787026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151fa95-df57-4b12-b756-dae457e8ab0c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:23.787394 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151fa95-df57-4b12-b756-dae457e8ab0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:23.835010 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-d151fa95-df57-4b12-b756-dae457e8ab0c None None] MFA Rules not processed for user `414da3a602194594bacf47e33f98d1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:23.841169 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-d151fa95-df57-4b12-b756-dae457e8ab0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:23.949377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4a4c3-19f4-458e-98ea-b57a03837e67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:23.951696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4a4c3-19f4-458e-98ea-b57a03837e67 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:24.011101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 849/1713] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:23 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:24.018138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13855e-903f-4372-a19a-e403a3a0c643 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:24.018430 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13855e-903f-4372-a19a-e403a3a0c643 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:24.020966 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13855e-903f-4372-a19a-e403a3a0c643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:24.135594 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 865/1714] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:24.136175 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-6e13855e-903f-4372-a19a-e403a3a0c643 None None] MFA Rules not processed for user `935cd7d4575941148be2d56a9fbdb88a`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:24.136567 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151fa95-df57-4b12-b756-dae457e8ab0c None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:24.147109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6e13855e-903f-4372-a19a-e403a3a0c643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:24.171336 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151fa95-df57-4b12-b756-dae457e8ab0c None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:24.188314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749ecab-365f-4c39-be05-a9f33b9d010d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff588aaad264f9cbc5a80e73ef0c09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:24.194543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749ecab-365f-4c39-be05-a9f33b9d010d service placement] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:24.194543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749ecab-365f-4c39-be05-a9f33b9d010d service placement] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:24.194543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749ecab-365f-4c39-be05-a9f33b9d010d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:24.206042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749ecab-365f-4c39-be05-a9f33b9d010d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:24.207850 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749ecab-365f-4c39-be05-a9f33b9d010d service placement] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:24.223153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 866/1715] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:24.223153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749ecab-365f-4c39-be05-a9f33b9d010d service placement] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:24.406787 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 850/1716] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:24.495440 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749ecab-365f-4c39-be05-a9f33b9d010d service placement] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:24.533866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47827f2a-4d74-49fb-b021-3aaaee8242f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:24.538025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47827f2a-4d74-49fb-b021-3aaaee8242f0 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:24.538025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47827f2a-4d74-49fb-b021-3aaaee8242f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:24.538025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47827f2a-4d74-49fb-b021-3aaaee8242f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:24.538025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47827f2a-4d74-49fb-b021-3aaaee8242f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:24.538025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47827f2a-4d74-49fb-b021-3aaaee8242f0 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:24.707340 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:24.716151 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 867/1717] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:24 2022] POST /identity/v3/projects => generated 367 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:24.737966 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13855e-903f-4372-a19a-e403a3a0c643 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:24.768392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13855e-903f-4372-a19a-e403a3a0c643 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:24.849591 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47827f2a-4d74-49fb-b021-3aaaee8242f0 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:24.973890 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1518c-075e-4db2-b523-081b88dc7f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:24.975862 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1518c-075e-4db2-b523-081b88dc7f04 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:24.976246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1518c-075e-4db2-b523-081b88dc7f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:24.977683 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1518c-075e-4db2-b523-081b88dc7f04 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:24.980130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1518c-075e-4db2-b523-081b88dc7f04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:24.984514 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1518c-075e-4db2-b523-081b88dc7f04 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:25.056173 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:25.075590 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47827f2a-4d74-49fb-b021-3aaaee8242f0 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:25.090182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fd17e-9c85-4dc5-8d98-797d4770135c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:25.092845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fd17e-9c85-4dc5-8d98-797d4770135c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:25.093399 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fd17e-9c85-4dc5-8d98-797d4770135c admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:25.093982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fd17e-9c85-4dc5-8d98-797d4770135c admin admin] PATH_INFO: `/v3/users/dad0f1d0452945a68a73c97cd8270500` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:25.095705 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33fd17e-9c85-4dc5-8d98-797d4770135c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad0f1d0452945a68a73c97cd8270500)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:25.098353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33fd17e-9c85-4dc5-8d98-797d4770135c admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:25.119152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 851/1718] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:24 2022] POST /identity/v3/users => generated 290 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:25.123481 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1518c-075e-4db2-b523-081b88dc7f04 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:25.155643 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1518c-075e-4db2-b523-081b88dc7f04 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:25.183095 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394aee98-30bd-4363-a243-f3ab6f08baaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:25.184694 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394aee98-30bd-4363-a243-f3ab6f08baaf admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:25.185145 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394aee98-30bd-4363-a243-f3ab6f08baaf admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:25.185616 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394aee98-30bd-4363-a243-f3ab6f08baaf admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:25.186543 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394aee98-30bd-4363-a243-f3ab6f08baaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:25.206592 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394aee98-30bd-4363-a243-f3ab6f08baaf admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:25.234956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 852/1719] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:25.238880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394aee98-30bd-4363-a243-f3ab6f08baaf admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:25.261067 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394aee98-30bd-4363-a243-f3ab6f08baaf admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:25.285733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d5b7f-7b3a-431d-8070-57bda77391a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:25.286905 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d5b7f-7b3a-431d-8070-57bda77391a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:25.287440 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d5b7f-7b3a-431d-8070-57bda77391a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:25.287881 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d5b7f-7b3a-431d-8070-57bda77391a1 admin admin] PATH_INFO: `/v3/projects/f2edd634d6fe47278894d539b0269f15/users/7f89c5dedd5d43f7962b170ff0611405/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:25.341456 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d5b7f-7b3a-431d-8070-57bda77391a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2edd634d6fe47278894d539b0269f15, user_id=7f89c5dedd5d43f7962b170ff0611405, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:25.344411 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d5b7f-7b3a-431d-8070-57bda77391a1 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:25.449621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 853/1720] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:25 2022] PUT /identity/v3/projects/f2edd634d6fe47278894d539b0269f15/users/7f89c5dedd5d43f7962b170ff0611405/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:25.450718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-b33fd17e-9c85-4dc5-8d98-797d4770135c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad0f1d0452945a68a73c97cd8270500'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:25.454032 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d5b7f-7b3a-431d-8070-57bda77391a1 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:25.510697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-b33fd17e-9c85-4dc5-8d98-797d4770135c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad0f1d0452945a68a73c97cd8270500'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:25.512033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-b33fd17e-9c85-4dc5-8d98-797d4770135c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad0f1d0452945a68a73c97cd8270500'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:25.620779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d5b7f-7b3a-431d-8070-57bda77391a1 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:25.628050 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ea6b7-8dc1-4507-885a-c2236c7b5405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:25.628968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ea6b7-8dc1-4507-885a-c2236c7b5405 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:25.629634 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ea6b7-8dc1-4507-885a-c2236c7b5405 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:25.629914 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ea6b7-8dc1-4507-885a-c2236c7b5405 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:25.630686 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ea6b7-8dc1-4507-885a-c2236c7b5405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:25.632709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ea6b7-8dc1-4507-885a-c2236c7b5405 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:25.640591 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-b33fd17e-9c85-4dc5-8d98-797d4770135c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad0f1d0452945a68a73c97cd8270500'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:25.641624 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-b33fd17e-9c85-4dc5-8d98-797d4770135c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad0f1d0452945a68a73c97cd8270500'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:25.678657 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 854/1721] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:25.694163 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7891bd-9d29-447e-92c8-27ac6cbf7582 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:25.694163 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7891bd-9d29-447e-92c8-27ac6cbf7582 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:25.694163 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7891bd-9d29-447e-92c8-27ac6cbf7582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:25.697082 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 868/1722] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:58:24 2022] DELETE /identity/v3/users/dad0f1d0452945a68a73c97cd8270500 => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:25.699754 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fd17e-9c85-4dc5-8d98-797d4770135c admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:25.703878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-b33fd17e-9c85-4dc5-8d98-797d4770135c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:25.761201 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-dd7891bd-9d29-447e-92c8-27ac6cbf7582 None None] MFA Rules not processed for user `d4ffb26d86d64d81bea84268e10386fc`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:25.764682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-dd7891bd-9d29-447e-92c8-27ac6cbf7582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:25.883610 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 855/1723] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:25.885663 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa1563-1e51-4271-bf3f-5eefaf73a413 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:25.886075 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa1563-1e51-4271-bf3f-5eefaf73a413 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:25.886479 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa1563-1e51-4271-bf3f-5eefaf73a413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:25.904936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fd17e-9c85-4dc5-8d98-797d4770135c admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:25.909487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-1aaa1563-1e51-4271-bf3f-5eefaf73a413 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:25.910874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-1aaa1563-1e51-4271-bf3f-5eefaf73a413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:25.919353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d62f30-3ea4-4a6f-8294-60bc2141329a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:25.924066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 856/1724] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:25.930976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d62f30-3ea4-4a6f-8294-60bc2141329a admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:25.930976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d62f30-3ea4-4a6f-8294-60bc2141329a admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:25.930976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d62f30-3ea4-4a6f-8294-60bc2141329a admin admin] PATH_INFO: `/v3/projects/f2edd634d6fe47278894d539b0269f15/users/7f89c5dedd5d43f7962b170ff0611405/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:25.930976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d62f30-3ea4-4a6f-8294-60bc2141329a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2edd634d6fe47278894d539b0269f15, user_id=7f89c5dedd5d43f7962b170ff0611405, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:25.932152 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d62f30-3ea4-4a6f-8294-60bc2141329a admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:25.935204 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa1563-1e51-4271-bf3f-5eefaf73a413 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:25.942188 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-1aaa1563-1e51-4271-bf3f-5eefaf73a413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:25.947035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 869/1725] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:25 2022] PUT /identity/v3/projects/f2edd634d6fe47278894d539b0269f15/users/7f89c5dedd5d43f7962b170ff0611405/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:25.969405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e1a6a-178f-4304-a7ac-665777a454e0 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:25.969405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e1a6a-178f-4304-a7ac-665777a454e0 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:25.971376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e1a6a-178f-4304-a7ac-665777a454e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:26.057266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-e23e1a6a-178f-4304-a7ac-665777a454e0 None None] MFA Rules not processed for user `7f89c5dedd5d43f7962b170ff0611405`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:26.059727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e23e1a6a-178f-4304-a7ac-665777a454e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:26.151903 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa1563-1e51-4271-bf3f-5eefaf73a413 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:26.314065 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6930e93-01c4-4e65-9262-97c06016949f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:26.315027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6930e93-01c4-4e65-9262-97c06016949f service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:26.315473 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6930e93-01c4-4e65-9262-97c06016949f service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:26.316098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6930e93-01c4-4e65-9262-97c06016949f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:26.373721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 870/1726] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:25 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:26.397647 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e1a6a-178f-4304-a7ac-665777a454e0 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:26.406952 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e23e1a6a-178f-4304-a7ac-665777a454e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:26.477898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6930e93-01c4-4e65-9262-97c06016949f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:26.479700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6930e93-01c4-4e65-9262-97c06016949f service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:26.493007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 857/1727] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:26.496691 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e1a6a-178f-4304-a7ac-665777a454e0 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:26.500939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209de162-3ede-4a7d-8c64-ee4ca0d205f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:26.501622 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209de162-3ede-4a7d-8c64-ee4ca0d205f8 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:26.501911 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209de162-3ede-4a7d-8c64-ee4ca0d205f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:26.502190 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209de162-3ede-4a7d-8c64-ee4ca0d205f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:26.518207 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209de162-3ede-4a7d-8c64-ee4ca0d205f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:26.520561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209de162-3ede-4a7d-8c64-ee4ca0d205f8 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:26.544136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 871/1728] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:26 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:26.849316 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:27.525407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:28.030584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6930e93-01c4-4e65-9262-97c06016949f service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:28.032925 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e6930e93-01c4-4e65-9262-97c06016949f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:28.106313 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6930e93-01c4-4e65-9262-97c06016949f service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:28.136590 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881cbe3-e424-4b64-b7ff-a50506036978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:28.142836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881cbe3-e424-4b64-b7ff-a50506036978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:28.142836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881cbe3-e424-4b64-b7ff-a50506036978 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:28.142836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881cbe3-e424-4b64-b7ff-a50506036978 admin admin] PATH_INFO: `/v3/projects/bbaf0c8e80e0466bb2537f53793c54b5` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:28.164797 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881cbe3-e424-4b64-b7ff-a50506036978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbaf0c8e80e0466bb2537f53793c54b5)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:28.180885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881cbe3-e424-4b64-b7ff-a50506036978 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:28.436162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-4881cbe3-e424-4b64-b7ff-a50506036978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbaf0c8e80e0466bb2537f53793c54b5', 'request_id': 'req-4881cbe3-e424-4b64-b7ff-a50506036978'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:28.457116 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-4881cbe3-e424-4b64-b7ff-a50506036978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbaf0c8e80e0466bb2537f53793c54b5', 'request_id': 'req-4881cbe3-e424-4b64-b7ff-a50506036978'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:28.553972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-4881cbe3-e424-4b64-b7ff-a50506036978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbaf0c8e80e0466bb2537f53793c54b5', 'request_id': 'req-4881cbe3-e424-4b64-b7ff-a50506036978'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:28.575421 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-4881cbe3-e424-4b64-b7ff-a50506036978 admin admin] The token cache is being invalidate because project bbaf0c8e80e0466bb2537f53793c54b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:58:28.576011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-4881cbe3-e424-4b64-b7ff-a50506036978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:28.578945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-4881cbe3-e424-4b64-b7ff-a50506036978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:28.582201 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 858/1729] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:58:28 2022] DELETE /identity/v3/projects/bbaf0c8e80e0466bb2537f53793c54b5 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:28.586146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209de162-3ede-4a7d-8c64-ee4ca0d205f8 service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:28.599152 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209de162-3ede-4a7d-8c64-ee4ca0d205f8 service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:28.650296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:28.734709 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84c768-aa97-4529-9d7a-2164ace93072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:28.736122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84c768-aa97-4529-9d7a-2164ace93072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:28.736623 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84c768-aa97-4529-9d7a-2164ace93072 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:28.737156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84c768-aa97-4529-9d7a-2164ace93072 admin admin] PATH_INFO: `/v3/users/5b40c1e6211840edac214214b4a752d7` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:28.738769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84c768-aa97-4529-9d7a-2164ace93072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b40c1e6211840edac214214b4a752d7)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:28.741498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84c768-aa97-4529-9d7a-2164ace93072 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:29.051394 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-cd84c768-aa97-4529-9d7a-2164ace93072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b40c1e6211840edac214214b4a752d7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:29.063332 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-cd84c768-aa97-4529-9d7a-2164ace93072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b40c1e6211840edac214214b4a752d7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:29.064398 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-cd84c768-aa97-4529-9d7a-2164ace93072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b40c1e6211840edac214214b4a752d7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:29.142530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:29.221979 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-cd84c768-aa97-4529-9d7a-2164ace93072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b40c1e6211840edac214214b4a752d7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:29.222993 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-cd84c768-aa97-4529-9d7a-2164ace93072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b40c1e6211840edac214214b4a752d7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:29.294351 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 872/1730] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:58:28 2022] DELETE /identity/v3/users/5b40c1e6211840edac214214b4a752d7 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:29.734421 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:29.848471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fe6d4-f277-4aa8-a512-279b5aca4001 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:29.848811 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fe6d4-f277-4aa8-a512-279b5aca4001 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:29.849307 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fe6d4-f277-4aa8-a512-279b5aca4001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:29.897855 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-941fe6d4-f277-4aa8-a512-279b5aca4001 None None] MFA Rules not processed for user `c3f7f25cf67c40b5a03f4f692a198146`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:29.897855 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-941fe6d4-f277-4aa8-a512-279b5aca4001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:30.032090 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 859/1731] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:30.217234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccc723-b134-4c0a-9a54-25a44c17c230 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:30.217713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccc723-b134-4c0a-9a54-25a44c17c230 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:30.217792 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccc723-b134-4c0a-9a54-25a44c17c230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:30.251213 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-80ccc723-b134-4c0a-9a54-25a44c17c230 None None] MFA Rules not processed for user `1b03d940626a449dbe904f02f3d70854`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:30.252844 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-80ccc723-b134-4c0a-9a54-25a44c17c230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:30.483245 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 873/1732] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 23 10:58:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:58:30.963953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fe6d4-f277-4aa8-a512-279b5aca4001 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:30.965968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-941fe6d4-f277-4aa8-a512-279b5aca4001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:31.045459 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:31.183942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fe6d4-f277-4aa8-a512-279b5aca4001 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:31.207960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92da3fc-59a2-43c4-ba11-90d622347fe7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a54fa1c326f41e88688404a56b75c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:31.208947 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92da3fc-59a2-43c4-ba11-90d622347fe7 service swift] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:31.209390 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92da3fc-59a2-43c4-ba11-90d622347fe7 service swift] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:31.209982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92da3fc-59a2-43c4-ba11-90d622347fe7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:31.249971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92da3fc-59a2-43c4-ba11-90d622347fe7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:31.254530 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92da3fc-59a2-43c4-ba11-90d622347fe7 service swift] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:31.272047 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:31.289878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 860/1733] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 23 10:58:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:58:32.089504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccc723-b134-4c0a-9a54-25a44c17c230 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:32.091703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-80ccc723-b134-4c0a-9a54-25a44c17c230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:32.380732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccc723-b134-4c0a-9a54-25a44c17c230 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:32.408992 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb868a-1049-4109-b03d-2d61e09437aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:32.413888 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb868a-1049-4109-b03d-2d61e09437aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:32.414728 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb868a-1049-4109-b03d-2d61e09437aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:32.416617 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb868a-1049-4109-b03d-2d61e09437aa admin admin] PATH_INFO: `/v3/projects/e677f28a5ff04ca2aa1d1266368f9747` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:32.420806 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb868a-1049-4109-b03d-2d61e09437aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e677f28a5ff04ca2aa1d1266368f9747)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:32.432973 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb868a-1049-4109-b03d-2d61e09437aa admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:32.739272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-bfbb868a-1049-4109-b03d-2d61e09437aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e677f28a5ff04ca2aa1d1266368f9747', 'request_id': 'req-bfbb868a-1049-4109-b03d-2d61e09437aa'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:33.013941 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-bfbb868a-1049-4109-b03d-2d61e09437aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e677f28a5ff04ca2aa1d1266368f9747', 'request_id': 'req-bfbb868a-1049-4109-b03d-2d61e09437aa'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:33.026561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-bfbb868a-1049-4109-b03d-2d61e09437aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e677f28a5ff04ca2aa1d1266368f9747', 'request_id': 'req-bfbb868a-1049-4109-b03d-2d61e09437aa'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:33.049197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-bfbb868a-1049-4109-b03d-2d61e09437aa admin admin] The token cache is being invalidate because project e677f28a5ff04ca2aa1d1266368f9747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:58:33.051154 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-bfbb868a-1049-4109-b03d-2d61e09437aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:33.051154 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-bfbb868a-1049-4109-b03d-2d61e09437aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:33.059354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 874/1734] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:58:32 2022] DELETE /identity/v3/projects/e677f28a5ff04ca2aa1d1266368f9747 => generated 0 bytes in 970 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:33.064050 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6dd88-73bc-449f-82f5-8bc5513c3e97 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:33.064629 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6dd88-73bc-449f-82f5-8bc5513c3e97 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:33.064770 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6dd88-73bc-449f-82f5-8bc5513c3e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:33.097382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-e0a6dd88-73bc-449f-82f5-8bc5513c3e97 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:33.098677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e0a6dd88-73bc-449f-82f5-8bc5513c3e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:33.211874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 861/1735] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:33.218757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d505ee-f137-43ef-90cb-ff2aaa02c2ef None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:33.219269 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d505ee-f137-43ef-90cb-ff2aaa02c2ef None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:33.219750 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d505ee-f137-43ef-90cb-ff2aaa02c2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:33.278596 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-70d505ee-f137-43ef-90cb-ff2aaa02c2ef None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:33.281795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-70d505ee-f137-43ef-90cb-ff2aaa02c2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:33.293773 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 875/1736] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:33.298485 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6dd88-73bc-449f-82f5-8bc5513c3e97 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:33.312185 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6dd88-73bc-449f-82f5-8bc5513c3e97 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:33.318173 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e719455-bae7-435f-a8a3-ea673d6d4ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:33.318563 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e719455-bae7-435f-a8a3-ea673d6d4ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:33.319374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e719455-bae7-435f-a8a3-ea673d6d4ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:33.320347 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e719455-bae7-435f-a8a3-ea673d6d4ca2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:33.322348 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e719455-bae7-435f-a8a3-ea673d6d4ca2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:58:33.322887 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e719455-bae7-435f-a8a3-ea673d6d4ca2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:33.326029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e719455-bae7-435f-a8a3-ea673d6d4ca2 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:33.365675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 862/1737] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:58:33.366130 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d505ee-f137-43ef-90cb-ff2aaa02c2ef None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:33.389600 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d505ee-f137-43ef-90cb-ff2aaa02c2ef None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:33.413484 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3676ce-7118-4e12-9789-58ab15fa701d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:33.416539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3676ce-7118-4e12-9789-58ab15fa701d admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:33.417123 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3676ce-7118-4e12-9789-58ab15fa701d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:33.418240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3676ce-7118-4e12-9789-58ab15fa701d admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:33.420621 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3676ce-7118-4e12-9789-58ab15fa701d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:33.435988 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3676ce-7118-4e12-9789-58ab15fa701d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:33.524838 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077a198-7b5d-4c24-8d20-741302179d11 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:33.525417 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077a198-7b5d-4c24-8d20-741302179d11 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:33.526079 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077a198-7b5d-4c24-8d20-741302179d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:33.575613 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-b077a198-7b5d-4c24-8d20-741302179d11 None None] MFA Rules not processed for user `0348261a78984c62aced60af2768688e`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:33.584394 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b077a198-7b5d-4c24-8d20-741302179d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:33.624363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 876/1738] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:33 2022] POST /identity/v3/projects => generated 403 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:33.625431 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3676ce-7118-4e12-9789-58ab15fa701d admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:33.719245 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:33.855183 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 863/1739] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Jun 23 10:58:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:58:33.866793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077a198-7b5d-4c24-8d20-741302179d11 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:33.877018 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b077a198-7b5d-4c24-8d20-741302179d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:33.895542 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3676ce-7118-4e12-9789-58ab15fa701d admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:33.902679 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3908ad-31ad-4e8a-ab4a-b7308a04695f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:33.903599 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3908ad-31ad-4e8a-ab4a-b7308a04695f admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:33.903985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3908ad-31ad-4e8a-ab4a-b7308a04695f admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:33.904361 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3908ad-31ad-4e8a-ab4a-b7308a04695f admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:33.905243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3908ad-31ad-4e8a-ab4a-b7308a04695f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:33.907240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3908ad-31ad-4e8a-ab4a-b7308a04695f admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:33.911983 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:33.923269 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077a198-7b5d-4c24-8d20-741302179d11 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:33.931155 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61f0b8-1ed6-4397-8b10-bc9f144af6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:33.933128 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61f0b8-1ed6-4397-8b10-bc9f144af6f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:33.934438 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61f0b8-1ed6-4397-8b10-bc9f144af6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:33.936062 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61f0b8-1ed6-4397-8b10-bc9f144af6f5 admin admin] PATH_INFO: `/v3/users/414da3a602194594bacf47e33f98d1c9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:33.939679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61f0b8-1ed6-4397-8b10-bc9f144af6f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=414da3a602194594bacf47e33f98d1c9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:33.944117 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61f0b8-1ed6-4397-8b10-bc9f144af6f5 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:34.013333 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 877/1740] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:33 2022] POST /identity/v3/users => generated 302 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:34.014360 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3908ad-31ad-4e8a-ab4a-b7308a04695f admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:34.023894 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-cd3908ad-31ad-4e8a-ab4a-b7308a04695f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:34.187257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3908ad-31ad-4e8a-ab4a-b7308a04695f admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:34.212489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bd5cc-5f37-4f42-a48f-60d235739ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:34.213234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bd5cc-5f37-4f42-a48f-60d235739ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:34.213480 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bd5cc-5f37-4f42-a48f-60d235739ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:34.213757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bd5cc-5f37-4f42-a48f-60d235739ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:34.251319 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6e61f0b8-1ed6-4397-8b10-bc9f144af6f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '414da3a602194594bacf47e33f98d1c9'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:34.283030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bd5cc-5f37-4f42-a48f-60d235739ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:34.310865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6e61f0b8-1ed6-4397-8b10-bc9f144af6f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '414da3a602194594bacf47e33f98d1c9'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:34.311060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bd5cc-5f37-4f42-a48f-60d235739ec4 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:34.334079 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 878/1741] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:34.337405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bd5cc-5f37-4f42-a48f-60d235739ec4 service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:34.339328 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-969bd5cc-5f37-4f42-a48f-60d235739ec4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:34.377010 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bd5cc-5f37-4f42-a48f-60d235739ec4 service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:34.385546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab94922-d5e9-4db3-94d5-fc414f57a65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:34.387066 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab94922-d5e9-4db3-94d5-fc414f57a65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:34.387549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab94922-d5e9-4db3-94d5-fc414f57a65b admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:34.388202 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab94922-d5e9-4db3-94d5-fc414f57a65b admin admin] PATH_INFO: `/v3/users/25aab3924ce4498898ef341be81353e7` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:34.389807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab94922-d5e9-4db3-94d5-fc414f57a65b admin admin] RBAC: Authorizing `identity:delete_user(user_id=25aab3924ce4498898ef341be81353e7)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:34.392790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab94922-d5e9-4db3-94d5-fc414f57a65b admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:34.692514 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6e61f0b8-1ed6-4397-8b10-bc9f144af6f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '414da3a602194594bacf47e33f98d1c9'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:34.693731 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6e61f0b8-1ed6-4397-8b10-bc9f144af6f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '414da3a602194594bacf47e33f98d1c9'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:34.694454 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6e61f0b8-1ed6-4397-8b10-bc9f144af6f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '414da3a602194594bacf47e33f98d1c9'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:34.739434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 864/1742] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:58:33 2022] DELETE /identity/v3/users/414da3a602194594bacf47e33f98d1c9 => generated 0 bytes in 884 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:34.740338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61f0b8-1ed6-4397-8b10-bc9f144af6f5 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:34.741829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6e61f0b8-1ed6-4397-8b10-bc9f144af6f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:34.989201 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-5ab94922-d5e9-4db3-94d5-fc414f57a65b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25aab3924ce4498898ef341be81353e7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:34.998813 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61f0b8-1ed6-4397-8b10-bc9f144af6f5 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:35.008522 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-5ab94922-d5e9-4db3-94d5-fc414f57a65b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25aab3924ce4498898ef341be81353e7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:35.010597 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be394f07-c4e9-474e-ac92-fbaf77f30ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:35.011327 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be394f07-c4e9-474e-ac92-fbaf77f30ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:35.011613 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be394f07-c4e9-474e-ac92-fbaf77f30ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:35.011934 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be394f07-c4e9-474e-ac92-fbaf77f30ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:35.013096 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-5ab94922-d5e9-4db3-94d5-fc414f57a65b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25aab3924ce4498898ef341be81353e7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:35.016175 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be394f07-c4e9-474e-ac92-fbaf77f30ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:35.019512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be394f07-c4e9-474e-ac92-fbaf77f30ab9 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:35.035806 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 865/1743] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:35.038251 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dcd44-59e9-42c3-9ef1-a2206630dda7 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:35.038662 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dcd44-59e9-42c3-9ef1-a2206630dda7 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:35.038827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dcd44-59e9-42c3-9ef1-a2206630dda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:35.064455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-ca5dcd44-59e9-42c3-9ef1-a2206630dda7 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:35.066810 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ca5dcd44-59e9-42c3-9ef1-a2206630dda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:35.085505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 866/1744] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:35.087961 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dcd44-59e9-42c3-9ef1-a2206630dda7 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:35.090567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ca5dcd44-59e9-42c3-9ef1-a2206630dda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:35.096007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-5ab94922-d5e9-4db3-94d5-fc414f57a65b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25aab3924ce4498898ef341be81353e7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:35.097294 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-5ab94922-d5e9-4db3-94d5-fc414f57a65b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25aab3924ce4498898ef341be81353e7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:35.160706 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 879/1745] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:58:34 2022] DELETE /identity/v3/users/25aab3924ce4498898ef341be81353e7 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:35.167812 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dcd44-59e9-42c3-9ef1-a2206630dda7 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:35.167972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb09de-e6b1-4c94-9ccb-baf6ef5588f5 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:35.167972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb09de-e6b1-4c94-9ccb-baf6ef5588f5 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:35.167972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb09de-e6b1-4c94-9ccb-baf6ef5588f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:35.207870 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-8ecb09de-e6b1-4c94-9ccb-baf6ef5588f5 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:35.222599 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8ecb09de-e6b1-4c94-9ccb-baf6ef5588f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:35.333408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52388d-0be3-44bc-8895-49a763c701fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:35.348103 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52388d-0be3-44bc-8895-49a763c701fc admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:35.352197 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52388d-0be3-44bc-8895-49a763c701fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:35.352759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52388d-0be3-44bc-8895-49a763c701fc admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:35.355405 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52388d-0be3-44bc-8895-49a763c701fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:35.365237 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52388d-0be3-44bc-8895-49a763c701fc admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:35.400623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 867/1746] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:35.410102 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52388d-0be3-44bc-8895-49a763c701fc admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:35.415214 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-bc52388d-0be3-44bc-8895-49a763c701fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:35.448494 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 880/1747] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:58:35.450276 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb09de-e6b1-4c94-9ccb-baf6ef5588f5 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:35.461918 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb09de-e6b1-4c94-9ccb-baf6ef5588f5 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:35.468016 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799abaa-da3c-4999-9921-c82d112d5a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:35.469429 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799abaa-da3c-4999-9921-c82d112d5a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:35.470400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799abaa-da3c-4999-9921-c82d112d5a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:35.470842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799abaa-da3c-4999-9921-c82d112d5a63 admin admin] PATH_INFO: `/v3/projects/f27ed1097c35486a864cd17d53cb3294/users/54e89bce266d48ffb29a21960f0241d1/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:35.516111 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799abaa-da3c-4999-9921-c82d112d5a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27ed1097c35486a864cd17d53cb3294, user_id=54e89bce266d48ffb29a21960f0241d1, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:35.519358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799abaa-da3c-4999-9921-c82d112d5a63 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:35.584045 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52388d-0be3-44bc-8895-49a763c701fc admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:35.590617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287489d-4eab-486f-a792-97a5df037153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:35.601303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287489d-4eab-486f-a792-97a5df037153 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:35.601303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287489d-4eab-486f-a792-97a5df037153 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:35.601303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287489d-4eab-486f-a792-97a5df037153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:35.626601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287489d-4eab-486f-a792-97a5df037153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:35.628712 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287489d-4eab-486f-a792-97a5df037153 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:35.696377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 868/1748] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:35.698873 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287489d-4eab-486f-a792-97a5df037153 service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:35.741404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287489d-4eab-486f-a792-97a5df037153 service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:35.752200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde7923-2baf-4623-bd59-59056ee15b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:35.753486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde7923-2baf-4623-bd59-59056ee15b0f service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:35.756563 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde7923-2baf-4623-bd59-59056ee15b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:35.757040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde7923-2baf-4623-bd59-59056ee15b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:35.764436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 881/1749] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:35 2022] PUT /identity/v3/projects/f27ed1097c35486a864cd17d53cb3294/users/54e89bce266d48ffb29a21960f0241d1/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:35.769881 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01425348-ee73-4922-96f9-244e4270fbcf None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:35.770460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01425348-ee73-4922-96f9-244e4270fbcf None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:35.772686 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01425348-ee73-4922-96f9-244e4270fbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:35.778788 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde7923-2baf-4623-bd59-59056ee15b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:35.781527 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde7923-2baf-4623-bd59-59056ee15b0f service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:35.796338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 869/1750] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:35.812813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-01425348-ee73-4922-96f9-244e4270fbcf None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:35.816020 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-01425348-ee73-4922-96f9-244e4270fbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:35.861849 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde7923-2baf-4623-bd59-59056ee15b0f service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:35.864279 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-dbde7923-2baf-4623-bd59-59056ee15b0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:35.918366 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde7923-2baf-4623-bd59-59056ee15b0f service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:35.958082 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 882/1751] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:35.999821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01425348-ee73-4922-96f9-244e4270fbcf None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:36.158260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01425348-ee73-4922-96f9-244e4270fbcf None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:36.168919 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f2d9b-fc2d-4f32-8ebf-5300bbec54a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:36.170146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2d9b-fc2d-4f32-8ebf-5300bbec54a1 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:36.170463 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2d9b-fc2d-4f32-8ebf-5300bbec54a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:36.170798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2d9b-fc2d-4f32-8ebf-5300bbec54a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:36.186357 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f2d9b-fc2d-4f32-8ebf-5300bbec54a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:36.187908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f2d9b-fc2d-4f32-8ebf-5300bbec54a1 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:36.190441 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f354d3-eef6-4884-91ad-40bdfcf28483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:36.192023 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f354d3-eef6-4884-91ad-40bdfcf28483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:36.194751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f354d3-eef6-4884-91ad-40bdfcf28483 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:36.195978 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f354d3-eef6-4884-91ad-40bdfcf28483 admin admin] PATH_INFO: `/v3/users/608acd4ad4f447bf99953aa5f8c0afe8` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:36.198519 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f354d3-eef6-4884-91ad-40bdfcf28483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=608acd4ad4f447bf99953aa5f8c0afe8)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:36.209101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f354d3-eef6-4884-91ad-40bdfcf28483 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:36.209254 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 883/1752] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:58:36.659563 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:36.664375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-83f354d3-eef6-4884-91ad-40bdfcf28483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '608acd4ad4f447bf99953aa5f8c0afe8'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:36.679622 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-83f354d3-eef6-4884-91ad-40bdfcf28483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '608acd4ad4f447bf99953aa5f8c0afe8'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:36.766889 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-83f354d3-eef6-4884-91ad-40bdfcf28483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '608acd4ad4f447bf99953aa5f8c0afe8'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:36.774512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-83f354d3-eef6-4884-91ad-40bdfcf28483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '608acd4ad4f447bf99953aa5f8c0afe8'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:36.774512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-83f354d3-eef6-4884-91ad-40bdfcf28483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '608acd4ad4f447bf99953aa5f8c0afe8'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:36.826593 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 870/1753] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:58:35 2022] DELETE /identity/v3/users/608acd4ad4f447bf99953aa5f8c0afe8 => generated 0 bytes in 966 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:36.832711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2409f-b0d1-49c8-b3ac-ebdf4d875c23 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:36.833154 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2409f-b0d1-49c8-b3ac-ebdf4d875c23 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:36.833570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2409f-b0d1-49c8-b3ac-ebdf4d875c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:36.886235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-1df2409f-b0d1-49c8-b3ac-ebdf4d875c23 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:36.888191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-1df2409f-b0d1-49c8-b3ac-ebdf4d875c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:37.076121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 884/1754] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:58:37.174201 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f354d3-eef6-4884-91ad-40bdfcf28483 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:37.176301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-83f354d3-eef6-4884-91ad-40bdfcf28483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:37.288338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f354d3-eef6-4884-91ad-40bdfcf28483 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:37.299519 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dd6c2-0894-4ee5-b354-5346a0a70d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:37.302109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dd6c2-0894-4ee5-b354-5346a0a70d16 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:37.303550 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dd6c2-0894-4ee5-b354-5346a0a70d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:37.303835 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dd6c2-0894-4ee5-b354-5346a0a70d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:37.317683 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60dd6c2-0894-4ee5-b354-5346a0a70d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:37.333018 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60dd6c2-0894-4ee5-b354-5346a0a70d16 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:37.366541 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 871/1755] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:37.403917 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:37.501830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7e7e6-2f1f-4511-a847-36b2999d9404 None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:37.502376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7e7e6-2f1f-4511-a847-36b2999d9404 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:37.502747 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7e7e6-2f1f-4511-a847-36b2999d9404 None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:37.504916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 885/1756] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jun 23 10:58:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:58:37.569135 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0f4f4-bded-46e6-a12f-686278c3285e None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:37.569819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0f4f4-bded-46e6-a12f-686278c3285e None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:37.570459 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0f4f4-bded-46e6-a12f-686278c3285e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:37.643975 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-89c0f4f4-bded-46e6-a12f-686278c3285e None None] MFA Rules not processed for user `39840f048d254831bdb963b38520f706`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:37.646516 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-89c0f4f4-bded-46e6-a12f-686278c3285e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:37.869288 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 872/1757] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jun 23 10:58:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:37.890616 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7e7e6-2f1f-4511-a847-36b2999d9404 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:37.895719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-cfe7e7e6-2f1f-4511-a847-36b2999d9404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:37.919513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7e7e6-2f1f-4511-a847-36b2999d9404 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:37.930782 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1c86f-4adc-4965-8720-949d3b5c09e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:37.943212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1c86f-4adc-4965-8720-949d3b5c09e5 service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:37.943426 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1c86f-4adc-4965-8720-949d3b5c09e5 service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:37.943890 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1c86f-4adc-4965-8720-949d3b5c09e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:37.955387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1c86f-4adc-4965-8720-949d3b5c09e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:37.957722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1c86f-4adc-4965-8720-949d3b5c09e5 service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:37.991600 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 886/1758] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:38.286533 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0f4f4-bded-46e6-a12f-686278c3285e None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:38.291590 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-89c0f4f4-bded-46e6-a12f-686278c3285e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:38.325812 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0f4f4-bded-46e6-a12f-686278c3285e None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:38.335164 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26aaa8-6e55-4de1-922d-2e2b50065fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:38.335164 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26aaa8-6e55-4de1-922d-2e2b50065fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:38.335164 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26aaa8-6e55-4de1-922d-2e2b50065fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:38.335164 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26aaa8-6e55-4de1-922d-2e2b50065fc4 admin admin] PATH_INFO: `/v3/projects/c52c4a9b0a26454a852f9fd3e299519d` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:38.335501 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26aaa8-6e55-4de1-922d-2e2b50065fc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c52c4a9b0a26454a852f9fd3e299519d)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:38.353787 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26aaa8-6e55-4de1-922d-2e2b50065fc4 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:38.762618 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-8a26aaa8-6e55-4de1-922d-2e2b50065fc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c52c4a9b0a26454a852f9fd3e299519d', 'request_id': 'req-8a26aaa8-6e55-4de1-922d-2e2b50065fc4'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:38.771266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-8a26aaa8-6e55-4de1-922d-2e2b50065fc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c52c4a9b0a26454a852f9fd3e299519d', 'request_id': 'req-8a26aaa8-6e55-4de1-922d-2e2b50065fc4'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:38.897090 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-8a26aaa8-6e55-4de1-922d-2e2b50065fc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c52c4a9b0a26454a852f9fd3e299519d', 'request_id': 'req-8a26aaa8-6e55-4de1-922d-2e2b50065fc4'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:38.922005 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-8a26aaa8-6e55-4de1-922d-2e2b50065fc4 admin admin] The token cache is being invalidate because project c52c4a9b0a26454a852f9fd3e299519d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:58:38.927447 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-8a26aaa8-6e55-4de1-922d-2e2b50065fc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:38.927447 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-8a26aaa8-6e55-4de1-922d-2e2b50065fc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:38.930682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 873/1759] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:58:38 2022] DELETE /identity/v3/projects/c52c4a9b0a26454a852f9fd3e299519d => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:38.935279 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1c86f-4adc-4965-8720-949d3b5c09e5 service nova] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:38.957948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1c86f-4adc-4965-8720-949d3b5c09e5 service nova] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:39.157665 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62050ad0-1757-4abd-810f-8fd76ff29def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:39.159555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62050ad0-1757-4abd-810f-8fd76ff29def admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:39.160156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62050ad0-1757-4abd-810f-8fd76ff29def admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:39.160684 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62050ad0-1757-4abd-810f-8fd76ff29def admin admin] PATH_INFO: `/v3/users/7f89c5dedd5d43f7962b170ff0611405` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:39.162359 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62050ad0-1757-4abd-810f-8fd76ff29def admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f89c5dedd5d43f7962b170ff0611405)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:39.165492 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62050ad0-1757-4abd-810f-8fd76ff29def admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:39.719466 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-62050ad0-1757-4abd-810f-8fd76ff29def admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f89c5dedd5d43f7962b170ff0611405'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:39.769531 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-62050ad0-1757-4abd-810f-8fd76ff29def admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f89c5dedd5d43f7962b170ff0611405'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:39.773383 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-62050ad0-1757-4abd-810f-8fd76ff29def admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f89c5dedd5d43f7962b170ff0611405'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:39.847834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-62050ad0-1757-4abd-810f-8fd76ff29def admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f89c5dedd5d43f7962b170ff0611405'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:39.851143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-62050ad0-1757-4abd-810f-8fd76ff29def admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f89c5dedd5d43f7962b170ff0611405'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:39.865870 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56a02c-9c57-45c3-a848-77a2c5287d43 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:39.866595 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56a02c-9c57-45c3-a848-77a2c5287d43 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:39.867764 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56a02c-9c57-45c3-a848-77a2c5287d43 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:39.871771 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 874/1760] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jun 23 10:58:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:58:39.927050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 887/1761] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:58:38 2022] DELETE /identity/v3/users/7f89c5dedd5d43f7962b170ff0611405 => generated 0 bytes in 992 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:39.931482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322cbbf-eea3-4c0c-be4d-1f61c2661149 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:39.932461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322cbbf-eea3-4c0c-be4d-1f61c2661149 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:39.935110 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322cbbf-eea3-4c0c-be4d-1f61c2661149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:39.972990 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-6322cbbf-eea3-4c0c-be4d-1f61c2661149 None None] MFA Rules not processed for user `39840f048d254831bdb963b38520f706`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:39.975351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6322cbbf-eea3-4c0c-be4d-1f61c2661149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:40.175280 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 875/1762] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jun 23 10:58:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:58:40.267579 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62050ad0-1757-4abd-810f-8fd76ff29def admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:40.272179 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-62050ad0-1757-4abd-810f-8fd76ff29def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:40.422887 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62050ad0-1757-4abd-810f-8fd76ff29def admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:40.431392 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00751436-2cbf-4c8a-bfa2-93303c7413fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:40.433883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00751436-2cbf-4c8a-bfa2-93303c7413fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:40.433883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00751436-2cbf-4c8a-bfa2-93303c7413fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:40.433883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00751436-2cbf-4c8a-bfa2-93303c7413fd admin admin] PATH_INFO: `/v3/projects/fd51118c47904dec808ca1f9e0bbacb8` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:40.435029 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00751436-2cbf-4c8a-bfa2-93303c7413fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd51118c47904dec808ca1f9e0bbacb8)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:40.437278 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00751436-2cbf-4c8a-bfa2-93303c7413fd admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:40.600208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-00751436-2cbf-4c8a-bfa2-93303c7413fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd51118c47904dec808ca1f9e0bbacb8', 'request_id': 'req-00751436-2cbf-4c8a-bfa2-93303c7413fd'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:40.688119 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-00751436-2cbf-4c8a-bfa2-93303c7413fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd51118c47904dec808ca1f9e0bbacb8', 'request_id': 'req-00751436-2cbf-4c8a-bfa2-93303c7413fd'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:40.696129 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-00751436-2cbf-4c8a-bfa2-93303c7413fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd51118c47904dec808ca1f9e0bbacb8', 'request_id': 'req-00751436-2cbf-4c8a-bfa2-93303c7413fd'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:40.723732 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322cbbf-eea3-4c0c-be4d-1f61c2661149 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:40.723732 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6322cbbf-eea3-4c0c-be4d-1f61c2661149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:40.728724 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-00751436-2cbf-4c8a-bfa2-93303c7413fd admin admin] The token cache is being invalidate because project fd51118c47904dec808ca1f9e0bbacb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:58:40.729156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-00751436-2cbf-4c8a-bfa2-93303c7413fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:40.730526 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-00751436-2cbf-4c8a-bfa2-93303c7413fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:40.734301 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 888/1763] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:58:40 2022] DELETE /identity/v3/projects/fd51118c47904dec808ca1f9e0bbacb8 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:40.738222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00751436-2cbf-4c8a-bfa2-93303c7413fd admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:40.739969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-00751436-2cbf-4c8a-bfa2-93303c7413fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:40.771729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322cbbf-eea3-4c0c-be4d-1f61c2661149 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:40.900141 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d798ec4-c4b9-4882-978c-9be19362dfa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:40.901373 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d798ec4-c4b9-4882-978c-9be19362dfa3 service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:40.901950 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d798ec4-c4b9-4882-978c-9be19362dfa3 service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:40.902393 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d798ec4-c4b9-4882-978c-9be19362dfa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:40.904623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-0d798ec4-c4b9-4882-978c-9be19362dfa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:40.909287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00751436-2cbf-4c8a-bfa2-93303c7413fd admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:40.917750 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b721c-7102-4aa5-9d7e-9b601c697f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:40.920316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d798ec4-c4b9-4882-978c-9be19362dfa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:40.920887 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b721c-7102-4aa5-9d7e-9b601c697f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:40.922364 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b721c-7102-4aa5-9d7e-9b601c697f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:40.922924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d798ec4-c4b9-4882-978c-9be19362dfa3 service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:40.924031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b721c-7102-4aa5-9d7e-9b601c697f7a admin admin] PATH_INFO: `/v3/users/8747c8f0aea548168501fa50da3d074b` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:40.932050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:40.936522 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b721c-7102-4aa5-9d7e-9b601c697f7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8747c8f0aea548168501fa50da3d074b)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:40.941438 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b721c-7102-4aa5-9d7e-9b601c697f7a admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:40.942867 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 876/1764] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:58:40.993500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d798ec4-c4b9-4882-978c-9be19362dfa3 service nova] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:40.996021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-0d798ec4-c4b9-4882-978c-9be19362dfa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:41.023193 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d798ec4-c4b9-4882-978c-9be19362dfa3 service nova] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:41.035008 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682a4a4-b159-4362-89c5-b073999117c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:41.035896 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682a4a4-b159-4362-89c5-b073999117c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:41.036538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682a4a4-b159-4362-89c5-b073999117c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:41.037191 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682a4a4-b159-4362-89c5-b073999117c2 admin admin] PATH_INFO: `/v3/projects/b7bf3fe96f6e48ad88c61c3997e899c3` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:41.040552 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682a4a4-b159-4362-89c5-b073999117c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7bf3fe96f6e48ad88c61c3997e899c3)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:41.046138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682a4a4-b159-4362-89c5-b073999117c2 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:41.335539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-7682a4a4-b159-4362-89c5-b073999117c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7bf3fe96f6e48ad88c61c3997e899c3', 'request_id': 'req-7682a4a4-b159-4362-89c5-b073999117c2'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:41.354214 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-7682a4a4-b159-4362-89c5-b073999117c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7bf3fe96f6e48ad88c61c3997e899c3', 'request_id': 'req-7682a4a4-b159-4362-89c5-b073999117c2'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:41.366017 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4a1b721c-7102-4aa5-9d7e-9b601c697f7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8747c8f0aea548168501fa50da3d074b'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:41.395026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4a1b721c-7102-4aa5-9d7e-9b601c697f7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8747c8f0aea548168501fa50da3d074b'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:41.395864 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4a1b721c-7102-4aa5-9d7e-9b601c697f7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8747c8f0aea548168501fa50da3d074b'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:41.622443 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-7682a4a4-b159-4362-89c5-b073999117c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7bf3fe96f6e48ad88c61c3997e899c3', 'request_id': 'req-7682a4a4-b159-4362-89c5-b073999117c2'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:41.642129 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-7682a4a4-b159-4362-89c5-b073999117c2 admin admin] The token cache is being invalidate because project b7bf3fe96f6e48ad88c61c3997e899c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:58:41.642599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-7682a4a4-b159-4362-89c5-b073999117c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:41.649898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-7682a4a4-b159-4362-89c5-b073999117c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:41.652086 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 877/1765] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:58:40 2022] DELETE /identity/v3/projects/b7bf3fe96f6e48ad88c61c3997e899c3 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:41.657520 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570285d-355b-4958-95fa-1eb7004905e1 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:41.663724 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570285d-355b-4958-95fa-1eb7004905e1 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:41.663724 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570285d-355b-4958-95fa-1eb7004905e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:41.685059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-1570285d-355b-4958-95fa-1eb7004905e1 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:41.727092 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-1570285d-355b-4958-95fa-1eb7004905e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:41.770968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 878/1766] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:41.773000 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5741c-26e5-41fb-8f03-3befd6173cdd None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:41.773953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5741c-26e5-41fb-8f03-3befd6173cdd None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:41.774326 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5741c-26e5-41fb-8f03-3befd6173cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:41.809196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-b9e5741c-26e5-41fb-8f03-3befd6173cdd None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:41.812748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b9e5741c-26e5-41fb-8f03-3befd6173cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:41.821039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 879/1767] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:41.825494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5741c-26e5-41fb-8f03-3befd6173cdd None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:41.833160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4a1b721c-7102-4aa5-9d7e-9b601c697f7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8747c8f0aea548168501fa50da3d074b'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:41.833794 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4a1b721c-7102-4aa5-9d7e-9b601c697f7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8747c8f0aea548168501fa50da3d074b'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:41.845663 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5741c-26e5-41fb-8f03-3befd6173cdd None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:41.847898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafc051-9a9a-4048-a70f-0561d6fc2ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:41.848668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafc051-9a9a-4048-a70f-0561d6fc2ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:41.849387 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafc051-9a9a-4048-a70f-0561d6fc2ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:41.849746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafc051-9a9a-4048-a70f-0561d6fc2ef9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:41.851164 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafc051-9a9a-4048-a70f-0561d6fc2ef9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:58:41.852097 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafc051-9a9a-4048-a70f-0561d6fc2ef9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:41.855591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafc051-9a9a-4048-a70f-0561d6fc2ef9 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:41.877689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 880/1768] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:58:41.880149 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafc051-9a9a-4048-a70f-0561d6fc2ef9 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:41.893935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafc051-9a9a-4048-a70f-0561d6fc2ef9 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:41.902149 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc4bf4-11bf-437c-a35c-ee6d4c1c5acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:41.903258 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc4bf4-11bf-437c-a35c-ee6d4c1c5acd admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:41.904365 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc4bf4-11bf-437c-a35c-ee6d4c1c5acd admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:41.905010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc4bf4-11bf-437c-a35c-ee6d4c1c5acd admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:41.906245 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc4bf4-11bf-437c-a35c-ee6d4c1c5acd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:41.909042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc4bf4-11bf-437c-a35c-ee6d4c1c5acd admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:41.955262 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 889/1769] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:58:40 2022] DELETE /identity/v3/users/8747c8f0aea548168501fa50da3d074b => generated 0 bytes in 1217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:42.074715 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:42.080925 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 881/1770] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:41 2022] POST /identity/v3/projects => generated 365 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:42.085570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b721c-7102-4aa5-9d7e-9b601c697f7a admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:42.087764 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4a1b721c-7102-4aa5-9d7e-9b601c697f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:42.224383 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b721c-7102-4aa5-9d7e-9b601c697f7a admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:42.397818 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5eb232-6cb8-4e5a-8307-381bfeb38761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:42.397818 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5eb232-6cb8-4e5a-8307-381bfeb38761 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:42.397818 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5eb232-6cb8-4e5a-8307-381bfeb38761 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:42.397818 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5eb232-6cb8-4e5a-8307-381bfeb38761 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:42.399391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5eb232-6cb8-4e5a-8307-381bfeb38761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:42.399391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5eb232-6cb8-4e5a-8307-381bfeb38761 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:42.608891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 890/1771] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:42 2022] POST /identity/v3/users => generated 283 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:42.609144 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc4bf4-11bf-437c-a35c-ee6d4c1c5acd admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:42.637946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc4bf4-11bf-437c-a35c-ee6d4c1c5acd admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:42.645108 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778203a-ccbe-42a3-931e-e08a245b2bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:42.646160 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778203a-ccbe-42a3-931e-e08a245b2bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:42.646450 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778203a-ccbe-42a3-931e-e08a245b2bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:42.646732 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778203a-ccbe-42a3-931e-e08a245b2bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:42.647533 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778203a-ccbe-42a3-931e-e08a245b2bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:42.650104 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778203a-ccbe-42a3-931e-e08a245b2bd9 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:42.666520 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 882/1772] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:42.667722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5eb232-6cb8-4e5a-8307-381bfeb38761 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:42.682263 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5eb232-6cb8-4e5a-8307-381bfeb38761 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:42.690760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379414e-b82e-4a3e-bdf5-0b97adac8589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:42.691527 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379414e-b82e-4a3e-bdf5-0b97adac8589 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:42.691823 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379414e-b82e-4a3e-bdf5-0b97adac8589 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:42.692102 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379414e-b82e-4a3e-bdf5-0b97adac8589 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:42.695284 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379414e-b82e-4a3e-bdf5-0b97adac8589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:42.695284 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379414e-b82e-4a3e-bdf5-0b97adac8589 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:42.717659 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 891/1773] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:42.719115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778203a-ccbe-42a3-931e-e08a245b2bd9 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:42.744237 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379414e-b82e-4a3e-bdf5-0b97adac8589 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:42.744884 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778203a-ccbe-42a3-931e-e08a245b2bd9 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:42.748362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-5379414e-b82e-4a3e-bdf5-0b97adac8589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:42.761285 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96193f9b-ee64-4256-8d4a-c0885a44b761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:42.773859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96193f9b-ee64-4256-8d4a-c0885a44b761 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:42.773859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96193f9b-ee64-4256-8d4a-c0885a44b761 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:42.773859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96193f9b-ee64-4256-8d4a-c0885a44b761 admin admin] PATH_INFO: `/v3/projects/3e93c790724d44d792411394543d8f6b/users/b98cfacbdff54478baec704db00a6606/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:42.790904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379414e-b82e-4a3e-bdf5-0b97adac8589 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:42.822641 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c9e76-2dd1-4456-a89f-40c807d3d309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:42.825488 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96193f9b-ee64-4256-8d4a-c0885a44b761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e93c790724d44d792411394543d8f6b, user_id=b98cfacbdff54478baec704db00a6606, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:42.828249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96193f9b-ee64-4256-8d4a-c0885a44b761 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:42.830567 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c9e76-2dd1-4456-a89f-40c807d3d309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:42.836907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c9e76-2dd1-4456-a89f-40c807d3d309 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:42.836907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c9e76-2dd1-4456-a89f-40c807d3d309 admin admin] PATH_INFO: `/v3/projects/f2edd634d6fe47278894d539b0269f15` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:42.836907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c9e76-2dd1-4456-a89f-40c807d3d309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2edd634d6fe47278894d539b0269f15)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:42.846669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c9e76-2dd1-4456-a89f-40c807d3d309 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:42.926696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 883/1774] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:42 2022] PUT /identity/v3/projects/3e93c790724d44d792411394543d8f6b/users/b98cfacbdff54478baec704db00a6606/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:58:42.939317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688354d-3a57-42d0-a44a-a71d99ec22ec None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:42.939621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688354d-3a57-42d0-a44a-a71d99ec22ec None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:42.940120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688354d-3a57-42d0-a44a-a71d99ec22ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:42.999325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-8688354d-3a57-42d0-a44a-a71d99ec22ec None None] MFA Rules not processed for user `b98cfacbdff54478baec704db00a6606`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:43.002296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-8688354d-3a57-42d0-a44a-a71d99ec22ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:43.074928 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-516c9e76-2dd1-4456-a89f-40c807d3d309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2edd634d6fe47278894d539b0269f15', 'request_id': 'req-516c9e76-2dd1-4456-a89f-40c807d3d309'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:43.184069 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 884/1775] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:43.186241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a7078-bc64-44c6-815b-fbb65e641a4b None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:43.186742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a7078-bc64-44c6-815b-fbb65e641a4b None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:43.187179 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a7078-bc64-44c6-815b-fbb65e641a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:43.197839 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-516c9e76-2dd1-4456-a89f-40c807d3d309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2edd634d6fe47278894d539b0269f15', 'request_id': 'req-516c9e76-2dd1-4456-a89f-40c807d3d309'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:43.216105 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-516c9e76-2dd1-4456-a89f-40c807d3d309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2edd634d6fe47278894d539b0269f15', 'request_id': 'req-516c9e76-2dd1-4456-a89f-40c807d3d309'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:43.252878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-759a7078-bc64-44c6-815b-fbb65e641a4b None None] MFA Rules not processed for user `54e89bce266d48ffb29a21960f0241d1`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:43.254266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-759a7078-bc64-44c6-815b-fbb65e641a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:43.284730 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-516c9e76-2dd1-4456-a89f-40c807d3d309 admin admin] The token cache is being invalidate because project f2edd634d6fe47278894d539b0269f15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:58:43.285106 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-516c9e76-2dd1-4456-a89f-40c807d3d309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:43.290522 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-516c9e76-2dd1-4456-a89f-40c807d3d309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:43.297665 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 892/1776] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:58:42 2022] DELETE /identity/v3/projects/f2edd634d6fe47278894d539b0269f15 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:43.298525 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c9e76-2dd1-4456-a89f-40c807d3d309 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:43.302550 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-516c9e76-2dd1-4456-a89f-40c807d3d309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:43.399295 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 885/1777] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:43.400598 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace5b77-26bd-4d1e-9055-e08ec1e28db3 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:43.400954 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace5b77-26bd-4d1e-9055-e08ec1e28db3 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:43.401258 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace5b77-26bd-4d1e-9055-e08ec1e28db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:43.490298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-5ace5b77-26bd-4d1e-9055-e08ec1e28db3 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:43.497668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-5ace5b77-26bd-4d1e-9055-e08ec1e28db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:43.505115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c9e76-2dd1-4456-a89f-40c807d3d309 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:43.517098 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5b7c5-0123-481f-adb3-e08ad81cfcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:43.518172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5b7c5-0123-481f-adb3-e08ad81cfcaf admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:43.520537 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5b7c5-0123-481f-adb3-e08ad81cfcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:43.521269 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5b7c5-0123-481f-adb3-e08ad81cfcaf admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:43.522160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5b7c5-0123-481f-adb3-e08ad81cfcaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:43.526357 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5b7c5-0123-481f-adb3-e08ad81cfcaf admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:43.564659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 886/1778] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:43.570938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace5b77-26bd-4d1e-9055-e08ec1e28db3 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:43.575737 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-5ace5b77-26bd-4d1e-9055-e08ec1e28db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:43.600459 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace5b77-26bd-4d1e-9055-e08ec1e28db3 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:43.634266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415776d-b9aa-420a-9f3b-d154961a897f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:43.635271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415776d-b9aa-420a-9f3b-d154961a897f admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:43.636480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415776d-b9aa-420a-9f3b-d154961a897f admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:43.636879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415776d-b9aa-420a-9f3b-d154961a897f admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:43.637698 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415776d-b9aa-420a-9f3b-d154961a897f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:43.640362 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415776d-b9aa-420a-9f3b-d154961a897f admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:43.677214 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 893/1779] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:43 2022] POST /identity/v3/projects => generated 365 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:43.681456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c90aa-844f-454f-8f5e-45a83902fd60 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:43.681456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c90aa-844f-454f-8f5e-45a83902fd60 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:43.681456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c90aa-844f-454f-8f5e-45a83902fd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:43.736941 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-ed9c90aa-844f-454f-8f5e-45a83902fd60 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:43.744067 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ed9c90aa-844f-454f-8f5e-45a83902fd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:43.753081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 887/1780] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:43 2022] POST /identity/v3/projects => generated 403 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:43.754280 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415776d-b9aa-420a-9f3b-d154961a897f admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:43.893070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415776d-b9aa-420a-9f3b-d154961a897f admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:43.899581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5208c6-c8d0-4758-837a-69b7b0659934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:43.900358 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5208c6-c8d0-4758-837a-69b7b0659934 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:43.900806 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5208c6-c8d0-4758-837a-69b7b0659934 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:43.901263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5208c6-c8d0-4758-837a-69b7b0659934 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:43.901922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5208c6-c8d0-4758-837a-69b7b0659934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:43.903939 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5208c6-c8d0-4758-837a-69b7b0659934 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:43.922565 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 894/1781] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:43.922565 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c90aa-844f-454f-8f5e-45a83902fd60 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:43.926017 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ed9c90aa-844f-454f-8f5e-45a83902fd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:43.957690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c90aa-844f-454f-8f5e-45a83902fd60 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:43.984960 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa846bc4-deea-4438-b292-9bf165c52d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:43.985704 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa846bc4-deea-4438-b292-9bf165c52d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:43.985993 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa846bc4-deea-4438-b292-9bf165c52d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:43.986562 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa846bc4-deea-4438-b292-9bf165c52d58 admin admin] PATH_INFO: `/v3/projects/7c3878b844d14ec59073b471eb767506` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:44.000681 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa846bc4-deea-4438-b292-9bf165c52d58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c3878b844d14ec59073b471eb767506)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:44.004173 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa846bc4-deea-4438-b292-9bf165c52d58 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:44.011525 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 888/1782] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:43 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:44.012514 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5208c6-c8d0-4758-837a-69b7b0659934 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:44.043486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5208c6-c8d0-4758-837a-69b7b0659934 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:44.066510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73409b-0fb9-4ce0-98e5-ea513332f32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:44.067322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73409b-0fb9-4ce0-98e5-ea513332f32c admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:44.067610 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73409b-0fb9-4ce0-98e5-ea513332f32c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:44.067890 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73409b-0fb9-4ce0-98e5-ea513332f32c admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:44.068598 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73409b-0fb9-4ce0-98e5-ea513332f32c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:44.073959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73409b-0fb9-4ce0-98e5-ea513332f32c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:44.336370 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-aa846bc4-deea-4438-b292-9bf165c52d58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c3878b844d14ec59073b471eb767506', 'request_id': 'req-aa846bc4-deea-4438-b292-9bf165c52d58'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:44.453058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 889/1783] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:44 2022] POST /identity/v3/users => generated 308 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:44.454541 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73409b-0fb9-4ce0-98e5-ea513332f32c admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:44.485738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73409b-0fb9-4ce0-98e5-ea513332f32c admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:44.522067 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-aa846bc4-deea-4438-b292-9bf165c52d58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c3878b844d14ec59073b471eb767506', 'request_id': 'req-aa846bc4-deea-4438-b292-9bf165c52d58'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:44.530092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-aa846bc4-deea-4438-b292-9bf165c52d58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c3878b844d14ec59073b471eb767506', 'request_id': 'req-aa846bc4-deea-4438-b292-9bf165c52d58'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:44.558402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:44.560668 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-aa846bc4-deea-4438-b292-9bf165c52d58 admin admin] The token cache is being invalidate because project 7c3878b844d14ec59073b471eb767506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:58:44.560668 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-aa846bc4-deea-4438-b292-9bf165c52d58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:44.560668 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-aa846bc4-deea-4438-b292-9bf165c52d58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:44.572060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 895/1784] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:58:43 2022] DELETE /identity/v3/projects/7c3878b844d14ec59073b471eb767506 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:44.572060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa846bc4-deea-4438-b292-9bf165c52d58 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:44.574119 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-aa846bc4-deea-4438-b292-9bf165c52d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:44.631941 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0adf4-0057-4242-bab5-844e490c093c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:44.635095 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0adf4-0057-4242-bab5-844e490c093c admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:44.636407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0adf4-0057-4242-bab5-844e490c093c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:44.637188 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0adf4-0057-4242-bab5-844e490c093c admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:44.643089 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0adf4-0057-4242-bab5-844e490c093c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:58:44.643089 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0adf4-0057-4242-bab5-844e490c093c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:44.643899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:44.645216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0adf4-0057-4242-bab5-844e490c093c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:44.663084 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 890/1785] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:58:44.665445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0adf4-0057-4242-bab5-844e490c093c admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:44.667972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-62e0adf4-0057-4242-bab5-844e490c093c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:44.683944 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0adf4-0057-4242-bab5-844e490c093c admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:44.703589 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89ef78-2637-4544-a34f-fdf7e1c35c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:44.704370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89ef78-2637-4544-a34f-fdf7e1c35c4e admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:44.704762 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89ef78-2637-4544-a34f-fdf7e1c35c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:44.705233 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89ef78-2637-4544-a34f-fdf7e1c35c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:44.718248 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89ef78-2637-4544-a34f-fdf7e1c35c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:44.729573 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89ef78-2637-4544-a34f-fdf7e1c35c4e admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:44.784425 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 891/1786] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:44.785920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638015f-ba5e-44cc-91a4-2938b5cd0f43 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:44.786377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638015f-ba5e-44cc-91a4-2938b5cd0f43 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:44.786680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638015f-ba5e-44cc-91a4-2938b5cd0f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:44.807399 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa846bc4-deea-4438-b292-9bf165c52d58 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:44.817844 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e58a42-ac42-4481-92ae-1c0a648513a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:44.819087 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e58a42-ac42-4481-92ae-1c0a648513a0 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:44.819749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e58a42-ac42-4481-92ae-1c0a648513a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:44.820397 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e58a42-ac42-4481-92ae-1c0a648513a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:44.822986 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e58a42-ac42-4481-92ae-1c0a648513a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:44.824914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e58a42-ac42-4481-92ae-1c0a648513a0 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:44.840669 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-5638015f-ba5e-44cc-91a4-2938b5cd0f43 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:44.843240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 896/1787] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:44.844376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e58a42-ac42-4481-92ae-1c0a648513a0 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:44.847458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-57e58a42-ac42-4481-92ae-1c0a648513a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:44.847601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-5638015f-ba5e-44cc-91a4-2938b5cd0f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:44.877167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e58a42-ac42-4481-92ae-1c0a648513a0 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:44.886578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfaf69-6ec0-4b8a-9339-dd6565ae7df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:44.887667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfaf69-6ec0-4b8a-9339-dd6565ae7df3 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:44.888189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfaf69-6ec0-4b8a-9339-dd6565ae7df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:44.888732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfaf69-6ec0-4b8a-9339-dd6565ae7df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:44.889080 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 892/1788] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:44.890331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638015f-ba5e-44cc-91a4-2938b5cd0f43 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:44.891765 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfaf69-6ec0-4b8a-9339-dd6565ae7df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:44.895761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfaf69-6ec0-4b8a-9339-dd6565ae7df3 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:44.923296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638015f-ba5e-44cc-91a4-2938b5cd0f43 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:44.928513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2db57-c453-4e1b-983a-4103e5dd5c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:44.930494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2db57-c453-4e1b-983a-4103e5dd5c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:44.930832 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2db57-c453-4e1b-983a-4103e5dd5c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:44.931287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2db57-c453-4e1b-983a-4103e5dd5c55 admin admin] PATH_INFO: `/v3/projects/fcd72fb819f244c4a363e30d8e433071/users/cb7faec011944df6b2ce1f38bfc37ab1/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:44.954796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2db57-c453-4e1b-983a-4103e5dd5c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd72fb819f244c4a363e30d8e433071, user_id=cb7faec011944df6b2ce1f38bfc37ab1, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:44.964400 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2db57-c453-4e1b-983a-4103e5dd5c55 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:45.114163 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 897/1789] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:44 2022] POST /identity/v3/projects => generated 367 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:45.115776 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfaf69-6ec0-4b8a-9339-dd6565ae7df3 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:45.142513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 893/1790] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:44 2022] PUT /identity/v3/projects/fcd72fb819f244c4a363e30d8e433071/users/cb7faec011944df6b2ce1f38bfc37ab1/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:45.147455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088c69d-22bd-49a8-a61a-093a0c04e279 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:45.147455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088c69d-22bd-49a8-a61a-093a0c04e279 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:45.147455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088c69d-22bd-49a8-a61a-093a0c04e279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:45.180515 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-f088c69d-22bd-49a8-a61a-093a0c04e279 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:45.182038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-f088c69d-22bd-49a8-a61a-093a0c04e279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:45.227180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfaf69-6ec0-4b8a-9339-dd6565ae7df3 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:45.306070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac03258-9339-43be-b1be-e4fbda5e53cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:45.306070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac03258-9339-43be-b1be-e4fbda5e53cf admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:45.306070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac03258-9339-43be-b1be-e4fbda5e53cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:45.306070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac03258-9339-43be-b1be-e4fbda5e53cf admin admin] PATH_INFO: `/v3/projects/9425008c65414246813044b8989e283b/users/30f5342a454346f281211fca9c835dbd/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:45.315500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 894/1791] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:45.316716 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088c69d-22bd-49a8-a61a-093a0c04e279 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:45.324061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac03258-9339-43be-b1be-e4fbda5e53cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9425008c65414246813044b8989e283b, user_id=30f5342a454346f281211fca9c835dbd, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:45.327112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac03258-9339-43be-b1be-e4fbda5e53cf admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:45.329737 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088c69d-22bd-49a8-a61a-093a0c04e279 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:45.335535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6588256-4a13-4977-8ab1-f09e4c440d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:45.336614 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6588256-4a13-4977-8ab1-f09e4c440d59 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:45.337019 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6588256-4a13-4977-8ab1-f09e4c440d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:45.337478 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6588256-4a13-4977-8ab1-f09e4c440d59 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:45.338217 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6588256-4a13-4977-8ab1-f09e4c440d59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:45.340243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6588256-4a13-4977-8ab1-f09e4c440d59 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:45.427801 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 898/1792] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:45 2022] PUT /identity/v3/projects/9425008c65414246813044b8989e283b/users/30f5342a454346f281211fca9c835dbd/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:45.428765 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac03258-9339-43be-b1be-e4fbda5e53cf admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:45.457631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 895/1793] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:45 2022] POST /identity/v3/users => generated 284 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:45.466485 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6588256-4a13-4977-8ab1-f09e4c440d59 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:45.478808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6588256-4a13-4977-8ab1-f09e4c440d59 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:45.530138 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac03258-9339-43be-b1be-e4fbda5e53cf admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:45.535790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30b652-c293-4e3f-ad90-5f4a4c3f1bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:45.536580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30b652-c293-4e3f-ad90-5f4a4c3f1bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:45.536978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30b652-c293-4e3f-ad90-5f4a4c3f1bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:45.537323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30b652-c293-4e3f-ad90-5f4a4c3f1bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:45.538135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30b652-c293-4e3f-ad90-5f4a4c3f1bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:45.540468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30b652-c293-4e3f-ad90-5f4a4c3f1bb6 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:45.553778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 899/1794] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:45.556195 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30b652-c293-4e3f-ad90-5f4a4c3f1bb6 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:45.567819 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30b652-c293-4e3f-ad90-5f4a4c3f1bb6 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:45.574104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d181bd6-4ae9-42d0-8af5-5c898444d3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:45.574795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d181bd6-4ae9-42d0-8af5-5c898444d3dc admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:45.575089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d181bd6-4ae9-42d0-8af5-5c898444d3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:45.575408 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d181bd6-4ae9-42d0-8af5-5c898444d3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:45.576318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d181bd6-4ae9-42d0-8af5-5c898444d3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:45.578182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d181bd6-4ae9-42d0-8af5-5c898444d3dc admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:45.592084 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63836a3-5da5-463d-a187-9646f40070d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:45.598227 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63836a3-5da5-463d-a187-9646f40070d7 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:45.598227 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63836a3-5da5-463d-a187-9646f40070d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:45.598227 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63836a3-5da5-463d-a187-9646f40070d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:45.598227 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63836a3-5da5-463d-a187-9646f40070d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:58:45.598227 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63836a3-5da5-463d-a187-9646f40070d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:45.598227 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63836a3-5da5-463d-a187-9646f40070d7 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:45.601076 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 900/1795] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:45.602862 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d181bd6-4ae9-42d0-8af5-5c898444d3dc admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:45.615071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d181bd6-4ae9-42d0-8af5-5c898444d3dc admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:45.621242 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1072631-44f1-4991-a60c-9684ab7587a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:45.622202 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072631-44f1-4991-a60c-9684ab7587a3 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:45.622648 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072631-44f1-4991-a60c-9684ab7587a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:45.623218 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072631-44f1-4991-a60c-9684ab7587a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:45.627083 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1072631-44f1-4991-a60c-9684ab7587a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:45.628179 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1072631-44f1-4991-a60c-9684ab7587a3 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:45.629817 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 896/1796] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:58:45.631064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63836a3-5da5-463d-a187-9646f40070d7 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:45.644039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63836a3-5da5-463d-a187-9646f40070d7 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:45.645524 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 901/1797] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:45.646834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1072631-44f1-4991-a60c-9684ab7587a3 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:45.661728 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1072631-44f1-4991-a60c-9684ab7587a3 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:45.662246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a44bf5-3821-4749-a8ad-9f90279643a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:45.663590 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a44bf5-3821-4749-a8ad-9f90279643a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:45.664725 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a44bf5-3821-4749-a8ad-9f90279643a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:45.665243 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a44bf5-3821-4749-a8ad-9f90279643a3 admin admin] PATH_INFO: `/v3/projects/fcd72fb819f244c4a363e30d8e433071/users/cb7faec011944df6b2ce1f38bfc37ab1/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:45.667409 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308611c1-a053-4f5c-bef8-255c6331e984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:45.668396 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308611c1-a053-4f5c-bef8-255c6331e984 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:45.668709 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308611c1-a053-4f5c-bef8-255c6331e984 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:45.668956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a44bf5-3821-4749-a8ad-9f90279643a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd72fb819f244c4a363e30d8e433071, user_id=cb7faec011944df6b2ce1f38bfc37ab1, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:45.669082 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308611c1-a053-4f5c-bef8-255c6331e984 admin admin] PATH_INFO: `/v3/projects/9425008c65414246813044b8989e283b/users/30f5342a454346f281211fca9c835dbd/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:45.671291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308611c1-a053-4f5c-bef8-255c6331e984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9425008c65414246813044b8989e283b, user_id=30f5342a454346f281211fca9c835dbd, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:45.672948 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a44bf5-3821-4749-a8ad-9f90279643a3 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:45.674104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308611c1-a053-4f5c-bef8-255c6331e984 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:45.688452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 902/1798] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:45 2022] PUT /identity/v3/projects/9425008c65414246813044b8989e283b/users/30f5342a454346f281211fca9c835dbd/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:45.689553 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308611c1-a053-4f5c-bef8-255c6331e984 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:45.692776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 897/1799] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:45 2022] PUT /identity/v3/projects/fcd72fb819f244c4a363e30d8e433071/users/cb7faec011944df6b2ce1f38bfc37ab1/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:45.693595 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a44bf5-3821-4749-a8ad-9f90279643a3 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:45.783516 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308611c1-a053-4f5c-bef8-255c6331e984 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:45.789999 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd20883-2e6f-4cf2-b69b-5cd2c5a5f5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:45.791709 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd20883-2e6f-4cf2-b69b-5cd2c5a5f5a6 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:45.792291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd20883-2e6f-4cf2-b69b-5cd2c5a5f5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:45.792619 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd20883-2e6f-4cf2-b69b-5cd2c5a5f5a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:45.793506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd20883-2e6f-4cf2-b69b-5cd2c5a5f5a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:45.795758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd20883-2e6f-4cf2-b69b-5cd2c5a5f5a6 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:45.796541 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a44bf5-3821-4749-a8ad-9f90279643a3 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:45.821445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde368c0-fb8e-485d-8158-5a7fe21db387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:45.822523 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde368c0-fb8e-485d-8158-5a7fe21db387 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:45.822662 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde368c0-fb8e-485d-8158-5a7fe21db387 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:45.823376 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde368c0-fb8e-485d-8158-5a7fe21db387 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:45.823860 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde368c0-fb8e-485d-8158-5a7fe21db387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:45.826394 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde368c0-fb8e-485d-8158-5a7fe21db387 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:45.846160 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 898/1800] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:45.854098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5c950-a65e-4690-99d6-a413e872da69 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:45.859379 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5c950-a65e-4690-99d6-a413e872da69 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:45.859379 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5c950-a65e-4690-99d6-a413e872da69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:45.891706 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 903/1801] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:45 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:45.891706 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd20883-2e6f-4cf2-b69b-5cd2c5a5f5a6 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:45.907827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-d1c5c950-a65e-4690-99d6-a413e872da69 None None] MFA Rules not processed for user `30f5342a454346f281211fca9c835dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:45.909389 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d1c5c950-a65e-4690-99d6-a413e872da69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:45.998480 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd20883-2e6f-4cf2-b69b-5cd2c5a5f5a6 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:46.006528 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5f0cb-65ec-4530-a1b1-cb561c0c4e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:46.007783 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5f0cb-65ec-4530-a1b1-cb561c0c4e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:46.008169 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5f0cb-65ec-4530-a1b1-cb561c0c4e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:46.009113 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5f0cb-65ec-4530-a1b1-cb561c0c4e4d admin admin] PATH_INFO: `/v3/projects/ea1ca779a9c44252a3ea906e41315f5f/users/e23be4030a8f4dbdb3190b096566f1df/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:46.023848 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 899/1802] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:46.025163 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5c950-a65e-4690-99d6-a413e872da69 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:46.038871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5c950-a65e-4690-99d6-a413e872da69 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:46.039902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5f0cb-65ec-4530-a1b1-cb561c0c4e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea1ca779a9c44252a3ea906e41315f5f, user_id=e23be4030a8f4dbdb3190b096566f1df, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:46.043518 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5f0cb-65ec-4530-a1b1-cb561c0c4e4d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:46.046207 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6157567-6e48-4c8f-93c2-b143d4a6a8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:46.046900 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6157567-6e48-4c8f-93c2-b143d4a6a8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:46.047192 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6157567-6e48-4c8f-93c2-b143d4a6a8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:46.047473 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6157567-6e48-4c8f-93c2-b143d4a6a8b0 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:46.048187 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6157567-6e48-4c8f-93c2-b143d4a6a8b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:46.050886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6157567-6e48-4c8f-93c2-b143d4a6a8b0 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:46.124901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 904/1803] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:45 2022] PUT /identity/v3/projects/ea1ca779a9c44252a3ea906e41315f5f/users/e23be4030a8f4dbdb3190b096566f1df/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:46.127038 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5f0cb-65ec-4530-a1b1-cb561c0c4e4d admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:46.130380 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-bee5f0cb-65ec-4530-a1b1-cb561c0c4e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:46.145112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:46.153462 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 900/1804] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:46 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:46.156257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5a6f-d067-4254-8154-e6ea941429d4 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:46.156968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5a6f-d067-4254-8154-e6ea941429d4 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:46.157427 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5a6f-d067-4254-8154-e6ea941429d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:46.197790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-214d5a6f-d067-4254-8154-e6ea941429d4 None None] MFA Rules not processed for user `e23be4030a8f4dbdb3190b096566f1df`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:46.199360 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-214d5a6f-d067-4254-8154-e6ea941429d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:46.230174 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5f0cb-65ec-4530-a1b1-cb561c0c4e4d admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:46.234684 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:46.237269 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b297dd8-e1b6-4aac-95b9-254fd1809d8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:46.238575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b297dd8-e1b6-4aac-95b9-254fd1809d8e service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:46.239144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b297dd8-e1b6-4aac-95b9-254fd1809d8e service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:46.239488 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b297dd8-e1b6-4aac-95b9-254fd1809d8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:46.308549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 901/1805] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:46.309903 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d5a6f-d067-4254-8154-e6ea941429d4 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:46.329819 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b297dd8-e1b6-4aac-95b9-254fd1809d8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:46.331745 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b297dd8-e1b6-4aac-95b9-254fd1809d8e service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:46.344224 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 905/1806] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:46.349680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b297dd8-e1b6-4aac-95b9-254fd1809d8e service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:46.410823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d5a6f-d067-4254-8154-e6ea941429d4 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:46.415763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c317f9-feb8-4275-901d-021b4b242174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:46.416441 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c317f9-feb8-4275-901d-021b4b242174 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:46.416594 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b297dd8-e1b6-4aac-95b9-254fd1809d8e service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:46.416890 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c317f9-feb8-4275-901d-021b4b242174 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:46.417171 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c317f9-feb8-4275-901d-021b4b242174 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:46.417966 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c317f9-feb8-4275-901d-021b4b242174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:46.419581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c317f9-feb8-4275-901d-021b4b242174 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:46.421824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b906d-bb6a-42b6-94df-4becc518fb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:46.422501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b906d-bb6a-42b6-94df-4becc518fb8f admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:46.422788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b906d-bb6a-42b6-94df-4becc518fb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:46.423068 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b906d-bb6a-42b6-94df-4becc518fb8f admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:46.423902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b906d-bb6a-42b6-94df-4becc518fb8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:46.425999 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b906d-bb6a-42b6-94df-4becc518fb8f admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:46.430037 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 902/1807] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:46.434411 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c317f9-feb8-4275-901d-021b4b242174 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:46.444487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c317f9-feb8-4275-901d-021b4b242174 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:46.457446 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45969a97-3336-4286-b0fc-b34804d7a719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:46.458153 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45969a97-3336-4286-b0fc-b34804d7a719 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:46.458725 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45969a97-3336-4286-b0fc-b34804d7a719 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:46.458725 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45969a97-3336-4286-b0fc-b34804d7a719 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:46.459464 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45969a97-3336-4286-b0fc-b34804d7a719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:46.461742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45969a97-3336-4286-b0fc-b34804d7a719 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:46.472059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 903/1808] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:58:46.476466 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45969a97-3336-4286-b0fc-b34804d7a719 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:46.486427 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45969a97-3336-4286-b0fc-b34804d7a719 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:46.491267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f914b7-75c1-4865-ae76-6f15272253d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:46.492700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f914b7-75c1-4865-ae76-6f15272253d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:46.493076 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f914b7-75c1-4865-ae76-6f15272253d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:46.493364 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f914b7-75c1-4865-ae76-6f15272253d4 admin admin] PATH_INFO: `/v3/projects/49efe0ce9cb34ea5bd679b66c7ad7f8d/users/777799faa4254c9d97f0cbeaac029896/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:46.509714 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f914b7-75c1-4865-ae76-6f15272253d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49efe0ce9cb34ea5bd679b66c7ad7f8d, user_id=777799faa4254c9d97f0cbeaac029896, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:46.512666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f914b7-75c1-4865-ae76-6f15272253d4 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:46.585359 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 906/1809] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:46 2022] POST /identity/v3/projects => generated 367 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:46.586407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b906d-bb6a-42b6-94df-4becc518fb8f admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:46.609795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 904/1810] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:46 2022] PUT /identity/v3/projects/49efe0ce9cb34ea5bd679b66c7ad7f8d/users/777799faa4254c9d97f0cbeaac029896/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:58:46.621278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb2c75-10aa-4948-b4e6-fb606c9912b0 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:46.621927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb2c75-10aa-4948-b4e6-fb606c9912b0 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:46.622315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb2c75-10aa-4948-b4e6-fb606c9912b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:46.706118 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-42fb2c75-10aa-4948-b4e6-fb606c9912b0 None None] MFA Rules not processed for user `777799faa4254c9d97f0cbeaac029896`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:46.714786 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-42fb2c75-10aa-4948-b4e6-fb606c9912b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:46.763932 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b906d-bb6a-42b6-94df-4becc518fb8f admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:46.875835 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 905/1811] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:46.880447 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f56e9d-6d85-499e-8b17-274f895fbec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:46.881269 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f56e9d-6d85-499e-8b17-274f895fbec7 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:46.881628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f56e9d-6d85-499e-8b17-274f895fbec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:46.881977 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f56e9d-6d85-499e-8b17-274f895fbec7 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:46.883554 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f56e9d-6d85-499e-8b17-274f895fbec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:46.886649 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f56e9d-6d85-499e-8b17-274f895fbec7 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:46.888305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb2c75-10aa-4948-b4e6-fb606c9912b0 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:46.905284 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb2c75-10aa-4948-b4e6-fb606c9912b0 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:46.912871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fe274-8d4e-4955-829c-f69ddb720aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:46.912871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fe274-8d4e-4955-829c-f69ddb720aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:46.912871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fe274-8d4e-4955-829c-f69ddb720aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:46.912871 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fe274-8d4e-4955-829c-f69ddb720aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:46.913874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fe274-8d4e-4955-829c-f69ddb720aa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:46.915869 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fe274-8d4e-4955-829c-f69ddb720aa4 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:47.041972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 907/1812] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:46 2022] POST /identity/v3/users => generated 290 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:58:47.045836 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f56e9d-6d85-499e-8b17-274f895fbec7 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:47.058367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 906/1813] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:46 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:47.059723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fe274-8d4e-4955-829c-f69ddb720aa4 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:47.071705 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f56e9d-6d85-499e-8b17-274f895fbec7 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:47.144001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fe274-8d4e-4955-829c-f69ddb720aa4 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:47.150538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce7ce5-b9ac-4b7d-aaf0-f8d9c342d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:47.151313 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce7ce5-b9ac-4b7d-aaf0-f8d9c342d49a admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:47.151665 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce7ce5-b9ac-4b7d-aaf0-f8d9c342d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:47.152010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce7ce5-b9ac-4b7d-aaf0-f8d9c342d49a admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:47.152817 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce7ce5-b9ac-4b7d-aaf0-f8d9c342d49a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:47.154410 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0f212-fcb5-43be-9711-f1a837db6e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:47.154968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce7ce5-b9ac-4b7d-aaf0-f8d9c342d49a admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:47.155308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0f212-fcb5-43be-9711-f1a837db6e94 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:47.155596 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0f212-fcb5-43be-9711-f1a837db6e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:47.155873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0f212-fcb5-43be-9711-f1a837db6e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:47.156659 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0f212-fcb5-43be-9711-f1a837db6e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:47.158264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0f212-fcb5-43be-9711-f1a837db6e94 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:47.173725 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 908/1814] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:47.178257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0f212-fcb5-43be-9711-f1a837db6e94 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:47.190039 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0f212-fcb5-43be-9711-f1a837db6e94 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:47.198012 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0883b06-6c73-4647-9000-47bc9cb89ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:47.199153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0883b06-6c73-4647-9000-47bc9cb89ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:47.199496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0883b06-6c73-4647-9000-47bc9cb89ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:47.200219 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0883b06-6c73-4647-9000-47bc9cb89ec9 admin admin] PATH_INFO: `/v3/projects/6c313605cec149e1ab080116dc1e76ed/users/c721f0c809d647ffb03abc9092d19b53/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:47.220228 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0883b06-6c73-4647-9000-47bc9cb89ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c313605cec149e1ab080116dc1e76ed, user_id=c721f0c809d647ffb03abc9092d19b53, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:47.223525 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0883b06-6c73-4647-9000-47bc9cb89ec9 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:47.291815 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 907/1815] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:47 2022] POST /identity/v3/users => generated 300 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:47.293413 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce7ce5-b9ac-4b7d-aaf0-f8d9c342d49a admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:47.316093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce7ce5-b9ac-4b7d-aaf0-f8d9c342d49a admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:47.322112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d867b-d6ec-4807-a950-5fff9e0e5568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:47.322829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d867b-d6ec-4807-a950-5fff9e0e5568 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:47.327763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d867b-d6ec-4807-a950-5fff9e0e5568 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:47.327763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d867b-d6ec-4807-a950-5fff9e0e5568 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:47.328479 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d867b-d6ec-4807-a950-5fff9e0e5568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:47.330137 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d867b-d6ec-4807-a950-5fff9e0e5568 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:47.338212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 909/1816] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:47 2022] PUT /identity/v3/projects/6c313605cec149e1ab080116dc1e76ed/users/c721f0c809d647ffb03abc9092d19b53/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:47.339682 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0883b06-6c73-4647-9000-47bc9cb89ec9 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:47.344586 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 908/1817] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:58:47.345904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d867b-d6ec-4807-a950-5fff9e0e5568 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:47.358225 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d867b-d6ec-4807-a950-5fff9e0e5568 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:47.422372 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0883b06-6c73-4647-9000-47bc9cb89ec9 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:47.424919 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855ddc4-f664-4e44-ae91-2aafb163b485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:47.425979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855ddc4-f664-4e44-ae91-2aafb163b485 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:47.426092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c63d21-7656-47b4-aba5-b0a041d7300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:47.426292 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855ddc4-f664-4e44-ae91-2aafb163b485 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:47.426540 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855ddc4-f664-4e44-ae91-2aafb163b485 admin admin] PATH_INFO: `/v3/projects/64de0f359c65456bae82f72e5775d0e5/users/043b5090a4b64f4bb446e8309606f576/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:47.427464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c63d21-7656-47b4-aba5-b0a041d7300a admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:47.427969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c63d21-7656-47b4-aba5-b0a041d7300a admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:47.428478 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c63d21-7656-47b4-aba5-b0a041d7300a admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:47.429498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c63d21-7656-47b4-aba5-b0a041d7300a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:47.431500 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c63d21-7656-47b4-aba5-b0a041d7300a admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:47.445391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855ddc4-f664-4e44-ae91-2aafb163b485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64de0f359c65456bae82f72e5775d0e5, user_id=043b5090a4b64f4bb446e8309606f576, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:47.448811 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855ddc4-f664-4e44-ae91-2aafb163b485 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:47.451982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 910/1818] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:47.453770 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c63d21-7656-47b4-aba5-b0a041d7300a admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:47.470722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c63d21-7656-47b4-aba5-b0a041d7300a admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:47.477777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1cb25-82f5-471c-a35b-0d71eddaa9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:47.479875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1cb25-82f5-471c-a35b-0d71eddaa9df admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:47.479875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1cb25-82f5-471c-a35b-0d71eddaa9df admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:47.479875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1cb25-82f5-471c-a35b-0d71eddaa9df admin admin] PATH_INFO: `/v3/projects/6c313605cec149e1ab080116dc1e76ed/users/c721f0c809d647ffb03abc9092d19b53/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:47.481892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1cb25-82f5-471c-a35b-0d71eddaa9df admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c313605cec149e1ab080116dc1e76ed, user_id=c721f0c809d647ffb03abc9092d19b53, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:47.484954 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1cb25-82f5-471c-a35b-0d71eddaa9df admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:47.507665 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 911/1819] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:47 2022] PUT /identity/v3/projects/6c313605cec149e1ab080116dc1e76ed/users/c721f0c809d647ffb03abc9092d19b53/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:47.509842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053b4a7-c702-4767-8192-e07238ea76f1 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:47.510135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053b4a7-c702-4767-8192-e07238ea76f1 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:47.510421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053b4a7-c702-4767-8192-e07238ea76f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:47.542865 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-b053b4a7-c702-4767-8192-e07238ea76f1 None None] MFA Rules not processed for user `c721f0c809d647ffb03abc9092d19b53`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:47.544716 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-b053b4a7-c702-4767-8192-e07238ea76f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:47.596510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 909/1820] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:47 2022] PUT /identity/v3/projects/64de0f359c65456bae82f72e5775d0e5/users/043b5090a4b64f4bb446e8309606f576/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:58:47.599016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855ddc4-f664-4e44-ae91-2aafb163b485 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:47.644196 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 912/1821] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:47.646029 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053b4a7-c702-4767-8192-e07238ea76f1 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:47.691115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855ddc4-f664-4e44-ae91-2aafb163b485 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:47.696716 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fc11a-fe93-4eed-8e3b-5caae00e9db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:47.697601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fc11a-fe93-4eed-8e3b-5caae00e9db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:47.697875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fc11a-fe93-4eed-8e3b-5caae00e9db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:47.698149 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fc11a-fe93-4eed-8e3b-5caae00e9db1 admin admin] PATH_INFO: `/v3/users/b98cfacbdff54478baec704db00a6606` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:47.699381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fc11a-fe93-4eed-8e3b-5caae00e9db1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b98cfacbdff54478baec704db00a6606)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:47.705809 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fc11a-fe93-4eed-8e3b-5caae00e9db1 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:47.716785 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053b4a7-c702-4767-8192-e07238ea76f1 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:47.721723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9833d-72ed-4418-a3bd-76c53c14c68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:47.722704 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9833d-72ed-4418-a3bd-76c53c14c68a admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:47.723121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9833d-72ed-4418-a3bd-76c53c14c68a admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:47.723476 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9833d-72ed-4418-a3bd-76c53c14c68a admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:47.724401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9833d-72ed-4418-a3bd-76c53c14c68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:47.726458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9833d-72ed-4418-a3bd-76c53c14c68a admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:47.734316 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:47.739696 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 913/1822] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:47.740509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9833d-72ed-4418-a3bd-76c53c14c68a admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:47.796981 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9833d-72ed-4418-a3bd-76c53c14c68a admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:47.802595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f026f8-2768-430b-ac1e-8bb9c2b8cb61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:47.805361 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f026f8-2768-430b-ac1e-8bb9c2b8cb61 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:47.805788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f026f8-2768-430b-ac1e-8bb9c2b8cb61 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:47.806167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f026f8-2768-430b-ac1e-8bb9c2b8cb61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:47.965891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-af9fc11a-fe93-4eed-8e3b-5caae00e9db1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b98cfacbdff54478baec704db00a6606'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:47.976546 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-af9fc11a-fe93-4eed-8e3b-5caae00e9db1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b98cfacbdff54478baec704db00a6606'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:48.042232 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f026f8-2768-430b-ac1e-8bb9c2b8cb61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:48.043765 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f026f8-2768-430b-ac1e-8bb9c2b8cb61 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:48.053999 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 914/1823] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:48.055151 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f026f8-2768-430b-ac1e-8bb9c2b8cb61 service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:48.066696 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f026f8-2768-430b-ac1e-8bb9c2b8cb61 service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:48.074197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870bbd9-6a19-4392-b96f-4f5a5342a380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:48.075479 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870bbd9-6a19-4392-b96f-4f5a5342a380 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:48.075926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870bbd9-6a19-4392-b96f-4f5a5342a380 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:48.076516 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870bbd9-6a19-4392-b96f-4f5a5342a380 admin admin] PATH_INFO: `/v3/projects/64de0f359c65456bae82f72e5775d0e5/users/043b5090a4b64f4bb446e8309606f576/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:48.076833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-af9fc11a-fe93-4eed-8e3b-5caae00e9db1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b98cfacbdff54478baec704db00a6606'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:48.086412 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-af9fc11a-fe93-4eed-8e3b-5caae00e9db1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b98cfacbdff54478baec704db00a6606'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:48.086412 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-af9fc11a-fe93-4eed-8e3b-5caae00e9db1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b98cfacbdff54478baec704db00a6606'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:48.086670 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870bbd9-6a19-4392-b96f-4f5a5342a380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64de0f359c65456bae82f72e5775d0e5, user_id=043b5090a4b64f4bb446e8309606f576, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:48.086670 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870bbd9-6a19-4392-b96f-4f5a5342a380 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:48.093015 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 915/1824] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:48 2022] PUT /identity/v3/projects/64de0f359c65456bae82f72e5775d0e5/users/043b5090a4b64f4bb446e8309606f576/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:48.094295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a2bd8-ec99-4e87-9b54-54ccca971b63 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:48.094593 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a2bd8-ec99-4e87-9b54-54ccca971b63 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:48.094875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a2bd8-ec99-4e87-9b54-54ccca971b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:48.098703 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 910/1825] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:58:47 2022] DELETE /identity/v3/users/b98cfacbdff54478baec704db00a6606 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:48.103747 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dd88d-1d89-44ed-8219-65ac6e92f70c None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:48.104006 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dd88d-1d89-44ed-8219-65ac6e92f70c None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:48.104298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dd88d-1d89-44ed-8219-65ac6e92f70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:48.123475 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-fa0dd88d-1d89-44ed-8219-65ac6e92f70c None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:48.124759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-fa0dd88d-1d89-44ed-8219-65ac6e92f70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:48.125537 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-ae9a2bd8-ec99-4e87-9b54-54ccca971b63 None None] MFA Rules not processed for user `cb7faec011944df6b2ce1f38bfc37ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:48.126861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ae9a2bd8-ec99-4e87-9b54-54ccca971b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:48.190865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 911/1826] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:58:48.192190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8439ba-77bb-424a-9a36-59314a333f52 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:48.192477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8439ba-77bb-424a-9a36-59314a333f52 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:48.192842 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8439ba-77bb-424a-9a36-59314a333f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:48.208450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 916/1827] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:48 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:48.209360 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a2bd8-ec99-4e87-9b54-54ccca971b63 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:48.210715 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ae9a2bd8-ec99-4e87-9b54-54ccca971b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:48.232757 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-6c8439ba-77bb-424a-9a36-59314a333f52 None None] MFA Rules not processed for user `043b5090a4b64f4bb446e8309606f576`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:48.234039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6c8439ba-77bb-424a-9a36-59314a333f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:48.276297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a2bd8-ec99-4e87-9b54-54ccca971b63 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:48.281052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a2b39-76e9-436a-b3bc-3da2c87a48d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:48.281760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a2b39-76e9-436a-b3bc-3da2c87a48d8 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:48.282711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a2b39-76e9-436a-b3bc-3da2c87a48d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:48.283011 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a2b39-76e9-436a-b3bc-3da2c87a48d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:48.295794 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a2b39-76e9-436a-b3bc-3da2c87a48d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:48.297391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a2b39-76e9-436a-b3bc-3da2c87a48d8 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:48.308104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 917/1828] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:48.308966 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a2b39-76e9-436a-b3bc-3da2c87a48d8 service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:48.310284 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f32a2b39-76e9-436a-b3bc-3da2c87a48d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:48.324816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 912/1829] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:48.337444 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8439ba-77bb-424a-9a36-59314a333f52 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:48.337444 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6c8439ba-77bb-424a-9a36-59314a333f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:48.386779 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a2b39-76e9-436a-b3bc-3da2c87a48d8 service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:48.391232 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644325b2-ea59-4d22-a5fc-f28ec2837903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:48.391895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644325b2-ea59-4d22-a5fc-f28ec2837903 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:48.392181 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644325b2-ea59-4d22-a5fc-f28ec2837903 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:48.392462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644325b2-ea59-4d22-a5fc-f28ec2837903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:48.394560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-644325b2-ea59-4d22-a5fc-f28ec2837903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:48.400037 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8439ba-77bb-424a-9a36-59314a333f52 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:48.404282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3325d-4a66-4c75-8aab-da79ec3588af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:48.405426 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3325d-4a66-4c75-8aab-da79ec3588af service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:48.406192 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3325d-4a66-4c75-8aab-da79ec3588af service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:48.406727 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3325d-4a66-4c75-8aab-da79ec3588af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:48.409262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:48.420323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3325d-4a66-4c75-8aab-da79ec3588af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:48.421889 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3325d-4a66-4c75-8aab-da79ec3588af service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:48.438823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 913/1830] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:48.467216 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644325b2-ea59-4d22-a5fc-f28ec2837903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:48.468966 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644325b2-ea59-4d22-a5fc-f28ec2837903 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:48.484841 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 918/1831] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:48.517929 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3325d-4a66-4c75-8aab-da79ec3588af service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:48.519681 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-38a3325d-4a66-4c75-8aab-da79ec3588af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:48.552166 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3325d-4a66-4c75-8aab-da79ec3588af service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:48.559541 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0dd1f-64a4-4881-8a19-b67898491488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:48.562622 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0dd1f-64a4-4881-8a19-b67898491488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:48.562622 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0dd1f-64a4-4881-8a19-b67898491488 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:48.562622 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0dd1f-64a4-4881-8a19-b67898491488 admin admin] PATH_INFO: `/v3/users/777799faa4254c9d97f0cbeaac029896` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:48.562622 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0dd1f-64a4-4881-8a19-b67898491488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=777799faa4254c9d97f0cbeaac029896)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:48.564712 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0dd1f-64a4-4881-8a19-b67898491488 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:48.865895 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c5e0dd1f-64a4-4881-8a19-b67898491488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777799faa4254c9d97f0cbeaac029896'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:48.876276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c5e0dd1f-64a4-4881-8a19-b67898491488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777799faa4254c9d97f0cbeaac029896'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:49.043396 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c5e0dd1f-64a4-4881-8a19-b67898491488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777799faa4254c9d97f0cbeaac029896'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:49.044003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c5e0dd1f-64a4-4881-8a19-b67898491488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777799faa4254c9d97f0cbeaac029896'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:49.044743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c5e0dd1f-64a4-4881-8a19-b67898491488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777799faa4254c9d97f0cbeaac029896'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:49.054040 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644325b2-ea59-4d22-a5fc-f28ec2837903 service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:49.054932 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-644325b2-ea59-4d22-a5fc-f28ec2837903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:49.071062 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644325b2-ea59-4d22-a5fc-f28ec2837903 service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:49.076793 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336ef2b-ca5f-4a6d-99d8-9dbc3e294d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:49.077986 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336ef2b-ca5f-4a6d-99d8-9dbc3e294d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:49.078383 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336ef2b-ca5f-4a6d-99d8-9dbc3e294d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:49.078832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336ef2b-ca5f-4a6d-99d8-9dbc3e294d00 admin admin] PATH_INFO: `/v3/projects/3e93c790724d44d792411394543d8f6b` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:49.080306 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336ef2b-ca5f-4a6d-99d8-9dbc3e294d00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e93c790724d44d792411394543d8f6b)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:49.082647 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336ef2b-ca5f-4a6d-99d8-9dbc3e294d00 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:49.087210 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 914/1832] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:58:48 2022] DELETE /identity/v3/users/777799faa4254c9d97f0cbeaac029896 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:49.093912 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852da8c7-4f05-4ab0-ad02-11ec7c8ba9db None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:49.094203 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852da8c7-4f05-4ab0-ad02-11ec7c8ba9db None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:49.094511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852da8c7-4f05-4ab0-ad02-11ec7c8ba9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:49.123174 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-852da8c7-4f05-4ab0-ad02-11ec7c8ba9db None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:49.124455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-852da8c7-4f05-4ab0-ad02-11ec7c8ba9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:49.189779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 915/1833] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:49.209183 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852da8c7-4f05-4ab0-ad02-11ec7c8ba9db None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:49.209183 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-852da8c7-4f05-4ab0-ad02-11ec7c8ba9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:49.250732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7336ef2b-ca5f-4a6d-99d8-9dbc3e294d00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e93c790724d44d792411394543d8f6b', 'request_id': 'req-7336ef2b-ca5f-4a6d-99d8-9dbc3e294d00'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:49.298349 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852da8c7-4f05-4ab0-ad02-11ec7c8ba9db None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:49.352860 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbf452-d90c-4c39-b835-f531c600d1c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:49.353591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbf452-d90c-4c39-b835-f531c600d1c1 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:49.353875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbf452-d90c-4c39-b835-f531c600d1c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:49.354150 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbf452-d90c-4c39-b835-f531c600d1c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:49.390487 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7336ef2b-ca5f-4a6d-99d8-9dbc3e294d00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e93c790724d44d792411394543d8f6b', 'request_id': 'req-7336ef2b-ca5f-4a6d-99d8-9dbc3e294d00'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:49.399016 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7336ef2b-ca5f-4a6d-99d8-9dbc3e294d00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e93c790724d44d792411394543d8f6b', 'request_id': 'req-7336ef2b-ca5f-4a6d-99d8-9dbc3e294d00'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:49.413424 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7336ef2b-ca5f-4a6d-99d8-9dbc3e294d00 admin admin] The token cache is being invalidate because project 3e93c790724d44d792411394543d8f6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:58:49.414406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7336ef2b-ca5f-4a6d-99d8-9dbc3e294d00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:49.415214 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7336ef2b-ca5f-4a6d-99d8-9dbc3e294d00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:49.419922 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 919/1834] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:58:49 2022] DELETE /identity/v3/projects/3e93c790724d44d792411394543d8f6b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:58:49.420882 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336ef2b-ca5f-4a6d-99d8-9dbc3e294d00 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:49.422253 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-7336ef2b-ca5f-4a6d-99d8-9dbc3e294d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:49.429069 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbf452-d90c-4c39-b835-f531c600d1c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:49.431559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbf452-d90c-4c39-b835-f531c600d1c1 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:49.436454 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336ef2b-ca5f-4a6d-99d8-9dbc3e294d00 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:49.441172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27bded-5f3d-40f2-973e-526cbcc9ed05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:49.442237 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 916/1835] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:58:49.442360 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27bded-5f3d-40f2-973e-526cbcc9ed05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:49.445023 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27bded-5f3d-40f2-973e-526cbcc9ed05 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:49.445319 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27bded-5f3d-40f2-973e-526cbcc9ed05 admin admin] PATH_INFO: `/v3/users/30f5342a454346f281211fca9c835dbd` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:49.447101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27bded-5f3d-40f2-973e-526cbcc9ed05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f5342a454346f281211fca9c835dbd)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:49.449107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27bded-5f3d-40f2-973e-526cbcc9ed05 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:49.555032 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1a31e-b222-4b48-a3b9-da2fdacc2801 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:49.561567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1a31e-b222-4b48-a3b9-da2fdacc2801 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:49.561567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1a31e-b222-4b48-a3b9-da2fdacc2801 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:49.561567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 917/1836] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jun 23 10:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:58:49.574156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da7c20-d49e-416c-bf08-af4f9b910dc5 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:49.574769 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da7c20-d49e-416c-bf08-af4f9b910dc5 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:49.575176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da7c20-d49e-416c-bf08-af4f9b910dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:49.597238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-11da7c20-d49e-416c-bf08-af4f9b910dc5 None None] MFA Rules not processed for user `6ff588aaad264f9cbc5a80e73ef0c09d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:49.598775 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-11da7c20-d49e-416c-bf08-af4f9b910dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:49.682036 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8f27bded-5f3d-40f2-973e-526cbcc9ed05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f5342a454346f281211fca9c835dbd'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:49.690626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 918/1837] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jun 23 10:58:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:58:49.719108 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8f27bded-5f3d-40f2-973e-526cbcc9ed05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f5342a454346f281211fca9c835dbd'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:49.721477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8f27bded-5f3d-40f2-973e-526cbcc9ed05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f5342a454346f281211fca9c835dbd'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:49.840878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da7c20-d49e-416c-bf08-af4f9b910dc5 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:49.840878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-11da7c20-d49e-416c-bf08-af4f9b910dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:49.840878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da7c20-d49e-416c-bf08-af4f9b910dc5 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:49.841805 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe570d-305f-4cb1-bc1c-6c558ac636f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff588aaad264f9cbc5a80e73ef0c09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:49.841805 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe570d-305f-4cb1-bc1c-6c558ac636f1 service placement] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:49.841805 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe570d-305f-4cb1-bc1c-6c558ac636f1 service placement] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:49.841805 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe570d-305f-4cb1-bc1c-6c558ac636f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:49.842512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-20fe570d-305f-4cb1-bc1c-6c558ac636f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:49.842512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe570d-305f-4cb1-bc1c-6c558ac636f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:49.842512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe570d-305f-4cb1-bc1c-6c558ac636f1 service placement] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:49.842512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 919/1838] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:58:50.096494 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8f27bded-5f3d-40f2-973e-526cbcc9ed05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f5342a454346f281211fca9c835dbd'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:50.097406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8f27bded-5f3d-40f2-973e-526cbcc9ed05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f5342a454346f281211fca9c835dbd'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:50.118761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 920/1839] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:58:49 2022] DELETE /identity/v3/users/30f5342a454346f281211fca9c835dbd => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:50.159217 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe570d-305f-4cb1-bc1c-6c558ac636f1 service placement] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:50.161505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-20fe570d-305f-4cb1-bc1c-6c558ac636f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:50.203743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe570d-305f-4cb1-bc1c-6c558ac636f1 service placement] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:50.294222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3800b-51e2-47f5-84ac-f608eab060aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:50.295112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3800b-51e2-47f5-84ac-f608eab060aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:50.297991 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3800b-51e2-47f5-84ac-f608eab060aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:50.298826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3800b-51e2-47f5-84ac-f608eab060aa admin admin] PATH_INFO: `/v3/projects/49efe0ce9cb34ea5bd679b66c7ad7f8d` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:50.305184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3800b-51e2-47f5-84ac-f608eab060aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=49efe0ce9cb34ea5bd679b66c7ad7f8d)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:50.307517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3800b-51e2-47f5-84ac-f608eab060aa admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:50.524334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-0ad3800b-51e2-47f5-84ac-f608eab060aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49efe0ce9cb34ea5bd679b66c7ad7f8d', 'request_id': 'req-0ad3800b-51e2-47f5-84ac-f608eab060aa'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:50.533236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-0ad3800b-51e2-47f5-84ac-f608eab060aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49efe0ce9cb34ea5bd679b66c7ad7f8d', 'request_id': 'req-0ad3800b-51e2-47f5-84ac-f608eab060aa'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:50.647868 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:50.648981 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-0ad3800b-51e2-47f5-84ac-f608eab060aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49efe0ce9cb34ea5bd679b66c7ad7f8d', 'request_id': 'req-0ad3800b-51e2-47f5-84ac-f608eab060aa'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:50.671738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-0ad3800b-51e2-47f5-84ac-f608eab060aa admin admin] The token cache is being invalidate because project 49efe0ce9cb34ea5bd679b66c7ad7f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:58:50.672048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-0ad3800b-51e2-47f5-84ac-f608eab060aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:50.673750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-0ad3800b-51e2-47f5-84ac-f608eab060aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:50.683711 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 920/1840] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:58:50 2022] DELETE /identity/v3/projects/49efe0ce9cb34ea5bd679b66c7ad7f8d => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:50.683853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27bded-5f3d-40f2-973e-526cbcc9ed05 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:50.697330 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27bded-5f3d-40f2-973e-526cbcc9ed05 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:50.791944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fce39-ef1b-4065-95ec-0049ecce94f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:50.791944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fce39-ef1b-4065-95ec-0049ecce94f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:50.791944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fce39-ef1b-4065-95ec-0049ecce94f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:50.791944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fce39-ef1b-4065-95ec-0049ecce94f3 admin admin] PATH_INFO: `/v3/users/043b5090a4b64f4bb446e8309606f576` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:50.792391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fce39-ef1b-4065-95ec-0049ecce94f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=043b5090a4b64f4bb446e8309606f576)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:50.792480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3800b-51e2-47f5-84ac-f608eab060aa admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:50.792570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fce39-ef1b-4065-95ec-0049ecce94f3 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:50.792718 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-0ad3800b-51e2-47f5-84ac-f608eab060aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:50.812325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3800b-51e2-47f5-84ac-f608eab060aa admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:50.818286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc93ac7-c223-46f4-9f4d-dd3212b55686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:50.821459 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc93ac7-c223-46f4-9f4d-dd3212b55686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:50.822962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc93ac7-c223-46f4-9f4d-dd3212b55686 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:50.823323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc93ac7-c223-46f4-9f4d-dd3212b55686 admin admin] PATH_INFO: `/v3/projects/9425008c65414246813044b8989e283b` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:50.825604 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc93ac7-c223-46f4-9f4d-dd3212b55686 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9425008c65414246813044b8989e283b)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:50.830718 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc93ac7-c223-46f4-9f4d-dd3212b55686 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:51.110806 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ecc93ac7-c223-46f4-9f4d-dd3212b55686 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9425008c65414246813044b8989e283b', 'request_id': 'req-ecc93ac7-c223-46f4-9f4d-dd3212b55686'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:51.113885 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-d12fce39-ef1b-4065-95ec-0049ecce94f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043b5090a4b64f4bb446e8309606f576'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:51.127159 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ecc93ac7-c223-46f4-9f4d-dd3212b55686 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9425008c65414246813044b8989e283b', 'request_id': 'req-ecc93ac7-c223-46f4-9f4d-dd3212b55686'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:51.141680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-d12fce39-ef1b-4065-95ec-0049ecce94f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043b5090a4b64f4bb446e8309606f576'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:51.142667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-d12fce39-ef1b-4065-95ec-0049ecce94f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043b5090a4b64f4bb446e8309606f576'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:51.236359 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ecc93ac7-c223-46f4-9f4d-dd3212b55686 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9425008c65414246813044b8989e283b', 'request_id': 'req-ecc93ac7-c223-46f4-9f4d-dd3212b55686'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:51.253452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ecc93ac7-c223-46f4-9f4d-dd3212b55686 admin admin] The token cache is being invalidate because project 9425008c65414246813044b8989e283b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:58:51.254015 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ecc93ac7-c223-46f4-9f4d-dd3212b55686 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:51.254874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ecc93ac7-c223-46f4-9f4d-dd3212b55686 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:51.256709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 921/1841] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:58:50 2022] DELETE /identity/v3/projects/9425008c65414246813044b8989e283b => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:51.261340 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cacdad-4705-4eb3-b702-ae58e88ca308 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:51.261807 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cacdad-4705-4eb3-b702-ae58e88ca308 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:51.262101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cacdad-4705-4eb3-b702-ae58e88ca308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:51.281879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-d2cacdad-4705-4eb3-b702-ae58e88ca308 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:51.283111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d2cacdad-4705-4eb3-b702-ae58e88ca308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:51.350397 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 922/1842] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:58:51.358722 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d6b0a-15e6-48b4-bfa1-429fc0aa78b8 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:51.359178 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d6b0a-15e6-48b4-bfa1-429fc0aa78b8 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:51.359635 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d6b0a-15e6-48b4-bfa1-429fc0aa78b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:51.383272 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-544d6b0a-15e6-48b4-bfa1-429fc0aa78b8 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:51.384384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-544d6b0a-15e6-48b4-bfa1-429fc0aa78b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:51.397085 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 923/1843] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:51.400525 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-d12fce39-ef1b-4065-95ec-0049ecce94f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043b5090a4b64f4bb446e8309606f576'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:51.401875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-d12fce39-ef1b-4065-95ec-0049ecce94f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043b5090a4b64f4bb446e8309606f576'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:51.410665 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d6b0a-15e6-48b4-bfa1-429fc0aa78b8 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:51.422813 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d6b0a-15e6-48b4-bfa1-429fc0aa78b8 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:51.428683 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421f77b-b723-4768-af00-41524affbc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:51.430732 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421f77b-b723-4768-af00-41524affbc37 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:51.430732 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421f77b-b723-4768-af00-41524affbc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:51.430732 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421f77b-b723-4768-af00-41524affbc37 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:51.431483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421f77b-b723-4768-af00-41524affbc37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:58:51.431901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421f77b-b723-4768-af00-41524affbc37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:51.434332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421f77b-b723-4768-af00-41524affbc37 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:51.452679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 924/1844] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:58:51.452873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 921/1845] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:58:50 2022] DELETE /identity/v3/users/043b5090a4b64f4bb446e8309606f576 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:51.456890 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421f77b-b723-4768-af00-41524affbc37 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:51.476950 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421f77b-b723-4768-af00-41524affbc37 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:51.504944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937767b0-f857-4b58-9f6e-5a43c632e7dd None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:51.505309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937767b0-f857-4b58-9f6e-5a43c632e7dd None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:51.506758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937767b0-f857-4b58-9f6e-5a43c632e7dd None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:51.509032 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 922/1846] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jun 23 10:58:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:58:51.558394 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5c1ee-4753-436e-9d8d-c20c8da9d6a5 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:51.563154 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5c1ee-4753-436e-9d8d-c20c8da9d6a5 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:51.563154 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5c1ee-4753-436e-9d8d-c20c8da9d6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:51.584304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90f737-b7df-4632-afcc-6a1ff27a50b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:51.584549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90f737-b7df-4632-afcc-6a1ff27a50b1 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:51.584825 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90f737-b7df-4632-afcc-6a1ff27a50b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:51.585072 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90f737-b7df-4632-afcc-6a1ff27a50b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:51.585952 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90f737-b7df-4632-afcc-6a1ff27a50b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:51.588538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90f737-b7df-4632-afcc-6a1ff27a50b1 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:51.613879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-f8b5c1ee-4753-436e-9d8d-c20c8da9d6a5 None None] MFA Rules not processed for user `6ff588aaad264f9cbc5a80e73ef0c09d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:51.615064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f8b5c1ee-4753-436e-9d8d-c20c8da9d6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:51.668470 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:51.689836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 925/1847] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:51 2022] POST /identity/v3/projects => generated 365 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:51.693572 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90f737-b7df-4632-afcc-6a1ff27a50b1 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:51.733192 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 923/1848] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jun 23 10:58:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:51.745087 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5c1ee-4753-436e-9d8d-c20c8da9d6a5 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:51.746633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f8b5c1ee-4753-436e-9d8d-c20c8da9d6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:51.794451 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5c1ee-4753-436e-9d8d-c20c8da9d6a5 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:51.811442 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90f737-b7df-4632-afcc-6a1ff27a50b1 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:51.828795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cc38f-9d89-4f2a-b4f0-61c522f19e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:51.830101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cc38f-9d89-4f2a-b4f0-61c522f19e35 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:51.830388 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cc38f-9d89-4f2a-b4f0-61c522f19e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:51.830666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cc38f-9d89-4f2a-b4f0-61c522f19e35 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:51.831386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172cc38f-9d89-4f2a-b4f0-61c522f19e35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:51.834268 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172cc38f-9d89-4f2a-b4f0-61c522f19e35 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:51.920225 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd26815-298f-4afc-93e3-fb44565053c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff588aaad264f9cbc5a80e73ef0c09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:51.920998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd26815-298f-4afc-93e3-fb44565053c0 service placement] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:51.921543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd26815-298f-4afc-93e3-fb44565053c0 service placement] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:51.921944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd26815-298f-4afc-93e3-fb44565053c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:51.934614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd26815-298f-4afc-93e3-fb44565053c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:51.936507 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd26815-298f-4afc-93e3-fb44565053c0 service placement] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:51.972873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 924/1849] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:58:51.972873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd26815-298f-4afc-93e3-fb44565053c0 service placement] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:51.972873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-abd26815-298f-4afc-93e3-fb44565053c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:51.972873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd26815-298f-4afc-93e3-fb44565053c0 service placement] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:51.983023 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0ed41-79af-4ea9-9579-ca9d7458a54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:51.984460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0ed41-79af-4ea9-9579-ca9d7458a54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:51.984915 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0ed41-79af-4ea9-9579-ca9d7458a54e admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:51.985462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0ed41-79af-4ea9-9579-ca9d7458a54e admin admin] PATH_INFO: `/v3/users/54e89bce266d48ffb29a21960f0241d1` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:51.988067 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0ed41-79af-4ea9-9579-ca9d7458a54e admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e89bce266d48ffb29a21960f0241d1)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:51.992500 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0ed41-79af-4ea9-9579-ca9d7458a54e admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:52.020445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 926/1850] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:51 2022] POST /identity/v3/users => generated 283 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:52.027852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cc38f-9d89-4f2a-b4f0-61c522f19e35 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:52.038418 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cc38f-9d89-4f2a-b4f0-61c522f19e35 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:52.050098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfeed2-f55e-4658-8043-c35495a10832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:52.051440 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfeed2-f55e-4658-8043-c35495a10832 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:52.051853 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfeed2-f55e-4658-8043-c35495a10832 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:52.052181 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfeed2-f55e-4658-8043-c35495a10832 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:52.053014 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfeed2-f55e-4658-8043-c35495a10832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:52.055416 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfeed2-f55e-4658-8043-c35495a10832 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:52.067749 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 927/1851] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:52.072794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfeed2-f55e-4658-8043-c35495a10832 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:52.083234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfeed2-f55e-4658-8043-c35495a10832 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:52.090195 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e23555-ea8b-471a-b2e7-2acd36398d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:52.090898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e23555-ea8b-471a-b2e7-2acd36398d7e admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:52.091188 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e23555-ea8b-471a-b2e7-2acd36398d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:52.091525 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e23555-ea8b-471a-b2e7-2acd36398d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:52.092430 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e23555-ea8b-471a-b2e7-2acd36398d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:52.094277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e23555-ea8b-471a-b2e7-2acd36398d7e admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:52.112075 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 928/1852] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:52.113077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e23555-ea8b-471a-b2e7-2acd36398d7e admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:52.132249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e23555-ea8b-471a-b2e7-2acd36398d7e admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:52.139775 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a2651-11af-4752-ba78-710479e042da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:52.141199 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a2651-11af-4752-ba78-710479e042da admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:52.141822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a2651-11af-4752-ba78-710479e042da admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:52.142457 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a2651-11af-4752-ba78-710479e042da admin admin] PATH_INFO: `/v3/projects/26b13050e8af4f81b490902d4473289e/users/3bb21563113748179de69cafcea3d0cc/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:52.171769 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a2651-11af-4752-ba78-710479e042da admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b13050e8af4f81b490902d4473289e, user_id=3bb21563113748179de69cafcea3d0cc, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:52.175045 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a2651-11af-4752-ba78-710479e042da admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:52.231079 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6ae0ed41-79af-4ea9-9579-ca9d7458a54e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e89bce266d48ffb29a21960f0241d1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:52.240384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6ae0ed41-79af-4ea9-9579-ca9d7458a54e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e89bce266d48ffb29a21960f0241d1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:52.241300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6ae0ed41-79af-4ea9-9579-ca9d7458a54e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e89bce266d48ffb29a21960f0241d1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:52.274688 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 929/1853] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:52 2022] PUT /identity/v3/projects/26b13050e8af4f81b490902d4473289e/users/3bb21563113748179de69cafcea3d0cc/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:52.288132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f50b6-f5c0-4d27-ba42-3b1f96e1905c None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:52.288417 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f50b6-f5c0-4d27-ba42-3b1f96e1905c None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:52.289466 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f50b6-f5c0-4d27-ba42-3b1f96e1905c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:52.318398 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-a27f50b6-f5c0-4d27-ba42-3b1f96e1905c None None] MFA Rules not processed for user `3bb21563113748179de69cafcea3d0cc`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:52.319624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-a27f50b6-f5c0-4d27-ba42-3b1f96e1905c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:52.356184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6ae0ed41-79af-4ea9-9579-ca9d7458a54e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e89bce266d48ffb29a21960f0241d1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:52.356938 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6ae0ed41-79af-4ea9-9579-ca9d7458a54e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e89bce266d48ffb29a21960f0241d1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:52.377146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 925/1854] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:58:51 2022] DELETE /identity/v3/users/54e89bce266d48ffb29a21960f0241d1 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:52.393134 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 930/1855] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:58:52.405133 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0ed41-79af-4ea9-9579-ca9d7458a54e admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:52.405133 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-6ae0ed41-79af-4ea9-9579-ca9d7458a54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:52.409041 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f50b6-f5c0-4d27-ba42-3b1f96e1905c None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:52.411781 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-a27f50b6-f5c0-4d27-ba42-3b1f96e1905c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:52.539570 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f50b6-f5c0-4d27-ba42-3b1f96e1905c None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:52.583721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0ed41-79af-4ea9-9579-ca9d7458a54e admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:52.594935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad3634-50b3-4df3-b9e0-ae658aa7ea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:52.596263 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad3634-50b3-4df3-b9e0-ae658aa7ea65 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:52.596904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad3634-50b3-4df3-b9e0-ae658aa7ea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:52.597496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad3634-50b3-4df3-b9e0-ae658aa7ea65 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:52.601934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad3634-50b3-4df3-b9e0-ae658aa7ea65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:52.604496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad3634-50b3-4df3-b9e0-ae658aa7ea65 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:52.658738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850481a-0a02-4464-a25f-bf108321a1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:52.661582 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850481a-0a02-4464-a25f-bf108321a1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:52.662529 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850481a-0a02-4464-a25f-bf108321a1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:52.665230 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850481a-0a02-4464-a25f-bf108321a1f8 admin admin] PATH_INFO: `/v3/projects/64de0f359c65456bae82f72e5775d0e5` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:52.667296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d850481a-0a02-4464-a25f-bf108321a1f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64de0f359c65456bae82f72e5775d0e5)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:52.670703 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d850481a-0a02-4464-a25f-bf108321a1f8 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:52.714882 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 926/1856] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:52 2022] POST /identity/v3/projects => generated 363 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:52.719243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad3634-50b3-4df3-b9e0-ae658aa7ea65 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:52.826478 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad3634-50b3-4df3-b9e0-ae658aa7ea65 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:52.833997 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc4564-19ed-4339-aa5a-c1b56119cbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:52.834808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc4564-19ed-4339-aa5a-c1b56119cbc7 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:52.835241 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc4564-19ed-4339-aa5a-c1b56119cbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:52.836334 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc4564-19ed-4339-aa5a-c1b56119cbc7 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:52.837093 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc4564-19ed-4339-aa5a-c1b56119cbc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:52.839157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc4564-19ed-4339-aa5a-c1b56119cbc7 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:52.885982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d850481a-0a02-4464-a25f-bf108321a1f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64de0f359c65456bae82f72e5775d0e5', 'request_id': 'req-d850481a-0a02-4464-a25f-bf108321a1f8'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:52.892764 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d850481a-0a02-4464-a25f-bf108321a1f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64de0f359c65456bae82f72e5775d0e5', 'request_id': 'req-d850481a-0a02-4464-a25f-bf108321a1f8'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:52.969432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 927/1857] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:52 2022] POST /identity/v3/users => generated 288 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:52.970651 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc4564-19ed-4339-aa5a-c1b56119cbc7 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:52.979330 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-eccc4564-19ed-4339-aa5a-c1b56119cbc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:52.999708 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc4564-19ed-4339-aa5a-c1b56119cbc7 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:53.001049 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d850481a-0a02-4464-a25f-bf108321a1f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64de0f359c65456bae82f72e5775d0e5', 'request_id': 'req-d850481a-0a02-4464-a25f-bf108321a1f8'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:53.019415 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d850481a-0a02-4464-a25f-bf108321a1f8 admin admin] The token cache is being invalidate because project 64de0f359c65456bae82f72e5775d0e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:58:53.019415 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d850481a-0a02-4464-a25f-bf108321a1f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:53.021250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d850481a-0a02-4464-a25f-bf108321a1f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:53.027889 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 931/1858] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:58:52 2022] DELETE /identity/v3/projects/64de0f359c65456bae82f72e5775d0e5 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:53.049109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850481a-0a02-4464-a25f-bf108321a1f8 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:53.051340 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d850481a-0a02-4464-a25f-bf108321a1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:53.123745 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7555156-3816-4183-afdd-da7631b96a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:53.123745 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7555156-3816-4183-afdd-da7631b96a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:53.123745 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7555156-3816-4183-afdd-da7631b96a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:53.123745 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7555156-3816-4183-afdd-da7631b96a4d admin admin] PATH_INFO: `/v3/projects/f27ed1097c35486a864cd17d53cb3294` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:53.124080 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7555156-3816-4183-afdd-da7631b96a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f27ed1097c35486a864cd17d53cb3294)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:53.124080 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7555156-3816-4183-afdd-da7631b96a4d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:53.208829 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:53.236544 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850481a-0a02-4464-a25f-bf108321a1f8 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:53.251628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a4f16-706a-4191-b28f-8316823da6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:53.252335 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a4f16-706a-4191-b28f-8316823da6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:53.252624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a4f16-706a-4191-b28f-8316823da6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:53.253412 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a4f16-706a-4191-b28f-8316823da6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:53.254614 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a4f16-706a-4191-b28f-8316823da6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:53.258154 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a4f16-706a-4191-b28f-8316823da6b9 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:53.296348 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 932/1859] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:53.305391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe9acc-2b1e-450c-ac2d-e67c686b5451 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:53.306076 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe9acc-2b1e-450c-ac2d-e67c686b5451 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:53.306609 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe9acc-2b1e-450c-ac2d-e67c686b5451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:53.312611 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f7555156-3816-4183-afdd-da7631b96a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27ed1097c35486a864cd17d53cb3294', 'request_id': 'req-f7555156-3816-4183-afdd-da7631b96a4d'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:53.337709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-37fe9acc-2b1e-450c-ac2d-e67c686b5451 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:53.338534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-37fe9acc-2b1e-450c-ac2d-e67c686b5451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:53.353927 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:53.410181 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 933/1860] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:53.416760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe9acc-2b1e-450c-ac2d-e67c686b5451 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:53.423797 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe9acc-2b1e-450c-ac2d-e67c686b5451 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:53.433694 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7c68f-029d-4e4b-bc9d-39ecbc429ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:53.435125 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7c68f-029d-4e4b-bc9d-39ecbc429ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:53.435797 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7c68f-029d-4e4b-bc9d-39ecbc429ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:53.436037 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7c68f-029d-4e4b-bc9d-39ecbc429ddb admin admin] PATH_INFO: `/v3/projects/8da10f57ee63405bb457c4c629ab0090/users/f2bf2ddadce64bf8bc0d90b509b809b8/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:53.456239 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7c68f-029d-4e4b-bc9d-39ecbc429ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8da10f57ee63405bb457c4c629ab0090, user_id=f2bf2ddadce64bf8bc0d90b509b809b8, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:53.458839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7c68f-029d-4e4b-bc9d-39ecbc429ddb admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:53.482548 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f7555156-3816-4183-afdd-da7631b96a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27ed1097c35486a864cd17d53cb3294', 'request_id': 'req-f7555156-3816-4183-afdd-da7631b96a4d'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:53.492020 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f7555156-3816-4183-afdd-da7631b96a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27ed1097c35486a864cd17d53cb3294', 'request_id': 'req-f7555156-3816-4183-afdd-da7631b96a4d'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:53.507294 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f7555156-3816-4183-afdd-da7631b96a4d admin admin] The token cache is being invalidate because project f27ed1097c35486a864cd17d53cb3294 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:58:53.507866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f7555156-3816-4183-afdd-da7631b96a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:53.511054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f7555156-3816-4183-afdd-da7631b96a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:53.511054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 928/1861] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:58:52 2022] DELETE /identity/v3/projects/f27ed1097c35486a864cd17d53cb3294 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:53.512460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab2e56-ed04-4721-bab3-547dbb82f690 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:53.512860 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab2e56-ed04-4721-bab3-547dbb82f690 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:53.513216 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab2e56-ed04-4721-bab3-547dbb82f690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:53.534645 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-eaab2e56-ed04-4721-bab3-547dbb82f690 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:53.536542 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-eaab2e56-ed04-4721-bab3-547dbb82f690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:53.547583 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 929/1862] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:53.548450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab2e56-ed04-4721-bab3-547dbb82f690 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:53.549919 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-eaab2e56-ed04-4721-bab3-547dbb82f690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:53.565231 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab2e56-ed04-4721-bab3-547dbb82f690 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:53.575510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 934/1863] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:53 2022] PUT /identity/v3/projects/8da10f57ee63405bb457c4c629ab0090/users/f2bf2ddadce64bf8bc0d90b509b809b8/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:53.575510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7c68f-029d-4e4b-bc9d-39ecbc429ddb admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:53.643807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a2248-4e11-44c9-8f3c-4ca50579b659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:53.645149 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a2248-4e11-44c9-8f3c-4ca50579b659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:53.645769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a2248-4e11-44c9-8f3c-4ca50579b659 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:53.646257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a2248-4e11-44c9-8f3c-4ca50579b659 admin admin] PATH_INFO: `/v3/users/cb7faec011944df6b2ce1f38bfc37ab1` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:53.648966 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a2248-4e11-44c9-8f3c-4ca50579b659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb7faec011944df6b2ce1f38bfc37ab1)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:53.650988 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a2248-4e11-44c9-8f3c-4ca50579b659 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:53.664332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7c68f-029d-4e4b-bc9d-39ecbc429ddb admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:53.670257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8843f-7aa7-4b46-ad93-78b62e151f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:53.671074 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8843f-7aa7-4b46-ad93-78b62e151f15 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:53.671510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8843f-7aa7-4b46-ad93-78b62e151f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:53.671669 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8843f-7aa7-4b46-ad93-78b62e151f15 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:53.672385 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8843f-7aa7-4b46-ad93-78b62e151f15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:58:53.672731 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8843f-7aa7-4b46-ad93-78b62e151f15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:53.675176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8843f-7aa7-4b46-ad93-78b62e151f15 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:53.691041 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 935/1864] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:58:53.691916 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8843f-7aa7-4b46-ad93-78b62e151f15 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:53.697830 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-66f8843f-7aa7-4b46-ad93-78b62e151f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:53.713734 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8843f-7aa7-4b46-ad93-78b62e151f15 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:53.718852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495dfb5-3d6d-4f84-b44e-200c6f0656c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:53.719661 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495dfb5-3d6d-4f84-b44e-200c6f0656c4 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:53.719950 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495dfb5-3d6d-4f84-b44e-200c6f0656c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:53.720226 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495dfb5-3d6d-4f84-b44e-200c6f0656c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:53.721017 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495dfb5-3d6d-4f84-b44e-200c6f0656c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:53.722668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495dfb5-3d6d-4f84-b44e-200c6f0656c4 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:53.736847 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 936/1865] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:53.736847 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495dfb5-3d6d-4f84-b44e-200c6f0656c4 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:53.747762 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495dfb5-3d6d-4f84-b44e-200c6f0656c4 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:53.756369 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d1776-78f6-498a-a3ba-34034e3b94e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:53.757234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d1776-78f6-498a-a3ba-34034e3b94e3 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:53.758072 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d1776-78f6-498a-a3ba-34034e3b94e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:53.758419 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d1776-78f6-498a-a3ba-34034e3b94e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:53.759286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d1776-78f6-498a-a3ba-34034e3b94e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:53.762511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d1776-78f6-498a-a3ba-34034e3b94e3 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:53.871408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 937/1866] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:53 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:53.872953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d1776-78f6-498a-a3ba-34034e3b94e3 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:53.876712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-fb5a2248-4e11-44c9-8f3c-4ca50579b659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb7faec011944df6b2ce1f38bfc37ab1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:53.887163 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-fb5a2248-4e11-44c9-8f3c-4ca50579b659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb7faec011944df6b2ce1f38bfc37ab1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:53.888278 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-fb5a2248-4e11-44c9-8f3c-4ca50579b659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb7faec011944df6b2ce1f38bfc37ab1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:53.950696 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-fb5a2248-4e11-44c9-8f3c-4ca50579b659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb7faec011944df6b2ce1f38bfc37ab1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:53.954656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-fb5a2248-4e11-44c9-8f3c-4ca50579b659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb7faec011944df6b2ce1f38bfc37ab1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:53.968391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d1776-78f6-498a-a3ba-34034e3b94e3 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:53.974422 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58aeafa-0667-45d0-bf95-2af8f55b6fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:53.977091 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58aeafa-0667-45d0-bf95-2af8f55b6fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:53.977091 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58aeafa-0667-45d0-bf95-2af8f55b6fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:53.977091 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58aeafa-0667-45d0-bf95-2af8f55b6fb5 admin admin] PATH_INFO: `/v3/projects/8da10f57ee63405bb457c4c629ab0090/users/f2bf2ddadce64bf8bc0d90b509b809b8/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:53.983548 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 930/1867] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:58:53 2022] DELETE /identity/v3/users/cb7faec011944df6b2ce1f38bfc37ab1 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:53.983548 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a2248-4e11-44c9-8f3c-4ca50579b659 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:53.983905 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58aeafa-0667-45d0-bf95-2af8f55b6fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8da10f57ee63405bb457c4c629ab0090, user_id=f2bf2ddadce64bf8bc0d90b509b809b8, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:53.983905 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58aeafa-0667-45d0-bf95-2af8f55b6fb5 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:53.987396 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-fb5a2248-4e11-44c9-8f3c-4ca50579b659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:53.996584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 938/1868] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:53 2022] PUT /identity/v3/projects/8da10f57ee63405bb457c4c629ab0090/users/f2bf2ddadce64bf8bc0d90b509b809b8/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:54.008318 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3c3b5-1677-4203-9be5-042990b7d243 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:54.009257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3c3b5-1677-4203-9be5-042990b7d243 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:54.021636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3c3b5-1677-4203-9be5-042990b7d243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:54.043729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-dcd3c3b5-1677-4203-9be5-042990b7d243 None None] MFA Rules not processed for user `f2bf2ddadce64bf8bc0d90b509b809b8`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:54.047905 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-dcd3c3b5-1677-4203-9be5-042990b7d243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:54.113259 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a2248-4e11-44c9-8f3c-4ca50579b659 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:54.195957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 939/1869] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:54 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:58:54.209914 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3c3b5-1677-4203-9be5-042990b7d243 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:54.211529 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-dcd3c3b5-1677-4203-9be5-042990b7d243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:54.226393 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec226689-8785-4813-8166-87460f9cccc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:54.227338 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec226689-8785-4813-8166-87460f9cccc3 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:54.227638 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec226689-8785-4813-8166-87460f9cccc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:54.228955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec226689-8785-4813-8166-87460f9cccc3 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:54.232656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec226689-8785-4813-8166-87460f9cccc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:54.237059 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec226689-8785-4813-8166-87460f9cccc3 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:54.291230 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3c3b5-1677-4203-9be5-042990b7d243 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:54.296342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa9319-708c-4b18-a936-6313f451ec20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:54.297157 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa9319-708c-4b18-a936-6313f451ec20 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:54.297778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa9319-708c-4b18-a936-6313f451ec20 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:54.297778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa9319-708c-4b18-a936-6313f451ec20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:54.314268 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa9319-708c-4b18-a936-6313f451ec20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:54.315122 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa9319-708c-4b18-a936-6313f451ec20 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:54.327542 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 940/1870] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:54 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:58:54.372671 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 931/1871] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:53 2022] POST /identity/v3/users => generated 296 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:54.376170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa9319-708c-4b18-a936-6313f451ec20 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:54.389389 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa9319-708c-4b18-a936-6313f451ec20 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:54.395172 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7223ed-d576-423e-b46b-c7a0755afcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:54.396819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7223ed-d576-423e-b46b-c7a0755afcdd admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:54.397282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7223ed-d576-423e-b46b-c7a0755afcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:54.397634 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7223ed-d576-423e-b46b-c7a0755afcdd admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:54.399078 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7223ed-d576-423e-b46b-c7a0755afcdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:54.401302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7223ed-d576-423e-b46b-c7a0755afcdd admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:54.418714 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 941/1872] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:54.420334 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec226689-8785-4813-8166-87460f9cccc3 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:54.432367 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec226689-8785-4813-8166-87460f9cccc3 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:54.434892 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7223ed-d576-423e-b46b-c7a0755afcdd admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:54.438808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-2b7223ed-d576-423e-b46b-c7a0755afcdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:54.452239 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0533b-8111-4626-9570-d174b27be5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:54.453855 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0533b-8111-4626-9570-d174b27be5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:54.454206 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0533b-8111-4626-9570-d174b27be5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:54.454597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0533b-8111-4626-9570-d174b27be5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:54.455641 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0533b-8111-4626-9570-d174b27be5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:54.459310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0533b-8111-4626-9570-d174b27be5c5 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:54.474345 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7223ed-d576-423e-b46b-c7a0755afcdd admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:54.493803 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 932/1873] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:58:54.494793 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0533b-8111-4626-9570-d174b27be5c5 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:54.496369 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff058343-9e63-472d-8799-b07741d3332e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:54.497367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff058343-9e63-472d-8799-b07741d3332e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:54.497654 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff058343-9e63-472d-8799-b07741d3332e admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:54.498832 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff058343-9e63-472d-8799-b07741d3332e admin admin] PATH_INFO: `/v3/projects/fcd72fb819f244c4a363e30d8e433071` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:54.504916 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff058343-9e63-472d-8799-b07741d3332e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcd72fb819f244c4a363e30d8e433071)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:54.507094 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff058343-9e63-472d-8799-b07741d3332e admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:54.522139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0533b-8111-4626-9570-d174b27be5c5 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:54.556462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a066787-c410-4a61-94f8-8d39d8ec4014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:54.557422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a066787-c410-4a61-94f8-8d39d8ec4014 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:54.557709 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a066787-c410-4a61-94f8-8d39d8ec4014 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:54.558140 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a066787-c410-4a61-94f8-8d39d8ec4014 admin admin] PATH_INFO: `/v3/projects/f5cb9954d887472fb6e7d6ac23801cb5/users/3ba8c78f906d413e84024d3c457ec56e/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:54.593716 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a066787-c410-4a61-94f8-8d39d8ec4014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5cb9954d887472fb6e7d6ac23801cb5, user_id=3ba8c78f906d413e84024d3c457ec56e, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:54.597131 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a066787-c410-4a61-94f8-8d39d8ec4014 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:54.623399 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:54.682164 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 933/1874] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:54 2022] PUT /identity/v3/projects/f5cb9954d887472fb6e7d6ac23801cb5/users/3ba8c78f906d413e84024d3c457ec56e/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:54.683244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a066787-c410-4a61-94f8-8d39d8ec4014 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:54.694068 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ff058343-9e63-472d-8799-b07741d3332e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcd72fb819f244c4a363e30d8e433071', 'request_id': 'req-ff058343-9e63-472d-8799-b07741d3332e'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:54.715911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ff058343-9e63-472d-8799-b07741d3332e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcd72fb819f244c4a363e30d8e433071', 'request_id': 'req-ff058343-9e63-472d-8799-b07741d3332e'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:54.776283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a066787-c410-4a61-94f8-8d39d8ec4014 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:54.804840 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ff058343-9e63-472d-8799-b07741d3332e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcd72fb819f244c4a363e30d8e433071', 'request_id': 'req-ff058343-9e63-472d-8799-b07741d3332e'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:54.818619 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ff058343-9e63-472d-8799-b07741d3332e admin admin] The token cache is being invalidate because project fcd72fb819f244c4a363e30d8e433071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:58:54.818927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ff058343-9e63-472d-8799-b07741d3332e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:54.820943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ff058343-9e63-472d-8799-b07741d3332e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:54.822940 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 942/1875] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:58:54 2022] DELETE /identity/v3/projects/fcd72fb819f244c4a363e30d8e433071 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:54.824398 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba76450-6476-49e0-85ea-e7f6d8ce8b20 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:54.824790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba76450-6476-49e0-85ea-e7f6d8ce8b20 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:54.825145 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba76450-6476-49e0-85ea-e7f6d8ce8b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:54.833071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29070c5d-7648-4199-97c0-6dc1b03c3002 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:54.833714 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29070c5d-7648-4199-97c0-6dc1b03c3002 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:54.834000 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29070c5d-7648-4199-97c0-6dc1b03c3002 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:54.834276 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29070c5d-7648-4199-97c0-6dc1b03c3002 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:54.837200 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-29070c5d-7648-4199-97c0-6dc1b03c3002 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:54.861999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-bba76450-6476-49e0-85ea-e7f6d8ce8b20 None None] MFA Rules not processed for user `3ba8c78f906d413e84024d3c457ec56e`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:54.863340 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-bba76450-6476-49e0-85ea-e7f6d8ce8b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:54.924793 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29070c5d-7648-4199-97c0-6dc1b03c3002 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:54.926390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29070c5d-7648-4199-97c0-6dc1b03c3002 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:54.937758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 934/1876] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:54.938496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29070c5d-7648-4199-97c0-6dc1b03c3002 service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:54.940673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-29070c5d-7648-4199-97c0-6dc1b03c3002 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:54.947025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 943/1877] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:54.949066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4996c-5ccb-4ee6-bb84-5e76fc57f76c None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:54.949066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4996c-5ccb-4ee6-bb84-5e76fc57f76c None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:54.949296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4996c-5ccb-4ee6-bb84-5e76fc57f76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:54.972275 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-43c4996c-5ccb-4ee6-bb84-5e76fc57f76c None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:54.974184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-43c4996c-5ccb-4ee6-bb84-5e76fc57f76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:55.055919 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 944/1878] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:55.056834 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4996c-5ccb-4ee6-bb84-5e76fc57f76c None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:55.058376 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-43c4996c-5ccb-4ee6-bb84-5e76fc57f76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:55.071655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29070c5d-7648-4199-97c0-6dc1b03c3002 service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:55.077714 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4996c-5ccb-4ee6-bb84-5e76fc57f76c None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:55.079064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ce2a0-a1db-4ed5-a149-27146bacb1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:55.080033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ce2a0-a1db-4ed5-a149-27146bacb1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:55.080907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ce2a0-a1db-4ed5-a149-27146bacb1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:55.080907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ce2a0-a1db-4ed5-a149-27146bacb1cd admin admin] PATH_INFO: `/v3/users/e23be4030a8f4dbdb3190b096566f1df` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:55.081083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b5200-ce42-4102-a65d-34a509e94b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:55.081474 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b5200-ce42-4102-a65d-34a509e94b7c admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:55.081931 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b5200-ce42-4102-a65d-34a509e94b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:55.082420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ce2a0-a1db-4ed5-a149-27146bacb1cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e23be4030a8f4dbdb3190b096566f1df)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:55.082734 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b5200-ce42-4102-a65d-34a509e94b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:55.083547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b5200-ce42-4102-a65d-34a509e94b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:55.086243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ce2a0-a1db-4ed5-a149-27146bacb1cd admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:55.086591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b5200-ce42-4102-a65d-34a509e94b7c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:55.101550 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:55.209691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 945/1879] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:55 2022] POST /identity/v3/projects => generated 391 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:55.211801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d794eb-2b82-4de0-bb3e-0e98f7618684 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:55.212719 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d794eb-2b82-4de0-bb3e-0e98f7618684 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:55.213534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d794eb-2b82-4de0-bb3e-0e98f7618684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:55.236254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-79d794eb-2b82-4de0-bb3e-0e98f7618684 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:55.243633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-79d794eb-2b82-4de0-bb3e-0e98f7618684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:55.315129 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4b8ce2a0-a1db-4ed5-a149-27146bacb1cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e23be4030a8f4dbdb3190b096566f1df'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:55.325058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4b8ce2a0-a1db-4ed5-a149-27146bacb1cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e23be4030a8f4dbdb3190b096566f1df'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:55.329132 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4b8ce2a0-a1db-4ed5-a149-27146bacb1cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e23be4030a8f4dbdb3190b096566f1df'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:55.329314 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 946/1880] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:55.330015 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d794eb-2b82-4de0-bb3e-0e98f7618684 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:55.341065 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d794eb-2b82-4de0-bb3e-0e98f7618684 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:55.346526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03907b-3e29-4566-a4a2-cbf1e3c3de59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:55.347430 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03907b-3e29-4566-a4a2-cbf1e3c3de59 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:55.347430 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03907b-3e29-4566-a4a2-cbf1e3c3de59 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:55.347843 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03907b-3e29-4566-a4a2-cbf1e3c3de59 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:55.348414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03907b-3e29-4566-a4a2-cbf1e3c3de59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:55.350779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03907b-3e29-4566-a4a2-cbf1e3c3de59 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:55.455672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4b8ce2a0-a1db-4ed5-a149-27146bacb1cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e23be4030a8f4dbdb3190b096566f1df'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:55.456297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4b8ce2a0-a1db-4ed5-a149-27146bacb1cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e23be4030a8f4dbdb3190b096566f1df'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:55.462620 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 947/1881] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:55 2022] POST /identity/v3/users => generated 302 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:55.464220 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d889b-4a5a-446f-8220-24b75f7b613d None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:55.464515 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d889b-4a5a-446f-8220-24b75f7b613d None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:55.464825 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d889b-4a5a-446f-8220-24b75f7b613d None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:55.466325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 948/1882] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jun 23 10:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:58:55.467037 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d889b-4a5a-446f-8220-24b75f7b613d None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:55.468812 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-447d889b-4a5a-446f-8220-24b75f7b613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:55.481058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 935/1883] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:58:54 2022] DELETE /identity/v3/users/e23be4030a8f4dbdb3190b096566f1df => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:55.481838 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ce2a0-a1db-4ed5-a149-27146bacb1cd admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:55.483433 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4b8ce2a0-a1db-4ed5-a149-27146bacb1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:55.485577 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d889b-4a5a-446f-8220-24b75f7b613d None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:55.565926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492a5ba-31a1-45fa-b827-5e1f2da0b052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:55.565926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492a5ba-31a1-45fa-b827-5e1f2da0b052 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:55.566371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492a5ba-31a1-45fa-b827-5e1f2da0b052 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:55.567111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492a5ba-31a1-45fa-b827-5e1f2da0b052 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:55.568335 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492a5ba-31a1-45fa-b827-5e1f2da0b052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:58:55.568825 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492a5ba-31a1-45fa-b827-5e1f2da0b052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:55.570809 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492a5ba-31a1-45fa-b827-5e1f2da0b052 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:55.580756 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ce2a0-a1db-4ed5-a149-27146bacb1cd admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:55.590508 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 949/1884] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:58:55.590698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd558304-d532-48c8-84cf-8d236de95720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:55.590698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd558304-d532-48c8-84cf-8d236de95720 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:55.590698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd558304-d532-48c8-84cf-8d236de95720 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:55.590698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd558304-d532-48c8-84cf-8d236de95720 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:55.590987 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd558304-d532-48c8-84cf-8d236de95720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:55.592731 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd558304-d532-48c8-84cf-8d236de95720 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:55.601792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1f839-9ba8-44e3-972d-acaf7ab8f0ea None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:55.604655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1f839-9ba8-44e3-972d-acaf7ab8f0ea None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:55.605109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1f839-9ba8-44e3-972d-acaf7ab8f0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:55.609881 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 936/1885] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:55.611459 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5a166-8b47-419a-8eaf-bd0aed169330 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:55.611767 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5a166-8b47-419a-8eaf-bd0aed169330 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:55.612162 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5a166-8b47-419a-8eaf-bd0aed169330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:55.633177 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-33e5a166-8b47-419a-8eaf-bd0aed169330 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:55.635423 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-33e5a166-8b47-419a-8eaf-bd0aed169330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:55.651868 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-78e1f839-9ba8-44e3-972d-acaf7ab8f0ea None None] MFA Rules not processed for user `39840f048d254831bdb963b38520f706`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:55.654402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-78e1f839-9ba8-44e3-972d-acaf7ab8f0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:55.658467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 937/1886] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:55.659542 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5a166-8b47-419a-8eaf-bd0aed169330 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:55.675864 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5a166-8b47-419a-8eaf-bd0aed169330 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:55.683128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ee56e-9448-4540-b57f-d7d6203400d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:55.693081 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ee56e-9448-4540-b57f-d7d6203400d5 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:55.693081 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ee56e-9448-4540-b57f-d7d6203400d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:55.693081 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ee56e-9448-4540-b57f-d7d6203400d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:55.693081 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ee56e-9448-4540-b57f-d7d6203400d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:55.693081 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ee56e-9448-4540-b57f-d7d6203400d5 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:55.737643 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:55.752746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 950/1887] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jun 23 10:58:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:55.754029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1f839-9ba8-44e3-972d-acaf7ab8f0ea None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:55.771122 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1f839-9ba8-44e3-972d-acaf7ab8f0ea None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:55.778942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546426a6-c431-40ab-aedf-e5240d9a967b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:55.779843 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546426a6-c431-40ab-aedf-e5240d9a967b admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:55.780132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546426a6-c431-40ab-aedf-e5240d9a967b admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:55.780421 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546426a6-c431-40ab-aedf-e5240d9a967b admin admin] PATH_INFO: `/v3/projects/a982d9f40d94449f933fa427d426cb60/users/54d3642c152240ca859320100cd560bf/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:55.781975 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 938/1888] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:55 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:55.782856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ee56e-9448-4540-b57f-d7d6203400d5 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:55.786264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e70ee56e-9448-4540-b57f-d7d6203400d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:55.809342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546426a6-c431-40ab-aedf-e5240d9a967b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a982d9f40d94449f933fa427d426cb60, user_id=54d3642c152240ca859320100cd560bf, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:55.818326 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546426a6-c431-40ab-aedf-e5240d9a967b admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:55.887184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ee56e-9448-4540-b57f-d7d6203400d5 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:55.890922 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725708f1-a22b-4a21-bd7d-fcf7f459b905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:55.891595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725708f1-a22b-4a21-bd7d-fcf7f459b905 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:55.891880 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725708f1-a22b-4a21-bd7d-fcf7f459b905 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:55.892156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725708f1-a22b-4a21-bd7d-fcf7f459b905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:55.931799 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 951/1889] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:55 2022] PUT /identity/v3/projects/a982d9f40d94449f933fa427d426cb60/users/54d3642c152240ca859320100cd560bf/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:55.933187 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546426a6-c431-40ab-aedf-e5240d9a967b admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:55.971506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725708f1-a22b-4a21-bd7d-fcf7f459b905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:55.973142 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725708f1-a22b-4a21-bd7d-fcf7f459b905 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:55.984691 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 939/1890] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:55.985240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725708f1-a22b-4a21-bd7d-fcf7f459b905 service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:55.986769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-725708f1-a22b-4a21-bd7d-fcf7f459b905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:56.007341 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546426a6-c431-40ab-aedf-e5240d9a967b admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:56.014978 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151506e-7b38-4aff-aa27-ce17723189e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:56.015672 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151506e-7b38-4aff-aa27-ce17723189e6 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:56.015961 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151506e-7b38-4aff-aa27-ce17723189e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:56.016280 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151506e-7b38-4aff-aa27-ce17723189e6 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:56.017274 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151506e-7b38-4aff-aa27-ce17723189e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:56.020203 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151506e-7b38-4aff-aa27-ce17723189e6 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:56.073868 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725708f1-a22b-4a21-bd7d-fcf7f459b905 service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:56.144078 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 952/1891] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:55 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:56.145833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151506e-7b38-4aff-aa27-ce17723189e6 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:56.159806 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151506e-7b38-4aff-aa27-ce17723189e6 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:56.172302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cb1aa-65b5-4458-99ed-735c2e5a4ec3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:56.176730 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cb1aa-65b5-4458-99ed-735c2e5a4ec3 service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:56.176730 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cb1aa-65b5-4458-99ed-735c2e5a4ec3 service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:56.176730 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cb1aa-65b5-4458-99ed-735c2e5a4ec3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:56.177004 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afffba5-6cf3-4c0e-8c0e-4bf9417d3f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:56.177004 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afffba5-6cf3-4c0e-8c0e-4bf9417d3f1a admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:56.177004 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afffba5-6cf3-4c0e-8c0e-4bf9417d3f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:56.177347 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afffba5-6cf3-4c0e-8c0e-4bf9417d3f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:56.178328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afffba5-6cf3-4c0e-8c0e-4bf9417d3f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:56.181121 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afffba5-6cf3-4c0e-8c0e-4bf9417d3f1a admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:56.189104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cb1aa-65b5-4458-99ed-735c2e5a4ec3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:56.192101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cb1aa-65b5-4458-99ed-735c2e5a4ec3 service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:56.205993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 953/1892] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:56.210103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 940/1893] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:56.212924 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cb1aa-65b5-4458-99ed-735c2e5a4ec3 service nova] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:56.222703 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afffba5-6cf3-4c0e-8c0e-4bf9417d3f1a admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:56.230362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cb1aa-65b5-4458-99ed-735c2e5a4ec3 service nova] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:56.237532 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e92c92-9264-45d2-9b30-c3144a9ae1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:56.238802 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e92c92-9264-45d2-9b30-c3144a9ae1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:56.239541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e92c92-9264-45d2-9b30-c3144a9ae1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:56.240398 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e92c92-9264-45d2-9b30-c3144a9ae1c4 admin admin] PATH_INFO: `/v3/projects/a982d9f40d94449f933fa427d426cb60/users/54d3642c152240ca859320100cd560bf/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:56.244315 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e92c92-9264-45d2-9b30-c3144a9ae1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a982d9f40d94449f933fa427d426cb60, user_id=54d3642c152240ca859320100cd560bf, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:56.248409 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e92c92-9264-45d2-9b30-c3144a9ae1c4 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:56.271308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 941/1894] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:56 2022] PUT /identity/v3/projects/a982d9f40d94449f933fa427d426cb60/users/54d3642c152240ca859320100cd560bf/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:56.283977 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afffba5-6cf3-4c0e-8c0e-4bf9417d3f1a admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:56.285512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9d77a-35b5-4a12-87cc-4ce08683d055 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:56.286889 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9d77a-35b5-4a12-87cc-4ce08683d055 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:56.289380 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9d77a-35b5-4a12-87cc-4ce08683d055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:56.353756 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-b4f9d77a-35b5-4a12-87cc-4ce08683d055 None None] MFA Rules not processed for user `54d3642c152240ca859320100cd560bf`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:56.355249 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-b4f9d77a-35b5-4a12-87cc-4ce08683d055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:56.381362 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75561d-0f50-4a4e-84b4-300ddb020696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:56.382341 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75561d-0f50-4a4e-84b4-300ddb020696 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:56.383561 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75561d-0f50-4a4e-84b4-300ddb020696 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:56.384053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75561d-0f50-4a4e-84b4-300ddb020696 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:56.386075 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75561d-0f50-4a4e-84b4-300ddb020696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:56.390338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75561d-0f50-4a4e-84b4-300ddb020696 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:56.426322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 954/1895] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:56.431125 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75561d-0f50-4a4e-84b4-300ddb020696 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:56.454180 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75561d-0f50-4a4e-84b4-300ddb020696 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:56.486735 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c787c0-3ad9-4802-81d6-d5deb738c93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:56.487428 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c787c0-3ad9-4802-81d6-d5deb738c93d admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:56.487769 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c787c0-3ad9-4802-81d6-d5deb738c93d admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:56.487990 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c787c0-3ad9-4802-81d6-d5deb738c93d admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:56.488916 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c787c0-3ad9-4802-81d6-d5deb738c93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:56.502535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c787c0-3ad9-4802-81d6-d5deb738c93d admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:56.523696 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 942/1896] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:56 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:56.531556 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 955/1897] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:56.533212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9d77a-35b5-4a12-87cc-4ce08683d055 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:56.559610 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c787c0-3ad9-4802-81d6-d5deb738c93d admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:56.562902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-71c787c0-3ad9-4802-81d6-d5deb738c93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:56.570589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9d77a-35b5-4a12-87cc-4ce08683d055 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:56.580704 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980acfc-528a-4e77-9253-d89769fb9fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:56.588706 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980acfc-528a-4e77-9253-d89769fb9fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:56.593072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980acfc-528a-4e77-9253-d89769fb9fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:56.593072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980acfc-528a-4e77-9253-d89769fb9fa6 admin admin] PATH_INFO: `/v3/projects/11091d2130514e3896a88ac782d80118/users/409f492c71c549009361fce18656440a/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:56.631067 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980acfc-528a-4e77-9253-d89769fb9fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11091d2130514e3896a88ac782d80118, user_id=409f492c71c549009361fce18656440a, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:56.636083 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980acfc-528a-4e77-9253-d89769fb9fa6 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:56.687092 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c787c0-3ad9-4802-81d6-d5deb738c93d admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:56.691543 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93a198-4664-4d1b-ba70-113488ddebef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:56.692461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93a198-4664-4d1b-ba70-113488ddebef service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:56.696949 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93a198-4664-4d1b-ba70-113488ddebef service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:56.697278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93a198-4664-4d1b-ba70-113488ddebef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:56.716903 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93a198-4664-4d1b-ba70-113488ddebef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:56.718410 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93a198-4664-4d1b-ba70-113488ddebef service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:56.732757 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 956/1898] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:56 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:56.736955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 943/1899] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:56 2022] PUT /identity/v3/projects/11091d2130514e3896a88ac782d80118/users/409f492c71c549009361fce18656440a/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:56.749407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541492f-f928-4faa-aa85-501de3f06188 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:56.749740 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541492f-f928-4faa-aa85-501de3f06188 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:56.749878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541492f-f928-4faa-aa85-501de3f06188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:56.754304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93a198-4664-4d1b-ba70-113488ddebef service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:56.761654 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-bd93a198-4664-4d1b-ba70-113488ddebef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:56.793922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93a198-4664-4d1b-ba70-113488ddebef service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:56.802780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-b541492f-f928-4faa-aa85-501de3f06188 None None] MFA Rules not processed for user `409f492c71c549009361fce18656440a`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:56.804039 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-b541492f-f928-4faa-aa85-501de3f06188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:56.921404 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 944/1900] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:56.922908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541492f-f928-4faa-aa85-501de3f06188 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:56.953027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:56.973707 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bb7fb-cd32-491c-9ffa-1445eab83782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:56.975461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bb7fb-cd32-491c-9ffa-1445eab83782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:56.975902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bb7fb-cd32-491c-9ffa-1445eab83782 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:56.976411 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bb7fb-cd32-491c-9ffa-1445eab83782 admin admin] PATH_INFO: `/v3/projects/ea1ca779a9c44252a3ea906e41315f5f` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:56.978420 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bb7fb-cd32-491c-9ffa-1445eab83782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea1ca779a9c44252a3ea906e41315f5f)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:56.980561 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bb7fb-cd32-491c-9ffa-1445eab83782 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:57.013822 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541492f-f928-4faa-aa85-501de3f06188 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:57.018538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3dce4-cf4b-46ac-b4f9-61824e4ea805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:57.019278 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3dce4-cf4b-46ac-b4f9-61824e4ea805 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:57.022384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3dce4-cf4b-46ac-b4f9-61824e4ea805 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:57.022384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3dce4-cf4b-46ac-b4f9-61824e4ea805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:57.022384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f4f3dce4-cf4b-46ac-b4f9-61824e4ea805 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:57.042682 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:57.101570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3dce4-cf4b-46ac-b4f9-61824e4ea805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:57.103003 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3dce4-cf4b-46ac-b4f9-61824e4ea805 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:57.126840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 945/1901] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:57.128198 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3dce4-cf4b-46ac-b4f9-61824e4ea805 service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:57.135489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-239bb7fb-cd32-491c-9ffa-1445eab83782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea1ca779a9c44252a3ea906e41315f5f', 'request_id': 'req-239bb7fb-cd32-491c-9ffa-1445eab83782'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:57.146837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-239bb7fb-cd32-491c-9ffa-1445eab83782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea1ca779a9c44252a3ea906e41315f5f', 'request_id': 'req-239bb7fb-cd32-491c-9ffa-1445eab83782'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:57.166885 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3dce4-cf4b-46ac-b4f9-61824e4ea805 service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:57.255972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa2682-e000-41e6-b931-1e6b615f7b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:57.256594 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa2682-e000-41e6-b931-1e6b615f7b79 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:57.256907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa2682-e000-41e6-b931-1e6b615f7b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:57.257184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa2682-e000-41e6-b931-1e6b615f7b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:57.258526 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa2682-e000-41e6-b931-1e6b615f7b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:57.260434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa2682-e000-41e6-b931-1e6b615f7b79 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:57.316604 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-239bb7fb-cd32-491c-9ffa-1445eab83782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea1ca779a9c44252a3ea906e41315f5f', 'request_id': 'req-239bb7fb-cd32-491c-9ffa-1445eab83782'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:57.330837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-239bb7fb-cd32-491c-9ffa-1445eab83782 admin admin] The token cache is being invalidate because project ea1ca779a9c44252a3ea906e41315f5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:58:57.331220 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-239bb7fb-cd32-491c-9ffa-1445eab83782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:57.332143 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-239bb7fb-cd32-491c-9ffa-1445eab83782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:57.334163 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 957/1902] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:58:56 2022] DELETE /identity/v3/projects/ea1ca779a9c44252a3ea906e41315f5f => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:57.338749 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bb7fb-cd32-491c-9ffa-1445eab83782 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:57.343308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-239bb7fb-cd32-491c-9ffa-1445eab83782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:57.354668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bb7fb-cd32-491c-9ffa-1445eab83782 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:57.359276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3607b-5609-4384-931d-24bc9cdb48ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:57.360152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3607b-5609-4384-931d-24bc9cdb48ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:57.364949 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3607b-5609-4384-931d-24bc9cdb48ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:57.365297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3607b-5609-4384-931d-24bc9cdb48ac admin admin] PATH_INFO: `/v3/users/c721f0c809d647ffb03abc9092d19b53` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:57.366623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3607b-5609-4384-931d-24bc9cdb48ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c721f0c809d647ffb03abc9092d19b53)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:57.368817 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3607b-5609-4384-931d-24bc9cdb48ac admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:57.408677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 946/1903] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:57 2022] POST /identity/v3/projects => generated 379 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:57.413330 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa2682-e000-41e6-b931-1e6b615f7b79 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:57.415743 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-04aa2682-e000-41e6-b931-1e6b615f7b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:57.501712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa2682-e000-41e6-b931-1e6b615f7b79 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:57.508978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b86f52-37ca-4e48-bed2-3b1b2209ad33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:57.508978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b86f52-37ca-4e48-bed2-3b1b2209ad33 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:57.508978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b86f52-37ca-4e48-bed2-3b1b2209ad33 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:57.508978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b86f52-37ca-4e48-bed2-3b1b2209ad33 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:57.509513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b86f52-37ca-4e48-bed2-3b1b2209ad33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:57.511442 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b86f52-37ca-4e48-bed2-3b1b2209ad33 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:57.680411 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 947/1904] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:57 2022] POST /identity/v3/users => generated 290 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:58:57.681570 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b86f52-37ca-4e48-bed2-3b1b2209ad33 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:57.695952 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b86f52-37ca-4e48-bed2-3b1b2209ad33 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:57.704772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf55a6-d032-4246-9817-cb583d0617cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:57.704772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf55a6-d032-4246-9817-cb583d0617cf admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:57.704772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf55a6-d032-4246-9817-cb583d0617cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:57.704772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf55a6-d032-4246-9817-cb583d0617cf admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:57.705140 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf55a6-d032-4246-9817-cb583d0617cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:57.706674 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf55a6-d032-4246-9817-cb583d0617cf admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:57.719419 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 948/1905] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:57.733630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf55a6-d032-4246-9817-cb583d0617cf admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:57.758461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-35e3607b-5609-4384-931d-24bc9cdb48ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c721f0c809d647ffb03abc9092d19b53'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:57.761211 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf55a6-d032-4246-9817-cb583d0617cf admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:57.773064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b2fad-6102-4cbf-8f28-5d4a85268e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:57.773282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-35e3607b-5609-4384-931d-24bc9cdb48ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c721f0c809d647ffb03abc9092d19b53'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:57.773768 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b2fad-6102-4cbf-8f28-5d4a85268e04 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:57.774052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b2fad-6102-4cbf-8f28-5d4a85268e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:57.774792 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b2fad-6102-4cbf-8f28-5d4a85268e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:57.775089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b2fad-6102-4cbf-8f28-5d4a85268e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:57.776971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b2fad-6102-4cbf-8f28-5d4a85268e04 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:57.790028 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 949/1906] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:57.796585 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b2fad-6102-4cbf-8f28-5d4a85268e04 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:57.807631 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b2fad-6102-4cbf-8f28-5d4a85268e04 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:57.812786 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e685b-aa4b-404d-aca1-46e3efebe3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:57.813693 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e685b-aa4b-404d-aca1-46e3efebe3a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:57.813980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e685b-aa4b-404d-aca1-46e3efebe3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:57.814302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e685b-aa4b-404d-aca1-46e3efebe3a1 admin admin] PATH_INFO: `/v3/projects/50827dc60efc47d7a12ea78a80785c61/users/3fc9e72c389c4705825349ba37f9c64a/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:57.832796 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e685b-aa4b-404d-aca1-46e3efebe3a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50827dc60efc47d7a12ea78a80785c61, user_id=3fc9e72c389c4705825349ba37f9c64a, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:57.836080 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e685b-aa4b-404d-aca1-46e3efebe3a1 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:57.850680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-35e3607b-5609-4384-931d-24bc9cdb48ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c721f0c809d647ffb03abc9092d19b53'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:57.852253 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-35e3607b-5609-4384-931d-24bc9cdb48ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c721f0c809d647ffb03abc9092d19b53'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:57.853037 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-35e3607b-5609-4384-931d-24bc9cdb48ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c721f0c809d647ffb03abc9092d19b53'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:57.874924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 958/1907] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:58:57 2022] DELETE /identity/v3/users/c721f0c809d647ffb03abc9092d19b53 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:58:57.944895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 950/1908] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:57 2022] PUT /identity/v3/projects/50827dc60efc47d7a12ea78a80785c61/users/3fc9e72c389c4705825349ba37f9c64a/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:57.955853 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a520a33-4d4f-49c0-aca7-1d45fceab4de None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:57.956182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a520a33-4d4f-49c0-aca7-1d45fceab4de None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:57.956597 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a520a33-4d4f-49c0-aca7-1d45fceab4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:57.998495 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-7a520a33-4d4f-49c0-aca7-1d45fceab4de None None] MFA Rules not processed for user `3fc9e72c389c4705825349ba37f9c64a`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:58.000259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-7a520a33-4d4f-49c0-aca7-1d45fceab4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:58.081496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 959/1909] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:58.087406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e685b-aa4b-404d-aca1-46e3efebe3a1 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:58.093613 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4c2e685b-aa4b-404d-aca1-46e3efebe3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:58.228598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e685b-aa4b-404d-aca1-46e3efebe3a1 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:58.235332 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64401a-feb0-48be-9191-524948b90c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:58.236027 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64401a-feb0-48be-9191-524948b90c02 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:58.237835 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64401a-feb0-48be-9191-524948b90c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:58.238153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64401a-feb0-48be-9191-524948b90c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:58.238871 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64401a-feb0-48be-9191-524948b90c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:58.241055 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64401a-feb0-48be-9191-524948b90c02 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:58.358704 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 951/1910] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:58 2022] POST /identity/v3/projects => generated 377 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:58:58.359750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a520a33-4d4f-49c0-aca7-1d45fceab4de None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:58.373107 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a520a33-4d4f-49c0-aca7-1d45fceab4de None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:58.451587 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da682ce-6c4f-403e-8ef6-ddf1c6f9a67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:58.451587 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da682ce-6c4f-403e-8ef6-ddf1c6f9a67e admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:58.451587 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da682ce-6c4f-403e-8ef6-ddf1c6f9a67e admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:58.451587 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da682ce-6c4f-403e-8ef6-ddf1c6f9a67e admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:58.452620 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da682ce-6c4f-403e-8ef6-ddf1c6f9a67e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:58.454076 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da682ce-6c4f-403e-8ef6-ddf1c6f9a67e admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:58.475182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64401a-feb0-48be-9191-524948b90c02 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:58.476065 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-5f64401a-feb0-48be-9191-524948b90c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:58.498405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64401a-feb0-48be-9191-524948b90c02 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:58.506095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8a6f5-4ce1-476c-9a3f-d972a2a2ae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:58.506380 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8a6f5-4ce1-476c-9a3f-d972a2a2ae6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:58.506730 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8a6f5-4ce1-476c-9a3f-d972a2a2ae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:58.507024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8a6f5-4ce1-476c-9a3f-d972a2a2ae6c admin admin] PATH_INFO: `/v3/projects/6c313605cec149e1ab080116dc1e76ed` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:58.509190 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8a6f5-4ce1-476c-9a3f-d972a2a2ae6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c313605cec149e1ab080116dc1e76ed)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:58.511374 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8a6f5-4ce1-476c-9a3f-d972a2a2ae6c admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:58.563688 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 960/1911] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:58 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:58:58.567707 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da682ce-6c4f-403e-8ef6-ddf1c6f9a67e admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:58.579459 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da682ce-6c4f-403e-8ef6-ddf1c6f9a67e admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:58.585550 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa2d76-f6b0-4d07-ab8e-3f3a73482a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:58.586798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa2d76-f6b0-4d07-ab8e-3f3a73482a29 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:58.587278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa2d76-f6b0-4d07-ab8e-3f3a73482a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:58.587718 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa2d76-f6b0-4d07-ab8e-3f3a73482a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:58.588611 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa2d76-f6b0-4d07-ab8e-3f3a73482a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:58.590511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa2d76-f6b0-4d07-ab8e-3f3a73482a29 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:58.602765 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 961/1912] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:58:58.607321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa2d76-f6b0-4d07-ab8e-3f3a73482a29 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:58.619210 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa2d76-f6b0-4d07-ab8e-3f3a73482a29 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:58.624684 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28688483-2ab3-433f-abd3-5e9ee7560353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:58.625592 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28688483-2ab3-433f-abd3-5e9ee7560353 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:58.625869 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28688483-2ab3-433f-abd3-5e9ee7560353 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:58.626142 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28688483-2ab3-433f-abd3-5e9ee7560353 admin admin] PATH_INFO: `/v3/projects/0544c2c2f48145778eccd56bee5eb30f/users/0bd7d81694134fbe801f924caaf40932/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:58.643695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28688483-2ab3-433f-abd3-5e9ee7560353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0544c2c2f48145778eccd56bee5eb30f, user_id=0bd7d81694134fbe801f924caaf40932, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:58.646721 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28688483-2ab3-433f-abd3-5e9ee7560353 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:58.649048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-9ae8a6f5-4ce1-476c-9a3f-d972a2a2ae6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c313605cec149e1ab080116dc1e76ed', 'request_id': 'req-9ae8a6f5-4ce1-476c-9a3f-d972a2a2ae6c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:58.742679 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-9ae8a6f5-4ce1-476c-9a3f-d972a2a2ae6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c313605cec149e1ab080116dc1e76ed', 'request_id': 'req-9ae8a6f5-4ce1-476c-9a3f-d972a2a2ae6c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:58.744257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:58.749442 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-9ae8a6f5-4ce1-476c-9a3f-d972a2a2ae6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c313605cec149e1ab080116dc1e76ed', 'request_id': 'req-9ae8a6f5-4ce1-476c-9a3f-d972a2a2ae6c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:58.752975 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 962/1913] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:58 2022] PUT /identity/v3/projects/0544c2c2f48145778eccd56bee5eb30f/users/0bd7d81694134fbe801f924caaf40932/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:58:58.758540 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28688483-2ab3-433f-abd3-5e9ee7560353 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:58.772733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-9ae8a6f5-4ce1-476c-9a3f-d972a2a2ae6c admin admin] The token cache is being invalidate because project 6c313605cec149e1ab080116dc1e76ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:58:58.772969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-9ae8a6f5-4ce1-476c-9a3f-d972a2a2ae6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:58.773854 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-9ae8a6f5-4ce1-476c-9a3f-d972a2a2ae6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:58:58.779009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 952/1914] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:58:58 2022] DELETE /identity/v3/projects/6c313605cec149e1ab080116dc1e76ed => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:58.780738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2438b2-5b47-4731-b2b7-1834a3c9fded None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:58.781051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2438b2-5b47-4731-b2b7-1834a3c9fded None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:58.781410 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2438b2-5b47-4731-b2b7-1834a3c9fded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:58.811657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-de2438b2-5b47-4731-b2b7-1834a3c9fded None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:58.812941 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-de2438b2-5b47-4731-b2b7-1834a3c9fded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:58.829675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:58.855236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28688483-2ab3-433f-abd3-5e9ee7560353 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:58.872939 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4314c4-1ba6-4e6d-b7b9-6bc53e625a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:58.873643 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4314c4-1ba6-4e6d-b7b9-6bc53e625a6d admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:58.873938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4314c4-1ba6-4e6d-b7b9-6bc53e625a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:58.874227 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4314c4-1ba6-4e6d-b7b9-6bc53e625a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:58.876017 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4314c4-1ba6-4e6d-b7b9-6bc53e625a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:58.877551 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4314c4-1ba6-4e6d-b7b9-6bc53e625a6d admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:58.890655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 963/1915] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:58:58.900698 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4314c4-1ba6-4e6d-b7b9-6bc53e625a6d admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:58.902833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-fc4314c4-1ba6-4e6d-b7b9-6bc53e625a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:58.918215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4314c4-1ba6-4e6d-b7b9-6bc53e625a6d admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:58.918464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 953/1916] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:58.927655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed669a48-2a3f-4478-b321-56fb6693acd4 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:58.927973 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed669a48-2a3f-4478-b321-56fb6693acd4 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:58.928339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed669a48-2a3f-4478-b321-56fb6693acd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:58.935843 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefb477-c04f-47c6-8a82-3f2cb7e10b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:58.936844 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefb477-c04f-47c6-8a82-3f2cb7e10b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:58.937137 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefb477-c04f-47c6-8a82-3f2cb7e10b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:58.937449 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefb477-c04f-47c6-8a82-3f2cb7e10b17 admin admin] PATH_INFO: `/v3/projects/0544c2c2f48145778eccd56bee5eb30f/users/0bd7d81694134fbe801f924caaf40932/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:58.943423 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefb477-c04f-47c6-8a82-3f2cb7e10b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0544c2c2f48145778eccd56bee5eb30f, user_id=0bd7d81694134fbe801f924caaf40932, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:58.948791 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefb477-c04f-47c6-8a82-3f2cb7e10b17 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:58.957007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-ed669a48-2a3f-4478-b321-56fb6693acd4 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:58.958282 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ed669a48-2a3f-4478-b321-56fb6693acd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:58.964817 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 964/1917] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:58 2022] PUT /identity/v3/projects/0544c2c2f48145778eccd56bee5eb30f/users/0bd7d81694134fbe801f924caaf40932/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:58:58.974455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fc6bf-03ad-43db-ae31-033a6206d46d None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:58.974768 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fc6bf-03ad-43db-ae31-033a6206d46d None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:58.975321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fc6bf-03ad-43db-ae31-033a6206d46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:59.008012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-ab6fc6bf-03ad-43db-ae31-033a6206d46d None None] MFA Rules not processed for user `0bd7d81694134fbe801f924caaf40932`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:59.009547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ab6fc6bf-03ad-43db-ae31-033a6206d46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:59.046777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 954/1918] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:58:59.050579 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed669a48-2a3f-4478-b321-56fb6693acd4 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:59.062435 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed669a48-2a3f-4478-b321-56fb6693acd4 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:59.073227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffec759-2b78-4a5b-92cd-8db803732bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:59.073227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffec759-2b78-4a5b-92cd-8db803732bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:59.073227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffec759-2b78-4a5b-92cd-8db803732bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:59.073227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffec759-2b78-4a5b-92cd-8db803732bb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:59.073895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffec759-2b78-4a5b-92cd-8db803732bb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:58:59.073895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffec759-2b78-4a5b-92cd-8db803732bb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:59.075214 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffec759-2b78-4a5b-92cd-8db803732bb2 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:59.092825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 955/1919] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:58:59.094934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffec759-2b78-4a5b-92cd-8db803732bb2 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:59.116181 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 965/1920] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:58:59.116289 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffec759-2b78-4a5b-92cd-8db803732bb2 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:59.116289 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b501bb6-50ab-4a4b-a45e-c4c3c0ba7158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:59.116289 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b501bb6-50ab-4a4b-a45e-c4c3c0ba7158 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:59.116289 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b501bb6-50ab-4a4b-a45e-c4c3c0ba7158 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:59.117358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b501bb6-50ab-4a4b-a45e-c4c3c0ba7158 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:59.117358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b501bb6-50ab-4a4b-a45e-c4c3c0ba7158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:59.118368 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b501bb6-50ab-4a4b-a45e-c4c3c0ba7158 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:59.125247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fc6bf-03ad-43db-ae31-033a6206d46d None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:59.126723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ab6fc6bf-03ad-43db-ae31-033a6206d46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:59.191923 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fc6bf-03ad-43db-ae31-033a6206d46d None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:59.197039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b918b-f796-4801-9520-89aa70b5a542 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:59.198117 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b918b-f796-4801-9520-89aa70b5a542 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:59.198298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b918b-f796-4801-9520-89aa70b5a542 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:59.198545 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b918b-f796-4801-9520-89aa70b5a542 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:59.208888 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b918b-f796-4801-9520-89aa70b5a542 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:59.210382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b918b-f796-4801-9520-89aa70b5a542 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:59.221029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 966/1921] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:58:59.246890 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 956/1922] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:59 2022] POST /identity/v3/projects => generated 401 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:58:59.247003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b918b-f796-4801-9520-89aa70b5a542 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:59.261100 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b918b-f796-4801-9520-89aa70b5a542 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:59.362465 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d615fa-8e25-43d6-bbf0-96dabc95f5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:59.363785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d615fa-8e25-43d6-bbf0-96dabc95f5bc admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:59.363785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d615fa-8e25-43d6-bbf0-96dabc95f5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:59.363785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d615fa-8e25-43d6-bbf0-96dabc95f5bc admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:59.364055 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d615fa-8e25-43d6-bbf0-96dabc95f5bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:59.366127 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d615fa-8e25-43d6-bbf0-96dabc95f5bc admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:59.453942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 967/1923] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:58:59 2022] POST /identity/v3/users => generated 301 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:58:59.458097 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b501bb6-50ab-4a4b-a45e-c4c3c0ba7158 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:59.475319 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b501bb6-50ab-4a4b-a45e-c4c3c0ba7158 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:59.489426 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdf114-e935-407d-9729-e0af429be46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:59.490115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdf114-e935-407d-9729-e0af429be46d admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:59.490556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdf114-e935-407d-9729-e0af429be46d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:59.490740 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdf114-e935-407d-9729-e0af429be46d admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:59.494593 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdf114-e935-407d-9729-e0af429be46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:59.497648 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdf114-e935-407d-9729-e0af429be46d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:59.516450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 957/1924] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:58:59.521911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d615fa-8e25-43d6-bbf0-96dabc95f5bc admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:59.534027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d615fa-8e25-43d6-bbf0-96dabc95f5bc admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:59.541477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccaa606-8eef-493d-8d55-38f48a2ff730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:59.542346 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccaa606-8eef-493d-8d55-38f48a2ff730 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:59.542733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccaa606-8eef-493d-8d55-38f48a2ff730 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:59.543120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccaa606-8eef-493d-8d55-38f48a2ff730 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:59.544121 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccaa606-8eef-493d-8d55-38f48a2ff730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:59.545902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccaa606-8eef-493d-8d55-38f48a2ff730 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:59.562199 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 968/1925] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:58:59.563853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdf114-e935-407d-9729-e0af429be46d admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:59.576346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdf114-e935-407d-9729-e0af429be46d admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:59.583549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db8deb-e91a-414b-bc8a-17fd862bdf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:59.584707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db8deb-e91a-414b-bc8a-17fd862bdf88 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:59.585065 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db8deb-e91a-414b-bc8a-17fd862bdf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:59.585385 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db8deb-e91a-414b-bc8a-17fd862bdf88 admin admin] PATH_INFO: `/v3/projects/907e8f87ae434522938b977b72237059/users/da6f8a86ddbb4731902452bd35a61ddb/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:59.618326 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db8deb-e91a-414b-bc8a-17fd862bdf88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=907e8f87ae434522938b977b72237059, user_id=da6f8a86ddbb4731902452bd35a61ddb, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:59.623697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db8deb-e91a-414b-bc8a-17fd862bdf88 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:59.755054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 958/1926] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:58:59 2022] PUT /identity/v3/projects/907e8f87ae434522938b977b72237059/users/da6f8a86ddbb4731902452bd35a61ddb/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:58:59.768655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccaa606-8eef-493d-8d55-38f48a2ff730 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:59.778567 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522c91a-7b44-4179-ae59-2a3c41132376 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:59.778892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522c91a-7b44-4179-ae59-2a3c41132376 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:59.779147 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522c91a-7b44-4179-ae59-2a3c41132376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:59.807914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-c522c91a-7b44-4179-ae59-2a3c41132376 None None] MFA Rules not processed for user `da6f8a86ddbb4731902452bd35a61ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:59.809406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c522c91a-7b44-4179-ae59-2a3c41132376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:59.852174 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccaa606-8eef-493d-8d55-38f48a2ff730 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:59.879715 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 959/1927] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:58:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:59.884713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522c91a-7b44-4179-ae59-2a3c41132376 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:59.904971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fe871-6096-41e2-8882-df6079a0f1e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:59.905638 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fe871-6096-41e2-8882-df6079a0f1e9 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:59.905928 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fe871-6096-41e2-8882-df6079a0f1e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:59.906242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fe871-6096-41e2-8882-df6079a0f1e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:59.908063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-f07fe871-6096-41e2-8882-df6079a0f1e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:59.956483 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522c91a-7b44-4179-ae59-2a3c41132376 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:59.963063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8bcc5-47c6-4fa0-9506-8cba3b5fe9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:59.963741 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8bcc5-47c6-4fa0-9506-8cba3b5fe9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:59.964029 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8bcc5-47c6-4fa0-9506-8cba3b5fe9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:59.964304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8bcc5-47c6-4fa0-9506-8cba3b5fe9a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:59.966505 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8bcc5-47c6-4fa0-9506-8cba3b5fe9a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:59.966947 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8bcc5-47c6-4fa0-9506-8cba3b5fe9a0 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:59.975155 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fe871-6096-41e2-8882-df6079a0f1e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:59.977645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fe871-6096-41e2-8882-df6079a0f1e9 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:59.989303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 969/1928] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:00.087912 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 960/1929] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:58:59 2022] POST /identity/v3/projects => generated 401 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:59:00.091971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fe871-6096-41e2-8882-df6079a0f1e9 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:00.107048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fe871-6096-41e2-8882-df6079a0f1e9 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:00.215282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ecb86-6852-4fea-a325-c1fe607714c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:00.216009 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ecb86-6852-4fea-a325-c1fe607714c0 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:00.216295 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ecb86-6852-4fea-a325-c1fe607714c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:00.216796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ecb86-6852-4fea-a325-c1fe607714c0 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:00.217482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ecb86-6852-4fea-a325-c1fe607714c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:00.219412 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ecb86-6852-4fea-a325-c1fe607714c0 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:00.332102 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 970/1930] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:00 2022] POST /identity/v3/users => generated 307 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:59:00.333649 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8bcc5-47c6-4fa0-9506-8cba3b5fe9a0 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:00.348402 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8bcc5-47c6-4fa0-9506-8cba3b5fe9a0 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:00.355422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bf8fd-6afe-4579-b1d0-3edf63075d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:00.356168 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bf8fd-6afe-4579-b1d0-3edf63075d54 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:00.356467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bf8fd-6afe-4579-b1d0-3edf63075d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:00.362280 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bf8fd-6afe-4579-b1d0-3edf63075d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:00.362280 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bf8fd-6afe-4579-b1d0-3edf63075d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:00.362280 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bf8fd-6afe-4579-b1d0-3edf63075d54 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:00.372708 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 961/1931] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:00.377123 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ecb86-6852-4fea-a325-c1fe607714c0 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:00.391546 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ecb86-6852-4fea-a325-c1fe607714c0 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:00.396823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fba35b-a11c-4bb3-965b-568ebdf8ff27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:00.397763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fba35b-a11c-4bb3-965b-568ebdf8ff27 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:00.398655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fba35b-a11c-4bb3-965b-568ebdf8ff27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:00.398938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fba35b-a11c-4bb3-965b-568ebdf8ff27 admin admin] PATH_INFO: `/v3/projects/c4725469f9c04f3a9036a4975b6b311f/users/aa7c43f128cd481fb1b7e4136e2a6fa0/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:00.422811 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fba35b-a11c-4bb3-965b-568ebdf8ff27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4725469f9c04f3a9036a4975b6b311f, user_id=aa7c43f128cd481fb1b7e4136e2a6fa0, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:00.427068 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fba35b-a11c-4bb3-965b-568ebdf8ff27 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:00.543628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 971/1932] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:00 2022] PUT /identity/v3/projects/c4725469f9c04f3a9036a4975b6b311f/users/aa7c43f128cd481fb1b7e4136e2a6fa0/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:00.545044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bf8fd-6afe-4579-b1d0-3edf63075d54 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:00.559350 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bf8fd-6afe-4579-b1d0-3edf63075d54 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:00.641002 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e43668-8449-47da-97f8-7048f5f30d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:00.642357 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e43668-8449-47da-97f8-7048f5f30d9f admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:00.643098 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e43668-8449-47da-97f8-7048f5f30d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:00.643429 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e43668-8449-47da-97f8-7048f5f30d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:00.644710 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e43668-8449-47da-97f8-7048f5f30d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:00.647618 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e43668-8449-47da-97f8-7048f5f30d9f admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:00.664320 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 962/1933] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:00.668548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fba35b-a11c-4bb3-965b-568ebdf8ff27 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:00.685084 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fba35b-a11c-4bb3-965b-568ebdf8ff27 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:00.691590 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87983da-48b8-4778-b512-4c969ed6275c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:00.692505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87983da-48b8-4778-b512-4c969ed6275c admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:00.692817 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87983da-48b8-4778-b512-4c969ed6275c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:00.693095 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87983da-48b8-4778-b512-4c969ed6275c admin admin] PATH_INFO: `/v3/projects/c4725469f9c04f3a9036a4975b6b311f/users/aa7c43f128cd481fb1b7e4136e2a6fa0/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:00.695879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87983da-48b8-4778-b512-4c969ed6275c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4725469f9c04f3a9036a4975b6b311f, user_id=aa7c43f128cd481fb1b7e4136e2a6fa0, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:00.700586 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87983da-48b8-4778-b512-4c969ed6275c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:00.717894 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 972/1934] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:00 2022] PUT /identity/v3/projects/c4725469f9c04f3a9036a4975b6b311f/users/aa7c43f128cd481fb1b7e4136e2a6fa0/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:00.729046 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60180c-4d20-4c80-b947-ad332eaf82f2 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:00.730421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60180c-4d20-4c80-b947-ad332eaf82f2 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:00.730421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60180c-4d20-4c80-b947-ad332eaf82f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:00.760845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-5e60180c-4d20-4c80-b947-ad332eaf82f2 None None] MFA Rules not processed for user `aa7c43f128cd481fb1b7e4136e2a6fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:00.763882 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-5e60180c-4d20-4c80-b947-ad332eaf82f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:00.765449 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:00.867958 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 963/1935] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:00 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:01.003344 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87983da-48b8-4778-b512-4c969ed6275c admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:01.005851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c87983da-48b8-4778-b512-4c969ed6275c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:01.094717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87983da-48b8-4778-b512-4c969ed6275c admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:01.153482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd2634-b04a-4e59-8be6-320c187fa0e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:01.153482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd2634-b04a-4e59-8be6-320c187fa0e3 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:01.153482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd2634-b04a-4e59-8be6-320c187fa0e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:01.153482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd2634-b04a-4e59-8be6-320c187fa0e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:01.154185 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd2634-b04a-4e59-8be6-320c187fa0e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:01.154185 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd2634-b04a-4e59-8be6-320c187fa0e3 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:01.154185 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 973/1936] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:01 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:01.534155 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:01.732925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60180c-4d20-4c80-b947-ad332eaf82f2 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:01.753127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60180c-4d20-4c80-b947-ad332eaf82f2 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:01.753127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c1d16-2361-4aa0-be12-fa74fec840a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:01.753700 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c1d16-2361-4aa0-be12-fa74fec840a0 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:01.753989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c1d16-2361-4aa0-be12-fa74fec840a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:01.754330 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c1d16-2361-4aa0-be12-fa74fec840a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:01.838983 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c1d16-2361-4aa0-be12-fa74fec840a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:01.840615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c1d16-2361-4aa0-be12-fa74fec840a0 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:01.850246 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 964/1937] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:01 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:02.467765 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:04.015339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd2634-b04a-4e59-8be6-320c187fa0e3 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:04.017048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6dbd2634-b04a-4e59-8be6-320c187fa0e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:04.154221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd2634-b04a-4e59-8be6-320c187fa0e3 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:04.165511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb4ad3-049f-4e76-8f8a-05b1d2b07938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:04.166482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb4ad3-049f-4e76-8f8a-05b1d2b07938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:04.166825 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb4ad3-049f-4e76-8f8a-05b1d2b07938 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:04.167152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb4ad3-049f-4e76-8f8a-05b1d2b07938 admin admin] PATH_INFO: `/v3/users/3ba8c78f906d413e84024d3c457ec56e` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:04.168903 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb4ad3-049f-4e76-8f8a-05b1d2b07938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba8c78f906d413e84024d3c457ec56e)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:04.173044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb4ad3-049f-4e76-8f8a-05b1d2b07938 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:04.311280 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:04.389078 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:04.407725 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-daeb4ad3-049f-4e76-8f8a-05b1d2b07938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba8c78f906d413e84024d3c457ec56e'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:04.415955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-daeb4ad3-049f-4e76-8f8a-05b1d2b07938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba8c78f906d413e84024d3c457ec56e'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:04.521645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-daeb4ad3-049f-4e76-8f8a-05b1d2b07938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba8c78f906d413e84024d3c457ec56e'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:04.523185 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-daeb4ad3-049f-4e76-8f8a-05b1d2b07938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba8c78f906d413e84024d3c457ec56e'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:04.524876 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-daeb4ad3-049f-4e76-8f8a-05b1d2b07938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba8c78f906d413e84024d3c457ec56e'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:04.564074 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 974/1938] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:04 2022] DELETE /identity/v3/users/3ba8c78f906d413e84024d3c457ec56e => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:04.569162 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63e15-64e5-4427-9566-d06c93c14b7a None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:04.569455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63e15-64e5-4427-9566-d06c93c14b7a None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:04.569800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63e15-64e5-4427-9566-d06c93c14b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:04.588581 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-16f63e15-64e5-4427-9566-d06c93c14b7a None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:04.589938 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-16f63e15-64e5-4427-9566-d06c93c14b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:04.672908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 965/1939] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:04.683478 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb4ad3-049f-4e76-8f8a-05b1d2b07938 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:04.690592 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-daeb4ad3-049f-4e76-8f8a-05b1d2b07938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:04.751078 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb4ad3-049f-4e76-8f8a-05b1d2b07938 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:04.755336 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62e315-ed93-496d-ad31-92f0f4e3485b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:04.756964 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62e315-ed93-496d-ad31-92f0f4e3485b service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:04.756964 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62e315-ed93-496d-ad31-92f0f4e3485b service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:04.758036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62e315-ed93-496d-ad31-92f0f4e3485b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:04.769985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62e315-ed93-496d-ad31-92f0f4e3485b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:04.771567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62e315-ed93-496d-ad31-92f0f4e3485b service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:04.785869 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 975/1940] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:05.326566 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f63e15-64e5-4427-9566-d06c93c14b7a None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:05.328384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-16f63e15-64e5-4427-9566-d06c93c14b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:05.342420 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:05.356285 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62e315-ed93-496d-ad31-92f0f4e3485b service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:05.358714 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6c62e315-ed93-496d-ad31-92f0f4e3485b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:05.399671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62e315-ed93-496d-ad31-92f0f4e3485b service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:05.419211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981c50e-878c-44f5-b591-8814155e6dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:05.420169 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981c50e-878c-44f5-b591-8814155e6dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:05.420973 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981c50e-878c-44f5-b591-8814155e6dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:05.421673 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981c50e-878c-44f5-b591-8814155e6dd4 admin admin] PATH_INFO: `/v3/projects/f5cb9954d887472fb6e7d6ac23801cb5` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:05.423730 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981c50e-878c-44f5-b591-8814155e6dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5cb9954d887472fb6e7d6ac23801cb5)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:05.424184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f63e15-64e5-4427-9566-d06c93c14b7a None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:05.428109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981c50e-878c-44f5-b591-8814155e6dd4 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:05.440887 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6333539-644e-464a-9abb-6d53be67eb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:05.441793 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6333539-644e-464a-9abb-6d53be67eb17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:05.442079 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6333539-644e-464a-9abb-6d53be67eb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:05.442355 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6333539-644e-464a-9abb-6d53be67eb17 admin admin] PATH_INFO: `/v3/users/3bb21563113748179de69cafcea3d0cc` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:05.444831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6333539-644e-464a-9abb-6d53be67eb17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bb21563113748179de69cafcea3d0cc)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:05.453964 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6333539-644e-464a-9abb-6d53be67eb17 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:05.549303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-5981c50e-878c-44f5-b591-8814155e6dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5cb9954d887472fb6e7d6ac23801cb5', 'request_id': 'req-5981c50e-878c-44f5-b591-8814155e6dd4'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:05.557140 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-5981c50e-878c-44f5-b591-8814155e6dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5cb9954d887472fb6e7d6ac23801cb5', 'request_id': 'req-5981c50e-878c-44f5-b591-8814155e6dd4'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:05.657279 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-5981c50e-878c-44f5-b591-8814155e6dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5cb9954d887472fb6e7d6ac23801cb5', 'request_id': 'req-5981c50e-878c-44f5-b591-8814155e6dd4'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:05.673101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f6333539-644e-464a-9abb-6d53be67eb17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bb21563113748179de69cafcea3d0cc'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:05.673827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-5981c50e-878c-44f5-b591-8814155e6dd4 admin admin] The token cache is being invalidate because project f5cb9954d887472fb6e7d6ac23801cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:05.674119 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-5981c50e-878c-44f5-b591-8814155e6dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:05.674954 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-5981c50e-878c-44f5-b591-8814155e6dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:05.676882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 976/1941] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:05 2022] DELETE /identity/v3/projects/f5cb9954d887472fb6e7d6ac23801cb5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:05.677893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981c50e-878c-44f5-b591-8814155e6dd4 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:05.679738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-5981c50e-878c-44f5-b591-8814155e6dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:05.685245 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f6333539-644e-464a-9abb-6d53be67eb17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bb21563113748179de69cafcea3d0cc'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:05.687051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f6333539-644e-464a-9abb-6d53be67eb17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bb21563113748179de69cafcea3d0cc'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:05.751750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981c50e-878c-44f5-b591-8814155e6dd4 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:05.753539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f6333539-644e-464a-9abb-6d53be67eb17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bb21563113748179de69cafcea3d0cc'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:05.754487 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f6333539-644e-464a-9abb-6d53be67eb17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bb21563113748179de69cafcea3d0cc'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:05.757013 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15719656-a5c5-4f15-975e-35e811598061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:05.760216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15719656-a5c5-4f15-975e-35e811598061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:05.760216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15719656-a5c5-4f15-975e-35e811598061 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:05.760216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15719656-a5c5-4f15-975e-35e811598061 admin admin] PATH_INFO: `/v3/users/409f492c71c549009361fce18656440a` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:05.760599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15719656-a5c5-4f15-975e-35e811598061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=409f492c71c549009361fce18656440a)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:05.762597 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15719656-a5c5-4f15-975e-35e811598061 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:05.777399 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 966/1942] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:05 2022] DELETE /identity/v3/users/3bb21563113748179de69cafcea3d0cc => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:05.778693 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6333539-644e-464a-9abb-6d53be67eb17 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:05.781765 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f6333539-644e-464a-9abb-6d53be67eb17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:05.859818 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6333539-644e-464a-9abb-6d53be67eb17 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:05.865911 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d73d2-4c41-4b5a-832e-90885fad16e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:05.866907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d73d2-4c41-4b5a-832e-90885fad16e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:05.867553 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d73d2-4c41-4b5a-832e-90885fad16e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:05.868081 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d73d2-4c41-4b5a-832e-90885fad16e6 admin admin] PATH_INFO: `/v3/users/54d3642c152240ca859320100cd560bf` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:05.869563 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d73d2-4c41-4b5a-832e-90885fad16e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54d3642c152240ca859320100cd560bf)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:05.871733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d73d2-4c41-4b5a-832e-90885fad16e6 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:06.010102 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-15719656-a5c5-4f15-975e-35e811598061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '409f492c71c549009361fce18656440a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:06.010102 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-15719656-a5c5-4f15-975e-35e811598061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '409f492c71c549009361fce18656440a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:06.094200 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7f6d73d2-4c41-4b5a-832e-90885fad16e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54d3642c152240ca859320100cd560bf'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:06.102541 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-15719656-a5c5-4f15-975e-35e811598061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '409f492c71c549009361fce18656440a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:06.102790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7f6d73d2-4c41-4b5a-832e-90885fad16e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54d3642c152240ca859320100cd560bf'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:06.103337 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7f6d73d2-4c41-4b5a-832e-90885fad16e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54d3642c152240ca859320100cd560bf'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:06.103662 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-15719656-a5c5-4f15-975e-35e811598061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '409f492c71c549009361fce18656440a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:06.104882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-15719656-a5c5-4f15-975e-35e811598061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '409f492c71c549009361fce18656440a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:06.129320 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 977/1943] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:05 2022] DELETE /identity/v3/users/409f492c71c549009361fce18656440a => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:06.131057 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d533bac-f3c7-401a-984c-87f7a15d93b1 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:06.131552 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d533bac-f3c7-401a-984c-87f7a15d93b1 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:06.131897 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d533bac-f3c7-401a-984c-87f7a15d93b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:06.152585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-3d533bac-f3c7-401a-984c-87f7a15d93b1 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:06.154010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-3d533bac-f3c7-401a-984c-87f7a15d93b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:06.201635 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7f6d73d2-4c41-4b5a-832e-90885fad16e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54d3642c152240ca859320100cd560bf'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:06.202589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7f6d73d2-4c41-4b5a-832e-90885fad16e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54d3642c152240ca859320100cd560bf'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:06.221203 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 978/1944] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:06.228264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 967/1945] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:05 2022] DELETE /identity/v3/users/54d3642c152240ca859320100cd560bf => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:06.228437 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edf16b-ea87-4ade-ba3b-61c53d751542 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:06.228437 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edf16b-ea87-4ade-ba3b-61c53d751542 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:06.228437 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edf16b-ea87-4ade-ba3b-61c53d751542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:06.244956 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d73d2-4c41-4b5a-832e-90885fad16e6 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:06.252496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-7f6d73d2-4c41-4b5a-832e-90885fad16e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:06.265738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-81edf16b-ea87-4ade-ba3b-61c53d751542 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:06.267510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-81edf16b-ea87-4ade-ba3b-61c53d751542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:06.397234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d73d2-4c41-4b5a-832e-90885fad16e6 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:06.411316 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60735cdd-3c88-4846-8ac0-26fabcfae539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:06.415869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60735cdd-3c88-4846-8ac0-26fabcfae539 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:06.415869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60735cdd-3c88-4846-8ac0-26fabcfae539 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:06.415869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60735cdd-3c88-4846-8ac0-26fabcfae539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:06.417962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 979/1946] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:06.432131 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edf16b-ea87-4ade-ba3b-61c53d751542 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:06.432538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:06.438228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-81edf16b-ea87-4ade-ba3b-61c53d751542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:06.438437 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60735cdd-3c88-4846-8ac0-26fabcfae539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:06.440342 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60735cdd-3c88-4846-8ac0-26fabcfae539 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:06.455764 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 968/1947] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:06.466787 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edf16b-ea87-4ade-ba3b-61c53d751542 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:06.470978 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4afdc-5240-4a31-8ade-7f2039cd922d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:06.471949 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4afdc-5240-4a31-8ade-7f2039cd922d service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:06.473158 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4afdc-5240-4a31-8ade-7f2039cd922d service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:06.473716 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4afdc-5240-4a31-8ade-7f2039cd922d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:06.487887 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4afdc-5240-4a31-8ade-7f2039cd922d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:06.489708 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4afdc-5240-4a31-8ade-7f2039cd922d service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:06.502557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 980/1948] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:07.048697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:07.267949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60735cdd-3c88-4846-8ac0-26fabcfae539 service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:07.270331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-60735cdd-3c88-4846-8ac0-26fabcfae539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:07.294633 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60735cdd-3c88-4846-8ac0-26fabcfae539 service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:07.306405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5d143-6fa2-48b3-bc12-2387849c5c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:07.308174 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5d143-6fa2-48b3-bc12-2387849c5c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:07.308466 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5d143-6fa2-48b3-bc12-2387849c5c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:07.308813 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5d143-6fa2-48b3-bc12-2387849c5c27 admin admin] PATH_INFO: `/v3/projects/a982d9f40d94449f933fa427d426cb60` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:07.311000 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5d143-6fa2-48b3-bc12-2387849c5c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a982d9f40d94449f933fa427d426cb60)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:07.312583 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5d143-6fa2-48b3-bc12-2387849c5c27 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:07.418521 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4afdc-5240-4a31-8ade-7f2039cd922d service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:07.421431 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ccc4afdc-5240-4a31-8ade-7f2039cd922d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:07.441204 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4afdc-5240-4a31-8ade-7f2039cd922d service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:07.451482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b9365-dd6e-4184-9b07-4bedad043d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:07.451482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b9365-dd6e-4184-9b07-4bedad043d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:07.451482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b9365-dd6e-4184-9b07-4bedad043d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:07.451482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b9365-dd6e-4184-9b07-4bedad043d4a admin admin] PATH_INFO: `/v3/projects/26b13050e8af4f81b490902d4473289e` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:07.452312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b9365-dd6e-4184-9b07-4bedad043d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b13050e8af4f81b490902d4473289e)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:07.454828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b9365-dd6e-4184-9b07-4bedad043d4a admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:07.507685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-dbc5d143-6fa2-48b3-bc12-2387849c5c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a982d9f40d94449f933fa427d426cb60', 'request_id': 'req-dbc5d143-6fa2-48b3-bc12-2387849c5c27'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:07.587567 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-dbc5d143-6fa2-48b3-bc12-2387849c5c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a982d9f40d94449f933fa427d426cb60', 'request_id': 'req-dbc5d143-6fa2-48b3-bc12-2387849c5c27'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:07.604530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-dbc5d143-6fa2-48b3-bc12-2387849c5c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a982d9f40d94449f933fa427d426cb60', 'request_id': 'req-dbc5d143-6fa2-48b3-bc12-2387849c5c27'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:07.621464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-dbc5d143-6fa2-48b3-bc12-2387849c5c27 admin admin] The token cache is being invalidate because project a982d9f40d94449f933fa427d426cb60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:07.622063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-dbc5d143-6fa2-48b3-bc12-2387849c5c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:07.623069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-dbc5d143-6fa2-48b3-bc12-2387849c5c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:07.627534 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 969/1949] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:07 2022] DELETE /identity/v3/projects/a982d9f40d94449f933fa427d426cb60 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:59:07.629728 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c55b9365-dd6e-4184-9b07-4bedad043d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b13050e8af4f81b490902d4473289e', 'request_id': 'req-c55b9365-dd6e-4184-9b07-4bedad043d4a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:07.633598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fe34e-19a3-4932-8e77-a27ca6cebbb9 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:07.633895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fe34e-19a3-4932-8e77-a27ca6cebbb9 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:07.634178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fe34e-19a3-4932-8e77-a27ca6cebbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:07.637878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c55b9365-dd6e-4184-9b07-4bedad043d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b13050e8af4f81b490902d4473289e', 'request_id': 'req-c55b9365-dd6e-4184-9b07-4bedad043d4a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:07.664166 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-117fe34e-19a3-4932-8e77-a27ca6cebbb9 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:07.665559 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-117fe34e-19a3-4932-8e77-a27ca6cebbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:07.733525 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c55b9365-dd6e-4184-9b07-4bedad043d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b13050e8af4f81b490902d4473289e', 'request_id': 'req-c55b9365-dd6e-4184-9b07-4bedad043d4a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:07.750104 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c55b9365-dd6e-4184-9b07-4bedad043d4a admin admin] The token cache is being invalidate because project 26b13050e8af4f81b490902d4473289e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:07.750395 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c55b9365-dd6e-4184-9b07-4bedad043d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:07.753907 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c55b9365-dd6e-4184-9b07-4bedad043d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:07.760949 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 981/1950] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:07 2022] DELETE /identity/v3/projects/26b13050e8af4f81b490902d4473289e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:59:07.766026 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b9365-dd6e-4184-9b07-4bedad043d4a admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:07.768828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:07.770053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c55b9365-dd6e-4184-9b07-4bedad043d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:07.821668 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 970/1951] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:59:07.823874 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb3aff-fd9c-4c3a-8362-d4e6583800ec None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:07.824172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb3aff-fd9c-4c3a-8362-d4e6583800ec None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:07.824458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb3aff-fd9c-4c3a-8362-d4e6583800ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:07.848470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-28fb3aff-fd9c-4c3a-8362-d4e6583800ec None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:07.850141 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-28fb3aff-fd9c-4c3a-8362-d4e6583800ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:07.861894 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b9365-dd6e-4184-9b07-4bedad043d4a admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:07.868772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 971/1952] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:07.869775 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb3aff-fd9c-4c3a-8362-d4e6583800ec None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:07.881780 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb76782-da13-4c4d-ab05-dc04acd6134c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:07.883301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb76782-da13-4c4d-ab05-dc04acd6134c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:07.883589 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb76782-da13-4c4d-ab05-dc04acd6134c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:07.883866 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb76782-da13-4c4d-ab05-dc04acd6134c admin admin] PATH_INFO: `/v3/users/f2bf2ddadce64bf8bc0d90b509b809b8` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:07.892446 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb76782-da13-4c4d-ab05-dc04acd6134c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2bf2ddadce64bf8bc0d90b509b809b8)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:07.894513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb76782-da13-4c4d-ab05-dc04acd6134c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:07.895861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb3aff-fd9c-4c3a-8362-d4e6583800ec None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:07.908873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17951c8-76a9-46a3-b270-b7a57295b2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:07.919680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17951c8-76a9-46a3-b270-b7a57295b2fb admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:07.919680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17951c8-76a9-46a3-b270-b7a57295b2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:07.919680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17951c8-76a9-46a3-b270-b7a57295b2fb admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:07.919680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17951c8-76a9-46a3-b270-b7a57295b2fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:59:07.919680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17951c8-76a9-46a3-b270-b7a57295b2fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:07.933177 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17951c8-76a9-46a3-b270-b7a57295b2fb admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:07.973300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 972/1953] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:59:07.982353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17951c8-76a9-46a3-b270-b7a57295b2fb admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:08.014180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17951c8-76a9-46a3-b270-b7a57295b2fb admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:08.030917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a46960-33cf-46bc-8bd6-a95a91b3ecae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:08.032190 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a46960-33cf-46bc-8bd6-a95a91b3ecae admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:08.034233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a46960-33cf-46bc-8bd6-a95a91b3ecae admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:08.034841 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a46960-33cf-46bc-8bd6-a95a91b3ecae admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:08.035866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a46960-33cf-46bc-8bd6-a95a91b3ecae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:08.038395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a46960-33cf-46bc-8bd6-a95a91b3ecae admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:08.139766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 973/1954] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:59:07 2022] POST /identity/v3/projects => generated 407 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:08.141053 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a46960-33cf-46bc-8bd6-a95a91b3ecae admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:08.150819 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-67a46960-33cf-46bc-8bd6-a95a91b3ecae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:08.154679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-dbb76782-da13-4c4d-ab05-dc04acd6134c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2bf2ddadce64bf8bc0d90b509b809b8'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:08.171705 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-dbb76782-da13-4c4d-ab05-dc04acd6134c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2bf2ddadce64bf8bc0d90b509b809b8'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:08.247370 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a46960-33cf-46bc-8bd6-a95a91b3ecae admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:08.256286 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5789d37-b10c-4635-ae4a-3dd71196e577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:08.259059 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5789d37-b10c-4635-ae4a-3dd71196e577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:08.259523 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5789d37-b10c-4635-ae4a-3dd71196e577 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:08.259943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5789d37-b10c-4635-ae4a-3dd71196e577 admin admin] PATH_INFO: `/v3/users/da6f8a86ddbb4731902452bd35a61ddb` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:08.262532 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5789d37-b10c-4635-ae4a-3dd71196e577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da6f8a86ddbb4731902452bd35a61ddb)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:08.266816 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5789d37-b10c-4635-ae4a-3dd71196e577 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:08.293728 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-dbb76782-da13-4c4d-ab05-dc04acd6134c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2bf2ddadce64bf8bc0d90b509b809b8'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:08.294535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-dbb76782-da13-4c4d-ab05-dc04acd6134c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2bf2ddadce64bf8bc0d90b509b809b8'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:08.295839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-dbb76782-da13-4c4d-ab05-dc04acd6134c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2bf2ddadce64bf8bc0d90b509b809b8'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:08.318452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 982/1955] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:07 2022] DELETE /identity/v3/users/f2bf2ddadce64bf8bc0d90b509b809b8 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:59:08.319201 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb76782-da13-4c4d-ab05-dc04acd6134c admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:08.320964 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-dbb76782-da13-4c4d-ab05-dc04acd6134c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:08.428384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb76782-da13-4c4d-ab05-dc04acd6134c admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:08.435997 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148bc6e-ab82-45dd-b017-597423e9afe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:08.436991 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148bc6e-ab82-45dd-b017-597423e9afe8 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:08.437522 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148bc6e-ab82-45dd-b017-597423e9afe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:08.437965 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148bc6e-ab82-45dd-b017-597423e9afe8 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:08.438881 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148bc6e-ab82-45dd-b017-597423e9afe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:08.441254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148bc6e-ab82-45dd-b017-597423e9afe8 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:08.510450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c5789d37-b10c-4635-ae4a-3dd71196e577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da6f8a86ddbb4731902452bd35a61ddb'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:08.523269 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 983/1956] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:08 2022] POST /identity/v3/users => generated 304 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:08.523726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148bc6e-ab82-45dd-b017-597423e9afe8 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:08.526355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-7148bc6e-ab82-45dd-b017-597423e9afe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:08.532443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c5789d37-b10c-4635-ae4a-3dd71196e577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da6f8a86ddbb4731902452bd35a61ddb'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:08.533366 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c5789d37-b10c-4635-ae4a-3dd71196e577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da6f8a86ddbb4731902452bd35a61ddb'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:08.541543 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148bc6e-ab82-45dd-b017-597423e9afe8 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:08.548039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b9f2b-1cb9-4418-b013-6e68e66cbb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:08.549688 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b9f2b-1cb9-4418-b013-6e68e66cbb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:08.549688 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b9f2b-1cb9-4418-b013-6e68e66cbb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:08.549688 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b9f2b-1cb9-4418-b013-6e68e66cbb34 admin admin] PATH_INFO: `/v3/projects/11091d2130514e3896a88ac782d80118` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:08.551391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b9f2b-1cb9-4418-b013-6e68e66cbb34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11091d2130514e3896a88ac782d80118)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:08.555321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b9f2b-1cb9-4418-b013-6e68e66cbb34 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:08.639774 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c5789d37-b10c-4635-ae4a-3dd71196e577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da6f8a86ddbb4731902452bd35a61ddb'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:08.640721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c5789d37-b10c-4635-ae4a-3dd71196e577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da6f8a86ddbb4731902452bd35a61ddb'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:08.670741 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 974/1957] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:08 2022] DELETE /identity/v3/users/da6f8a86ddbb4731902452bd35a61ddb => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:08.671740 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5789d37-b10c-4635-ae4a-3dd71196e577 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:08.674627 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c5789d37-b10c-4635-ae4a-3dd71196e577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:08.714745 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f22b9f2b-1cb9-4418-b013-6e68e66cbb34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11091d2130514e3896a88ac782d80118', 'request_id': 'req-f22b9f2b-1cb9-4418-b013-6e68e66cbb34'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:08.734737 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f22b9f2b-1cb9-4418-b013-6e68e66cbb34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11091d2130514e3896a88ac782d80118', 'request_id': 'req-f22b9f2b-1cb9-4418-b013-6e68e66cbb34'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:08.793811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5789d37-b10c-4635-ae4a-3dd71196e577 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:08.815971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f22b9f2b-1cb9-4418-b013-6e68e66cbb34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11091d2130514e3896a88ac782d80118', 'request_id': 'req-f22b9f2b-1cb9-4418-b013-6e68e66cbb34'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:08.843160 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f22b9f2b-1cb9-4418-b013-6e68e66cbb34 admin admin] The token cache is being invalidate because project 11091d2130514e3896a88ac782d80118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:08.843803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f22b9f2b-1cb9-4418-b013-6e68e66cbb34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:08.844845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f22b9f2b-1cb9-4418-b013-6e68e66cbb34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:08.847313 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 984/1958] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:08 2022] DELETE /identity/v3/projects/11091d2130514e3896a88ac782d80118 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:08.849039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa95cc6-e805-471c-a9d4-8c7eec03156c None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:08.849385 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa95cc6-e805-471c-a9d4-8c7eec03156c None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:08.849732 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa95cc6-e805-471c-a9d4-8c7eec03156c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:08.872166 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-6fa95cc6-e805-471c-a9d4-8c7eec03156c None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:08.873563 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6fa95cc6-e805-471c-a9d4-8c7eec03156c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:08.883959 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9702ea-cce9-4869-8864-412afc511d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:08.884717 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9702ea-cce9-4869-8864-412afc511d3d admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:08.885009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9702ea-cce9-4869-8864-412afc511d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:08.885294 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9702ea-cce9-4869-8864-412afc511d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:08.887412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9702ea-cce9-4869-8864-412afc511d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:08.888119 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9702ea-cce9-4869-8864-412afc511d3d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:08.900799 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 975/1959] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:08.902015 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9702ea-cce9-4869-8864-412afc511d3d admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:08.904444 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-1a9702ea-cce9-4869-8864-412afc511d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:08.939162 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9702ea-cce9-4869-8864-412afc511d3d admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:08.946753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0081e2-155a-40d6-ba86-660a95af2938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:08.952551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0081e2-155a-40d6-ba86-660a95af2938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:08.952551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0081e2-155a-40d6-ba86-660a95af2938 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:08.952551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0081e2-155a-40d6-ba86-660a95af2938 admin admin] PATH_INFO: `/v3/users/3fc9e72c389c4705825349ba37f9c64a` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:08.952551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0081e2-155a-40d6-ba86-660a95af2938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc9e72c389c4705825349ba37f9c64a)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:08.953186 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0081e2-155a-40d6-ba86-660a95af2938 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:09.002740 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 985/1960] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:09.003795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa95cc6-e805-471c-a9d4-8c7eec03156c None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:09.005386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6fa95cc6-e805-471c-a9d4-8c7eec03156c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:09.018596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa95cc6-e805-471c-a9d4-8c7eec03156c None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:09.025294 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260b9fa-824c-4f92-88ff-edb02a7e8db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:09.031020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b9fa-824c-4f92-88ff-edb02a7e8db0 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:09.031020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b9fa-824c-4f92-88ff-edb02a7e8db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:09.031020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b9fa-824c-4f92-88ff-edb02a7e8db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:09.031020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260b9fa-824c-4f92-88ff-edb02a7e8db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:09.031020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260b9fa-824c-4f92-88ff-edb02a7e8db0 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:09.047229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 986/1961] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:09.049393 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260b9fa-824c-4f92-88ff-edb02a7e8db0 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:09.052941 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b260b9fa-824c-4f92-88ff-edb02a7e8db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:09.068364 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260b9fa-824c-4f92-88ff-edb02a7e8db0 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:09.076931 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a8770-98ab-4222-a781-74d411a6b0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:09.077727 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a8770-98ab-4222-a781-74d411a6b0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:09.078015 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a8770-98ab-4222-a781-74d411a6b0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:09.078292 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a8770-98ab-4222-a781-74d411a6b0dd admin admin] PATH_INFO: `/v3/projects/8da10f57ee63405bb457c4c629ab0090` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:09.079500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a8770-98ab-4222-a781-74d411a6b0dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8da10f57ee63405bb457c4c629ab0090)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:09.081561 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a8770-98ab-4222-a781-74d411a6b0dd admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:09.224332 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-0b0081e2-155a-40d6-ba86-660a95af2938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc9e72c389c4705825349ba37f9c64a'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:09.233935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-0b0081e2-155a-40d6-ba86-660a95af2938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc9e72c389c4705825349ba37f9c64a'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:09.235030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-0b0081e2-155a-40d6-ba86-660a95af2938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc9e72c389c4705825349ba37f9c64a'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:09.300077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-7e0a8770-98ab-4222-a781-74d411a6b0dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8da10f57ee63405bb457c4c629ab0090', 'request_id': 'req-7e0a8770-98ab-4222-a781-74d411a6b0dd'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:09.306015 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-7e0a8770-98ab-4222-a781-74d411a6b0dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8da10f57ee63405bb457c4c629ab0090', 'request_id': 'req-7e0a8770-98ab-4222-a781-74d411a6b0dd'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:09.308788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-0b0081e2-155a-40d6-ba86-660a95af2938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc9e72c389c4705825349ba37f9c64a'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:09.309410 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-0b0081e2-155a-40d6-ba86-660a95af2938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc9e72c389c4705825349ba37f9c64a'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:09.327991 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 976/1962] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:08 2022] DELETE /identity/v3/users/3fc9e72c389c4705825349ba37f9c64a => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:09.328954 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0081e2-155a-40d6-ba86-660a95af2938 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:09.330455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-0b0081e2-155a-40d6-ba86-660a95af2938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:09.386461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:09.399450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0081e2-155a-40d6-ba86-660a95af2938 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:09.404665 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebf310-0bce-4a6d-b031-4e65eac15343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:09.405010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-7e0a8770-98ab-4222-a781-74d411a6b0dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8da10f57ee63405bb457c4c629ab0090', 'request_id': 'req-7e0a8770-98ab-4222-a781-74d411a6b0dd'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:09.406185 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebf310-0bce-4a6d-b031-4e65eac15343 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:09.406185 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebf310-0bce-4a6d-b031-4e65eac15343 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:09.407148 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebf310-0bce-4a6d-b031-4e65eac15343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:09.410386 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-6aebf310-0bce-4a6d-b031-4e65eac15343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:09.433927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-7e0a8770-98ab-4222-a781-74d411a6b0dd admin admin] The token cache is being invalidate because project 8da10f57ee63405bb457c4c629ab0090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:09.434843 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-7e0a8770-98ab-4222-a781-74d411a6b0dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:09.435727 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-7e0a8770-98ab-4222-a781-74d411a6b0dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:09.437835 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 987/1963] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:09 2022] DELETE /identity/v3/projects/8da10f57ee63405bb457c4c629ab0090 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:09.446129 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a8770-98ab-4222-a781-74d411a6b0dd admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:09.446129 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-7e0a8770-98ab-4222-a781-74d411a6b0dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:09.446383 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:09.511082 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebf310-0bce-4a6d-b031-4e65eac15343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:09.513044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebf310-0bce-4a6d-b031-4e65eac15343 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:09.525126 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a8770-98ab-4222-a781-74d411a6b0dd admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:09.530855 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a13ecb-8c8f-4fc2-9550-b2797fac70d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:09.532057 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a13ecb-8c8f-4fc2-9550-b2797fac70d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:09.532701 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a13ecb-8c8f-4fc2-9550-b2797fac70d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:09.533155 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a13ecb-8c8f-4fc2-9550-b2797fac70d1 admin admin] PATH_INFO: `/v3/projects/b010aa705fa449fd9fa6d0eea90bb608/users/9b5d4f7e3323441798c12711448557c3/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:09.538731 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 977/1964] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:09.543844 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4f038-efad-4e8e-b4fc-3998efe21e1c None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:09.544248 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4f038-efad-4e8e-b4fc-3998efe21e1c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:09.544541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4f038-efad-4e8e-b4fc-3998efe21e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:09.555812 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a13ecb-8c8f-4fc2-9550-b2797fac70d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b010aa705fa449fd9fa6d0eea90bb608, user_id=9b5d4f7e3323441798c12711448557c3, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:09.562548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a13ecb-8c8f-4fc2-9550-b2797fac70d1 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:09.585611 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-93c4f038-efad-4e8e-b4fc-3998efe21e1c None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:09.587384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-93c4f038-efad-4e8e-b4fc-3998efe21e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:09.598642 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 978/1965] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:09.606670 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f536896-b7b5-4e5d-93e1-8d64bdde1608 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:09.607499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f536896-b7b5-4e5d-93e1-8d64bdde1608 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:09.607499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f536896-b7b5-4e5d-93e1-8d64bdde1608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:09.640873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-9f536896-b7b5-4e5d-93e1-8d64bdde1608 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:09.642287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-9f536896-b7b5-4e5d-93e1-8d64bdde1608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:09.652015 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 988/1966] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:09 2022] PUT /identity/v3/projects/b010aa705fa449fd9fa6d0eea90bb608/users/9b5d4f7e3323441798c12711448557c3/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:09.666854 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a2b6d-e1af-4787-8ed1-00824fd8ffe2 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:09.667207 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a2b6d-e1af-4787-8ed1-00824fd8ffe2 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:09.667498 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a2b6d-e1af-4787-8ed1-00824fd8ffe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:09.723792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-fd0a2b6d-e1af-4787-8ed1-00824fd8ffe2 None None] MFA Rules not processed for user `9b5d4f7e3323441798c12711448557c3`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:09.725597 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-fd0a2b6d-e1af-4787-8ed1-00824fd8ffe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:09.767538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 979/1967] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:59:09.770218 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f536896-b7b5-4e5d-93e1-8d64bdde1608 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:09.790104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f536896-b7b5-4e5d-93e1-8d64bdde1608 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:09.807369 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b785239-2674-408d-99da-1a829dddd026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:09.808457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b785239-2674-408d-99da-1a829dddd026 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:09.808457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b785239-2674-408d-99da-1a829dddd026 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:09.808806 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b785239-2674-408d-99da-1a829dddd026 admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:09.814434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b785239-2674-408d-99da-1a829dddd026 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:59:09.814757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b785239-2674-408d-99da-1a829dddd026 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:09.816584 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b785239-2674-408d-99da-1a829dddd026 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:09.850561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 980/1968] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:59:09.852719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b785239-2674-408d-99da-1a829dddd026 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:09.873440 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b785239-2674-408d-99da-1a829dddd026 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:09.881277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 989/1969] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:09 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:59:09.883258 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a2b6d-e1af-4787-8ed1-00824fd8ffe2 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:09.884249 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a5d5c-2e81-464b-b625-aaae5ac1e7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:09.893368 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a5d5c-2e81-464b-b625-aaae5ac1e7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:09.893368 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a5d5c-2e81-464b-b625-aaae5ac1e7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:09.895888 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a5d5c-2e81-464b-b625-aaae5ac1e7d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:09.895888 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a5d5c-2e81-464b-b625-aaae5ac1e7d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:09.898495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a5d5c-2e81-464b-b625-aaae5ac1e7d5 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:09.903062 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a2b6d-e1af-4787-8ed1-00824fd8ffe2 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:09.909425 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf33510-cb44-4723-aa81-113eda2db0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:09.910314 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf33510-cb44-4723-aa81-113eda2db0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:09.910516 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf33510-cb44-4723-aa81-113eda2db0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:09.911140 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf33510-cb44-4723-aa81-113eda2db0c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:09.911531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf33510-cb44-4723-aa81-113eda2db0c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:09.913744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf33510-cb44-4723-aa81-113eda2db0c3 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:10.094907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 981/1970] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:59:09 2022] POST /identity/v3/projects => generated 387 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:10.098949 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 990/1971] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:59:09 2022] POST /identity/v3/projects => generated 407 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:10.112749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a5d5c-2e81-464b-b625-aaae5ac1e7d5 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:10.114254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf33510-cb44-4723-aa81-113eda2db0c3 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:10.215619 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a5d5c-2e81-464b-b625-aaae5ac1e7d5 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:10.264468 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf33510-cb44-4723-aa81-113eda2db0c3 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:10.270303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98c2ed-4515-4a57-b2f0-dc04877e1a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:10.270992 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98c2ed-4515-4a57-b2f0-dc04877e1a31 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:10.271264 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98c2ed-4515-4a57-b2f0-dc04877e1a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:10.271544 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98c2ed-4515-4a57-b2f0-dc04877e1a31 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:10.272246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98c2ed-4515-4a57-b2f0-dc04877e1a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:10.274521 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98c2ed-4515-4a57-b2f0-dc04877e1a31 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:10.282917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc7b9f-5a83-4027-8796-d5121871e459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:10.283866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc7b9f-5a83-4027-8796-d5121871e459 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:10.284209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc7b9f-5a83-4027-8796-d5121871e459 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:10.284493 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc7b9f-5a83-4027-8796-d5121871e459 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:10.285502 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc7b9f-5a83-4027-8796-d5121871e459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:10.291466 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc7b9f-5a83-4027-8796-d5121871e459 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:10.408371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 991/1972] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:10 2022] POST /identity/v3/users => generated 310 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:10.409264 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98c2ed-4515-4a57-b2f0-dc04877e1a31 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:10.410899 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ce98c2ed-4515-4a57-b2f0-dc04877e1a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:10.423629 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98c2ed-4515-4a57-b2f0-dc04877e1a31 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:10.429764 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103708a5-946e-42f5-b4ed-131b1dab3ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:10.430634 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103708a5-946e-42f5-b4ed-131b1dab3ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:10.430920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103708a5-946e-42f5-b4ed-131b1dab3ade admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:10.431205 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103708a5-946e-42f5-b4ed-131b1dab3ade admin admin] PATH_INFO: `/v3/projects/50827dc60efc47d7a12ea78a80785c61` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:10.432868 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103708a5-946e-42f5-b4ed-131b1dab3ade admin admin] RBAC: Authorizing `identity:delete_project(project_id=50827dc60efc47d7a12ea78a80785c61)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:10.435979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103708a5-946e-42f5-b4ed-131b1dab3ade admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:10.443702 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 982/1973] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:10 2022] POST /identity/v3/users => generated 294 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:10.443702 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc7b9f-5a83-4027-8796-d5121871e459 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:10.459095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc7b9f-5a83-4027-8796-d5121871e459 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:10.468255 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b52d8e-6c01-485d-9b9c-4c428f6c5f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:10.468947 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b52d8e-6c01-485d-9b9c-4c428f6c5f66 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:10.469438 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b52d8e-6c01-485d-9b9c-4c428f6c5f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:10.469438 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b52d8e-6c01-485d-9b9c-4c428f6c5f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:10.470187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b52d8e-6c01-485d-9b9c-4c428f6c5f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:10.472409 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b52d8e-6c01-485d-9b9c-4c428f6c5f66 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:10.488572 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 983/1974] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:10.488572 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b52d8e-6c01-485d-9b9c-4c428f6c5f66 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:10.488572 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-86b52d8e-6c01-485d-9b9c-4c428f6c5f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:10.501658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b52d8e-6c01-485d-9b9c-4c428f6c5f66 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:10.506644 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f6b2d-f262-4cca-9392-cd3929020967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:10.508137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f6b2d-f262-4cca-9392-cd3929020967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:10.508416 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f6b2d-f262-4cca-9392-cd3929020967 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:10.508723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f6b2d-f262-4cca-9392-cd3929020967 admin admin] PATH_INFO: `/v3/projects/907e8f87ae434522938b977b72237059` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:10.509931 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f6b2d-f262-4cca-9392-cd3929020967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=907e8f87ae434522938b977b72237059)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:10.511840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f6b2d-f262-4cca-9392-cd3929020967 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:10.564253 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-103708a5-946e-42f5-b4ed-131b1dab3ade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50827dc60efc47d7a12ea78a80785c61', 'request_id': 'req-103708a5-946e-42f5-b4ed-131b1dab3ade'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:10.570522 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-103708a5-946e-42f5-b4ed-131b1dab3ade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50827dc60efc47d7a12ea78a80785c61', 'request_id': 'req-103708a5-946e-42f5-b4ed-131b1dab3ade'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:10.628507 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-227f6b2d-f262-4cca-9392-cd3929020967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907e8f87ae434522938b977b72237059', 'request_id': 'req-227f6b2d-f262-4cca-9392-cd3929020967'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:10.667727 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-103708a5-946e-42f5-b4ed-131b1dab3ade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50827dc60efc47d7a12ea78a80785c61', 'request_id': 'req-103708a5-946e-42f5-b4ed-131b1dab3ade'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:10.680984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-103708a5-946e-42f5-b4ed-131b1dab3ade admin admin] The token cache is being invalidate because project 50827dc60efc47d7a12ea78a80785c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:10.681277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-103708a5-946e-42f5-b4ed-131b1dab3ade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:10.681960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-103708a5-946e-42f5-b4ed-131b1dab3ade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:10.683538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 992/1975] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:10 2022] DELETE /identity/v3/projects/50827dc60efc47d7a12ea78a80785c61 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:10.684357 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103708a5-946e-42f5-b4ed-131b1dab3ade admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:10.685712 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-103708a5-946e-42f5-b4ed-131b1dab3ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:10.728220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-227f6b2d-f262-4cca-9392-cd3929020967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907e8f87ae434522938b977b72237059', 'request_id': 'req-227f6b2d-f262-4cca-9392-cd3929020967'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:10.735185 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-227f6b2d-f262-4cca-9392-cd3929020967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907e8f87ae434522938b977b72237059', 'request_id': 'req-227f6b2d-f262-4cca-9392-cd3929020967'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:10.748788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-227f6b2d-f262-4cca-9392-cd3929020967 admin admin] The token cache is being invalidate because project 907e8f87ae434522938b977b72237059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:10.749084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-227f6b2d-f262-4cca-9392-cd3929020967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:10.749760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-227f6b2d-f262-4cca-9392-cd3929020967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:10.751559 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 984/1976] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:10 2022] DELETE /identity/v3/projects/907e8f87ae434522938b977b72237059 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:10.752143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f6b2d-f262-4cca-9392-cd3929020967 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:10.753605 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-227f6b2d-f262-4cca-9392-cd3929020967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:10.753731 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103708a5-946e-42f5-b4ed-131b1dab3ade admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:10.823828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebda97-46af-4444-a31e-1572d2daf05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:10.824517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebda97-46af-4444-a31e-1572d2daf05e admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:10.824835 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebda97-46af-4444-a31e-1572d2daf05e admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:10.825116 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebda97-46af-4444-a31e-1572d2daf05e admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:10.825857 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebda97-46af-4444-a31e-1572d2daf05e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:10.827545 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebda97-46af-4444-a31e-1572d2daf05e admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:10.832267 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f6b2d-f262-4cca-9392-cd3929020967 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:10.838148 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad22c41-598d-43c8-afa4-369056511b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:10.839092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad22c41-598d-43c8-afa4-369056511b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:10.839384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad22c41-598d-43c8-afa4-369056511b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:10.839667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad22c41-598d-43c8-afa4-369056511b22 admin admin] PATH_INFO: `/v3/projects/cfc5c3a6a27d41e492b23f2d6a309658/users/3ea57212bfb74d6181be33d7e64696f7/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:10.843662 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 993/1977] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:10.843662 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebda97-46af-4444-a31e-1572d2daf05e admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:10.843906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d4ebda97-46af-4444-a31e-1572d2daf05e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:10.861295 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebda97-46af-4444-a31e-1572d2daf05e admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:10.862286 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad22c41-598d-43c8-afa4-369056511b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc5c3a6a27d41e492b23f2d6a309658, user_id=3ea57212bfb74d6181be33d7e64696f7, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:10.863503 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d9318-8f85-459c-bc46-33948cb2c276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:10.864390 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d9318-8f85-459c-bc46-33948cb2c276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:10.864825 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d9318-8f85-459c-bc46-33948cb2c276 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:10.865115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d9318-8f85-459c-bc46-33948cb2c276 admin admin] PATH_INFO: `/v3/users/0bd7d81694134fbe801f924caaf40932` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:10.865387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad22c41-598d-43c8-afa4-369056511b22 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:10.866364 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d9318-8f85-459c-bc46-33948cb2c276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bd7d81694134fbe801f924caaf40932)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:10.868964 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d9318-8f85-459c-bc46-33948cb2c276 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:10.992828 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 985/1978] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:10 2022] PUT /identity/v3/projects/cfc5c3a6a27d41e492b23f2d6a309658/users/3ea57212bfb74d6181be33d7e64696f7/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:10.993075 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad22c41-598d-43c8-afa4-369056511b22 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:10.994918 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-cad22c41-598d-43c8-afa4-369056511b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:10.999135 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:11.065145 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad22c41-598d-43c8-afa4-369056511b22 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:11.071527 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06426fe-87d5-49b8-8b53-7fdce5d3b4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:11.077469 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06426fe-87d5-49b8-8b53-7fdce5d3b4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:11.077469 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06426fe-87d5-49b8-8b53-7fdce5d3b4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:11.077469 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06426fe-87d5-49b8-8b53-7fdce5d3b4a6 admin admin] PATH_INFO: `/v3/users/aa7c43f128cd481fb1b7e4136e2a6fa0` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:11.077469 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06426fe-87d5-49b8-8b53-7fdce5d3b4a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa7c43f128cd481fb1b7e4136e2a6fa0)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:11.077469 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06426fe-87d5-49b8-8b53-7fdce5d3b4a6 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:11.115700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a17d9318-8f85-459c-bc46-33948cb2c276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bd7d81694134fbe801f924caaf40932'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:11.123767 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a17d9318-8f85-459c-bc46-33948cb2c276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bd7d81694134fbe801f924caaf40932'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:11.222150 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a17d9318-8f85-459c-bc46-33948cb2c276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bd7d81694134fbe801f924caaf40932'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:11.223003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a17d9318-8f85-459c-bc46-33948cb2c276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bd7d81694134fbe801f924caaf40932'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:11.223864 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a17d9318-8f85-459c-bc46-33948cb2c276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bd7d81694134fbe801f924caaf40932'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:11.252188 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 994/1979] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:10 2022] DELETE /identity/v3/users/0bd7d81694134fbe801f924caaf40932 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:11.253269 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d9318-8f85-459c-bc46-33948cb2c276 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:11.254666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-a17d9318-8f85-459c-bc46-33948cb2c276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:11.303691 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-d06426fe-87d5-49b8-8b53-7fdce5d3b4a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa7c43f128cd481fb1b7e4136e2a6fa0'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:11.311685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-d06426fe-87d5-49b8-8b53-7fdce5d3b4a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa7c43f128cd481fb1b7e4136e2a6fa0'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:11.312503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-d06426fe-87d5-49b8-8b53-7fdce5d3b4a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa7c43f128cd481fb1b7e4136e2a6fa0'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:11.341461 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d9318-8f85-459c-bc46-33948cb2c276 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:11.359861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f192fe-9900-4bad-a6b4-ee9cbcc18572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:11.363229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f192fe-9900-4bad-a6b4-ee9cbcc18572 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:11.363729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f192fe-9900-4bad-a6b4-ee9cbcc18572 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:11.364171 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f192fe-9900-4bad-a6b4-ee9cbcc18572 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:11.365112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f192fe-9900-4bad-a6b4-ee9cbcc18572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:11.367896 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f192fe-9900-4bad-a6b4-ee9cbcc18572 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:11.378800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-d06426fe-87d5-49b8-8b53-7fdce5d3b4a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa7c43f128cd481fb1b7e4136e2a6fa0'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:11.379550 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-d06426fe-87d5-49b8-8b53-7fdce5d3b4a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa7c43f128cd481fb1b7e4136e2a6fa0'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:11.384521 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 995/1980] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:11.385945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f192fe-9900-4bad-a6b4-ee9cbcc18572 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:11.393367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-10f192fe-9900-4bad-a6b4-ee9cbcc18572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:11.412281 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f192fe-9900-4bad-a6b4-ee9cbcc18572 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:11.412483 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 986/1981] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:10 2022] DELETE /identity/v3/users/aa7c43f128cd481fb1b7e4136e2a6fa0 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:11.413687 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06426fe-87d5-49b8-8b53-7fdce5d3b4a6 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:11.415242 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-d06426fe-87d5-49b8-8b53-7fdce5d3b4a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:11.506101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3724ff6-15f7-4df6-9c16-6d664ebab24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:11.506101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3724ff6-15f7-4df6-9c16-6d664ebab24b admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:11.506101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3724ff6-15f7-4df6-9c16-6d664ebab24b admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:11.506101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3724ff6-15f7-4df6-9c16-6d664ebab24b admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:11.506803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3724ff6-15f7-4df6-9c16-6d664ebab24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:11.508981 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3724ff6-15f7-4df6-9c16-6d664ebab24b admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:11.524217 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 996/1982] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:11.531775 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3724ff6-15f7-4df6-9c16-6d664ebab24b admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:11.535398 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06426fe-87d5-49b8-8b53-7fdce5d3b4a6 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:11.541893 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e943551-ed5e-41c3-9c1d-2892f531bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:11.542968 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e943551-ed5e-41c3-9c1d-2892f531bae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:11.543493 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e943551-ed5e-41c3-9c1d-2892f531bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:11.543879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e943551-ed5e-41c3-9c1d-2892f531bae2 admin admin] PATH_INFO: `/v3/projects/7a533999f5194403b2fbd51d6074a541/users/1653c7faaea04986b5214a881b628956/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:11.568581 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e943551-ed5e-41c3-9c1d-2892f531bae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a533999f5194403b2fbd51d6074a541, user_id=1653c7faaea04986b5214a881b628956, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:11.571984 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e943551-ed5e-41c3-9c1d-2892f531bae2 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:11.582007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3724ff6-15f7-4df6-9c16-6d664ebab24b admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:11.596320 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca663ca-f8be-427a-822f-c1146acaa4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:11.597332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca663ca-f8be-427a-822f-c1146acaa4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:11.597681 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca663ca-f8be-427a-822f-c1146acaa4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:11.597965 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca663ca-f8be-427a-822f-c1146acaa4c9 admin admin] PATH_INFO: `/v3/projects/cfc5c3a6a27d41e492b23f2d6a309658/users/3ea57212bfb74d6181be33d7e64696f7/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:11.605361 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca663ca-f8be-427a-822f-c1146acaa4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc5c3a6a27d41e492b23f2d6a309658, user_id=3ea57212bfb74d6181be33d7e64696f7, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:11.612684 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca663ca-f8be-427a-822f-c1146acaa4c9 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:11.632691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 997/1983] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:11 2022] PUT /identity/v3/projects/cfc5c3a6a27d41e492b23f2d6a309658/users/3ea57212bfb74d6181be33d7e64696f7/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:11.633520 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad130df-a2c6-4d39-9f79-91af6afeaf35 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:11.633816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad130df-a2c6-4d39-9f79-91af6afeaf35 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:11.634094 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad130df-a2c6-4d39-9f79-91af6afeaf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:11.671791 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-9ad130df-a2c6-4d39-9f79-91af6afeaf35 None None] MFA Rules not processed for user `3ea57212bfb74d6181be33d7e64696f7`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:11.673229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9ad130df-a2c6-4d39-9f79-91af6afeaf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:11.712944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 987/1984] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:11 2022] PUT /identity/v3/projects/7a533999f5194403b2fbd51d6074a541/users/1653c7faaea04986b5214a881b628956/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:11.723367 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc9c29-dc33-41eb-b52b-f4fc4b8bd9f2 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:11.723656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc9c29-dc33-41eb-b52b-f4fc4b8bd9f2 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:11.723934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc9c29-dc33-41eb-b52b-f4fc4b8bd9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:11.754589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-00cc9c29-dc33-41eb-b52b-f4fc4b8bd9f2 None None] MFA Rules not processed for user `1653c7faaea04986b5214a881b628956`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:11.755830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-00cc9c29-dc33-41eb-b52b-f4fc4b8bd9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:11.766817 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 998/1985] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:11 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:11.779374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad130df-a2c6-4d39-9f79-91af6afeaf35 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:11.780082 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9ad130df-a2c6-4d39-9f79-91af6afeaf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:11.843773 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 988/1986] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:59:11.848388 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc9c29-dc33-41eb-b52b-f4fc4b8bd9f2 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:11.848388 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-00cc9c29-dc33-41eb-b52b-f4fc4b8bd9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:11.879667 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad130df-a2c6-4d39-9f79-91af6afeaf35 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:11.895656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:11.938969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc9c29-dc33-41eb-b52b-f4fc4b8bd9f2 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:11.940528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bf038-df76-40ee-9d2e-f52d728f5267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:11.941197 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bf038-df76-40ee-9d2e-f52d728f5267 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:11.941506 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bf038-df76-40ee-9d2e-f52d728f5267 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:11.941771 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bf038-df76-40ee-9d2e-f52d728f5267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:11.944282 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140dff20-0771-4c5d-9d9c-771e7e7e17b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:11.945507 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140dff20-0771-4c5d-9d9c-771e7e7e17b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:11.945761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140dff20-0771-4c5d-9d9c-771e7e7e17b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:11.945974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140dff20-0771-4c5d-9d9c-771e7e7e17b8 admin admin] PATH_INFO: `/v3/projects/0544c2c2f48145778eccd56bee5eb30f` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:11.949035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140dff20-0771-4c5d-9d9c-771e7e7e17b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0544c2c2f48145778eccd56bee5eb30f)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:11.950842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140dff20-0771-4c5d-9d9c-771e7e7e17b8 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:12.012478 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bf038-df76-40ee-9d2e-f52d728f5267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:12.013885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bf038-df76-40ee-9d2e-f52d728f5267 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:12.024783 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 999/1987] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:11 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:59:12.025627 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bf038-df76-40ee-9d2e-f52d728f5267 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:12.039909 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bf038-df76-40ee-9d2e-f52d728f5267 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:12.044712 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0ee59-92a3-4a32-b4db-f08cbf59f778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:12.045379 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0ee59-92a3-4a32-b4db-f08cbf59f778 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:12.045846 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0ee59-92a3-4a32-b4db-f08cbf59f778 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:12.046036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0ee59-92a3-4a32-b4db-f08cbf59f778 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:12.046843 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0ee59-92a3-4a32-b4db-f08cbf59f778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:12.048791 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0ee59-92a3-4a32-b4db-f08cbf59f778 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:12.105844 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-140dff20-0771-4c5d-9d9c-771e7e7e17b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0544c2c2f48145778eccd56bee5eb30f', 'request_id': 'req-140dff20-0771-4c5d-9d9c-771e7e7e17b8'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:12.154659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1000/1988] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:59:12 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:12.154659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0ee59-92a3-4a32-b4db-f08cbf59f778 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:12.154981 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-bcf0ee59-92a3-4a32-b4db-f08cbf59f778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:12.210905 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-140dff20-0771-4c5d-9d9c-771e7e7e17b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0544c2c2f48145778eccd56bee5eb30f', 'request_id': 'req-140dff20-0771-4c5d-9d9c-771e7e7e17b8'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:12.217275 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-140dff20-0771-4c5d-9d9c-771e7e7e17b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0544c2c2f48145778eccd56bee5eb30f', 'request_id': 'req-140dff20-0771-4c5d-9d9c-771e7e7e17b8'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:12.222592 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0ee59-92a3-4a32-b4db-f08cbf59f778 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:12.231032 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e16986-5ad0-424d-bef5-1d56c8fefa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:12.231346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-140dff20-0771-4c5d-9d9c-771e7e7e17b8 admin admin] The token cache is being invalidate because project 0544c2c2f48145778eccd56bee5eb30f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:12.231513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-140dff20-0771-4c5d-9d9c-771e7e7e17b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:12.231976 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e16986-5ad0-424d-bef5-1d56c8fefa72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:12.232160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-140dff20-0771-4c5d-9d9c-771e7e7e17b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:12.232320 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e16986-5ad0-424d-bef5-1d56c8fefa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:12.232521 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e16986-5ad0-424d-bef5-1d56c8fefa72 admin admin] PATH_INFO: `/v3/projects/c4725469f9c04f3a9036a4975b6b311f` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:12.233704 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 989/1989] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:11 2022] DELETE /identity/v3/projects/0544c2c2f48145778eccd56bee5eb30f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:12.233838 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e16986-5ad0-424d-bef5-1d56c8fefa72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4725469f9c04f3a9036a4975b6b311f)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:12.234657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140dff20-0771-4c5d-9d9c-771e7e7e17b8 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:12.235786 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e16986-5ad0-424d-bef5-1d56c8fefa72 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:12.236240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-140dff20-0771-4c5d-9d9c-771e7e7e17b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:12.325873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140dff20-0771-4c5d-9d9c-771e7e7e17b8 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:12.330894 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bb76e-57d8-473d-a9cc-53dadc413733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:12.331791 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bb76e-57d8-473d-a9cc-53dadc413733 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:12.331910 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bb76e-57d8-473d-a9cc-53dadc413733 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:12.332107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bb76e-57d8-473d-a9cc-53dadc413733 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:12.332841 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bb76e-57d8-473d-a9cc-53dadc413733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:12.334896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bb76e-57d8-473d-a9cc-53dadc413733 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:12.397548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d2e16986-5ad0-424d-bef5-1d56c8fefa72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4725469f9c04f3a9036a4975b6b311f', 'request_id': 'req-d2e16986-5ad0-424d-bef5-1d56c8fefa72'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:12.404458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d2e16986-5ad0-424d-bef5-1d56c8fefa72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4725469f9c04f3a9036a4975b6b311f', 'request_id': 'req-d2e16986-5ad0-424d-bef5-1d56c8fefa72'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:12.479719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 990/1990] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:12 2022] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:12.481289 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f5047-bfdd-40fb-93c6-c1f10c509b73 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:12.481587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f5047-bfdd-40fb-93c6-c1f10c509b73 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:12.481877 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f5047-bfdd-40fb-93c6-c1f10c509b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:12.501509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-f51f5047-bfdd-40fb-93c6-c1f10c509b73 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:12.501862 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d2e16986-5ad0-424d-bef5-1d56c8fefa72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4725469f9c04f3a9036a4975b6b311f', 'request_id': 'req-d2e16986-5ad0-424d-bef5-1d56c8fefa72'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:12.503326 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f51f5047-bfdd-40fb-93c6-c1f10c509b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:12.514912 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d2e16986-5ad0-424d-bef5-1d56c8fefa72 admin admin] The token cache is being invalidate because project c4725469f9c04f3a9036a4975b6b311f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:12.523296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d2e16986-5ad0-424d-bef5-1d56c8fefa72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:12.523296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d2e16986-5ad0-424d-bef5-1d56c8fefa72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:12.523296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1001/1991] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:12 2022] DELETE /identity/v3/projects/c4725469f9c04f3a9036a4975b6b311f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:12.523296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e16986-5ad0-424d-bef5-1d56c8fefa72 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:12.523296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d2e16986-5ad0-424d-bef5-1d56c8fefa72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:12.573414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 991/1992] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:12.574943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d1fe1-8a3b-410a-9153-a1aac77f8108 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:12.575343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d1fe1-8a3b-410a-9153-a1aac77f8108 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:12.575719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d1fe1-8a3b-410a-9153-a1aac77f8108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:12.595400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-4f0d1fe1-8a3b-410a-9153-a1aac77f8108 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:12.596626 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4f0d1fe1-8a3b-410a-9153-a1aac77f8108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:12.605591 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 992/1993] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:12.606416 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d1fe1-8a3b-410a-9153-a1aac77f8108 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:12.607785 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4f0d1fe1-8a3b-410a-9153-a1aac77f8108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:12.609864 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e16986-5ad0-424d-bef5-1d56c8fefa72 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:12.618690 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479ceba-aad7-4ab5-aa72-aeea7a5f4405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:12.620156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479ceba-aad7-4ab5-aa72-aeea7a5f4405 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:12.620156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479ceba-aad7-4ab5-aa72-aeea7a5f4405 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:12.620334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479ceba-aad7-4ab5-aa72-aeea7a5f4405 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:12.621177 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479ceba-aad7-4ab5-aa72-aeea7a5f4405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:12.622981 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479ceba-aad7-4ab5-aa72-aeea7a5f4405 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:12.638263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1002/1994] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:12.639559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57619b2-2f19-408b-a423-0cfe5d682f9e None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:12.639874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57619b2-2f19-408b-a423-0cfe5d682f9e None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:12.640158 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57619b2-2f19-408b-a423-0cfe5d682f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:12.664374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-b57619b2-2f19-408b-a423-0cfe5d682f9e None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:12.665925 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b57619b2-2f19-408b-a423-0cfe5d682f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:12.680825 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1003/1995] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:12.682641 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dc52e-18fd-49f9-8dd5-d4ad758be4c2 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:12.683057 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dc52e-18fd-49f9-8dd5-d4ad758be4c2 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:12.683393 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dc52e-18fd-49f9-8dd5-d4ad758be4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:12.697644 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d1fe1-8a3b-410a-9153-a1aac77f8108 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:12.702243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a30c6f-35b4-4345-92f9-146816bf01f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:12.703338 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a30c6f-35b4-4345-92f9-146816bf01f0 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:12.703731 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a30c6f-35b4-4345-92f9-146816bf01f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:12.704115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a30c6f-35b4-4345-92f9-146816bf01f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:12.706764 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-60a30c6f-35b4-4345-92f9-146816bf01f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:12.710784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-710dc52e-18fd-49f9-8dd5-d4ad758be4c2 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:12.713433 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-710dc52e-18fd-49f9-8dd5-d4ad758be4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:12.728355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1004/1996] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:12.729868 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dc52e-18fd-49f9-8dd5-d4ad758be4c2 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:12.741089 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dc52e-18fd-49f9-8dd5-d4ad758be4c2 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:12.747712 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5171f80-53e3-46b1-9251-cd46f5aad8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:12.748628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5171f80-53e3-46b1-9251-cd46f5aad8e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:12.749260 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5171f80-53e3-46b1-9251-cd46f5aad8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:12.749635 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5171f80-53e3-46b1-9251-cd46f5aad8e2 admin admin] PATH_INFO: `/v3/projects/137912d614db45679dcf10dc69f2daab/users/13d168b8dbb94ca8a28715e334ca29dc/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:12.770437 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5171f80-53e3-46b1-9251-cd46f5aad8e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=137912d614db45679dcf10dc69f2daab, user_id=13d168b8dbb94ca8a28715e334ca29dc, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:12.775462 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5171f80-53e3-46b1-9251-cd46f5aad8e2 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:12.793517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:12.795433 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a30c6f-35b4-4345-92f9-146816bf01f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:12.797196 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a30c6f-35b4-4345-92f9-146816bf01f0 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:12.810308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 993/1997] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:12 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:12.811496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a30c6f-35b4-4345-92f9-146816bf01f0 service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:12.826087 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a30c6f-35b4-4345-92f9-146816bf01f0 service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:12.831225 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97273978-cdfd-49fd-b25e-7130e17165ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:12.831901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97273978-cdfd-49fd-b25e-7130e17165ee admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:12.832190 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97273978-cdfd-49fd-b25e-7130e17165ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:12.832477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97273978-cdfd-49fd-b25e-7130e17165ee admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:12.833274 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97273978-cdfd-49fd-b25e-7130e17165ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:59:12.833706 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97273978-cdfd-49fd-b25e-7130e17165ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:12.835936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97273978-cdfd-49fd-b25e-7130e17165ee admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:12.849423 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 994/1998] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:59:12.850555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97273978-cdfd-49fd-b25e-7130e17165ee admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:12.864547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1005/1999] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:12 2022] PUT /identity/v3/projects/137912d614db45679dcf10dc69f2daab/users/13d168b8dbb94ca8a28715e334ca29dc/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:12.868089 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5171f80-53e3-46b1-9251-cd46f5aad8e2 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:12.868855 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97273978-cdfd-49fd-b25e-7130e17165ee admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:12.944330 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5171f80-53e3-46b1-9251-cd46f5aad8e2 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:12.950287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8173e1-ed8b-492b-86be-afc8e50b281b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:12.951308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8173e1-ed8b-492b-86be-afc8e50b281b admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:12.951695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8173e1-ed8b-492b-86be-afc8e50b281b admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:12.951980 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8173e1-ed8b-492b-86be-afc8e50b281b admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:12.952837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8173e1-ed8b-492b-86be-afc8e50b281b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:12.953223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc90f3-aaae-48b8-89c4-ace68a1f659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:12.954580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc90f3-aaae-48b8-89c4-ace68a1f659c admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:12.954721 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8173e1-ed8b-492b-86be-afc8e50b281b admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:12.955008 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc90f3-aaae-48b8-89c4-ace68a1f659c admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:12.955367 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc90f3-aaae-48b8-89c4-ace68a1f659c admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:12.956338 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc90f3-aaae-48b8-89c4-ace68a1f659c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:59:12.956787 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc90f3-aaae-48b8-89c4-ace68a1f659c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:12.961158 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc90f3-aaae-48b8-89c4-ace68a1f659c admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:12.974580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 995/2000] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:59:12.976239 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc90f3-aaae-48b8-89c4-ace68a1f659c admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:12.986710 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc90f3-aaae-48b8-89c4-ace68a1f659c admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:12.992334 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e7648-8dff-48ff-8043-f4d11a78b809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:12.993013 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e7648-8dff-48ff-8043-f4d11a78b809 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:12.993303 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e7648-8dff-48ff-8043-f4d11a78b809 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:12.993586 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e7648-8dff-48ff-8043-f4d11a78b809 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:12.994324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e7648-8dff-48ff-8043-f4d11a78b809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:12.995936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e7648-8dff-48ff-8043-f4d11a78b809 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:13.007325 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 996/2001] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:13.008152 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e7648-8dff-48ff-8043-f4d11a78b809 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:13.021430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e7648-8dff-48ff-8043-f4d11a78b809 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:13.026835 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ddf6b-8506-4b43-863f-7067d13d12ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:13.027503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ddf6b-8506-4b43-863f-7067d13d12ce admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:13.027784 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ddf6b-8506-4b43-863f-7067d13d12ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:13.028060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ddf6b-8506-4b43-863f-7067d13d12ce admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:13.028820 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ddf6b-8506-4b43-863f-7067d13d12ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:13.030962 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ddf6b-8506-4b43-863f-7067d13d12ce admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:13.128788 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1006/2002] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:59:12 2022] POST /identity/v3/projects => generated 387 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:13.130152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8173e1-ed8b-492b-86be-afc8e50b281b admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:13.196749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 997/2003] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:59:13 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:13.196749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ddf6b-8506-4b43-863f-7067d13d12ce admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:13.211883 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8173e1-ed8b-492b-86be-afc8e50b281b admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:13.299492 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ddf6b-8506-4b43-863f-7067d13d12ce admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:13.300449 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb77d5c-3ba2-4fb1-9224-faa79f9ef6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:13.301672 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb77d5c-3ba2-4fb1-9224-faa79f9ef6f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:13.302068 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb77d5c-3ba2-4fb1-9224-faa79f9ef6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:13.302515 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb77d5c-3ba2-4fb1-9224-faa79f9ef6f8 admin admin] PATH_INFO: `/v3/projects/137912d614db45679dcf10dc69f2daab/users/13d168b8dbb94ca8a28715e334ca29dc/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:13.305133 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb77d5c-3ba2-4fb1-9224-faa79f9ef6f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=137912d614db45679dcf10dc69f2daab, user_id=13d168b8dbb94ca8a28715e334ca29dc, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:13.308208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0f34d-f1de-4443-8ab9-6f81f2ebb9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:13.308351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb77d5c-3ba2-4fb1-9224-faa79f9ef6f8 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:13.309429 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0f34d-f1de-4443-8ab9-6f81f2ebb9cc admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:13.309925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0f34d-f1de-4443-8ab9-6f81f2ebb9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:13.310310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0f34d-f1de-4443-8ab9-6f81f2ebb9cc admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:13.311613 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0f34d-f1de-4443-8ab9-6f81f2ebb9cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:13.315607 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0f34d-f1de-4443-8ab9-6f81f2ebb9cc admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:13.320615 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1007/2004] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:13 2022] PUT /identity/v3/projects/137912d614db45679dcf10dc69f2daab/users/13d168b8dbb94ca8a28715e334ca29dc/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:13.321932 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb77d5c-3ba2-4fb1-9224-faa79f9ef6f8 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:13.409536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb77d5c-3ba2-4fb1-9224-faa79f9ef6f8 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:13.415521 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c745b-b4aa-4156-ad75-d8be9114e731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:13.416514 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c745b-b4aa-4156-ad75-d8be9114e731 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:13.417054 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c745b-b4aa-4156-ad75-d8be9114e731 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:13.417291 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c745b-b4aa-4156-ad75-d8be9114e731 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:13.418036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c745b-b4aa-4156-ad75-d8be9114e731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:13.420028 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c745b-b4aa-4156-ad75-d8be9114e731 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:13.424858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 998/2005] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:13 2022] POST /identity/v3/users => generated 294 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:13.426552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4a47b-8bed-4169-86c0-2abda4f9f2eb None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:13.426989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4a47b-8bed-4169-86c0-2abda4f9f2eb None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:13.427412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4a47b-8bed-4169-86c0-2abda4f9f2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:13.457928 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-03f4a47b-8bed-4169-86c0-2abda4f9f2eb None None] MFA Rules not processed for user `13d168b8dbb94ca8a28715e334ca29dc`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:13.459292 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-03f4a47b-8bed-4169-86c0-2abda4f9f2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:13.503162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1008/2006] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:13 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:13.504392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c745b-b4aa-4156-ad75-d8be9114e731 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:13.515096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c745b-b4aa-4156-ad75-d8be9114e731 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:13.522263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebee715-f9c9-4272-89ca-a7809f1fbca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:13.523595 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebee715-f9c9-4272-89ca-a7809f1fbca2 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:13.523879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebee715-f9c9-4272-89ca-a7809f1fbca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:13.524156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebee715-f9c9-4272-89ca-a7809f1fbca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:13.525188 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebee715-f9c9-4272-89ca-a7809f1fbca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:13.527256 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebee715-f9c9-4272-89ca-a7809f1fbca2 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:13.540703 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1009/2007] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:13.542124 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebee715-f9c9-4272-89ca-a7809f1fbca2 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:13.571803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebee715-f9c9-4272-89ca-a7809f1fbca2 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:13.579532 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 999/2008] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:13.579532 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4a47b-8bed-4169-86c0-2abda4f9f2eb None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:13.585249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb6317-a6fe-4c80-88c2-71dd588477dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:13.589138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb6317-a6fe-4c80-88c2-71dd588477dc admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:13.589433 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb6317-a6fe-4c80-88c2-71dd588477dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:13.589769 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb6317-a6fe-4c80-88c2-71dd588477dc admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:13.590841 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb6317-a6fe-4c80-88c2-71dd588477dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:13.592979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb6317-a6fe-4c80-88c2-71dd588477dc admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:13.595409 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4a47b-8bed-4169-86c0-2abda4f9f2eb None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:13.604741 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ca222-28f8-4e02-8ffd-1d4780b623f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:13.605564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ca222-28f8-4e02-8ffd-1d4780b623f5 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:13.605856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ca222-28f8-4e02-8ffd-1d4780b623f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:13.606140 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ca222-28f8-4e02-8ffd-1d4780b623f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:13.607018 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ca222-28f8-4e02-8ffd-1d4780b623f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:13.614559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1010/2009] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:13.614559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb6317-a6fe-4c80-88c2-71dd588477dc admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:13.621896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ca222-28f8-4e02-8ffd-1d4780b623f5 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:13.631705 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1000/2010] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:13.631705 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ca222-28f8-4e02-8ffd-1d4780b623f5 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:13.643330 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ca222-28f8-4e02-8ffd-1d4780b623f5 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:13.649521 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc82377-ff78-4715-ba88-2b3a0c2ee379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:13.650164 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc82377-ff78-4715-ba88-2b3a0c2ee379 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:13.651485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc82377-ff78-4715-ba88-2b3a0c2ee379 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:13.651485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc82377-ff78-4715-ba88-2b3a0c2ee379 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:13.651661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc82377-ff78-4715-ba88-2b3a0c2ee379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:13.653599 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc82377-ff78-4715-ba88-2b3a0c2ee379 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:13.666406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1001/2011] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:13.667567 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc82377-ff78-4715-ba88-2b3a0c2ee379 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:13.678323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc82377-ff78-4715-ba88-2b3a0c2ee379 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:13.681863 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:13.686066 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c716375-a6e6-471f-adcf-4d5a79df9547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:13.687031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c716375-a6e6-471f-adcf-4d5a79df9547 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:13.687328 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c716375-a6e6-471f-adcf-4d5a79df9547 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:13.687609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c716375-a6e6-471f-adcf-4d5a79df9547 admin admin] PATH_INFO: `/v3/projects/6c07e8136c7a44c38ba58d08f05125c1/users/d1c0575466e44fa4a909b6b0dbc6988a/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:13.703320 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb6317-a6fe-4c80-88c2-71dd588477dc admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:13.707276 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c716375-a6e6-471f-adcf-4d5a79df9547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c07e8136c7a44c38ba58d08f05125c1, user_id=d1c0575466e44fa4a909b6b0dbc6988a, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:13.710291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c716375-a6e6-471f-adcf-4d5a79df9547 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:13.715608 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cae61-34e9-4418-a7ad-804d9e3fe4f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:13.718609 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cae61-34e9-4418-a7ad-804d9e3fe4f5 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:13.718609 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cae61-34e9-4418-a7ad-804d9e3fe4f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:13.718609 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cae61-34e9-4418-a7ad-804d9e3fe4f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:13.727776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cae61-34e9-4418-a7ad-804d9e3fe4f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:13.729197 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cae61-34e9-4418-a7ad-804d9e3fe4f5 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:13.740621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1011/2012] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:13.741653 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cae61-34e9-4418-a7ad-804d9e3fe4f5 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:13.754163 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cae61-34e9-4418-a7ad-804d9e3fe4f5 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:13.762485 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67a750-66cb-4e40-97f7-618a4f74ac45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:13.763447 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67a750-66cb-4e40-97f7-618a4f74ac45 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:13.765147 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67a750-66cb-4e40-97f7-618a4f74ac45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:13.765147 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67a750-66cb-4e40-97f7-618a4f74ac45 admin admin] PATH_INFO: `/v3/projects/218be21339384d408a00726a53198c41/users/d124899ce94442b6a67265c76b5b7419/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:13.787113 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67a750-66cb-4e40-97f7-618a4f74ac45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=218be21339384d408a00726a53198c41, user_id=d124899ce94442b6a67265c76b5b7419, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:13.789904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67a750-66cb-4e40-97f7-618a4f74ac45 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:13.801310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1002/2013] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:13 2022] PUT /identity/v3/projects/6c07e8136c7a44c38ba58d08f05125c1/users/d1c0575466e44fa4a909b6b0dbc6988a/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:13.801310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c716375-a6e6-471f-adcf-4d5a79df9547 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:13.891050 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1012/2014] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:13 2022] PUT /identity/v3/projects/218be21339384d408a00726a53198c41/users/d124899ce94442b6a67265c76b5b7419/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:13.892962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d551e6-5216-410a-affb-f0753649bc0b None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:13.893207 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d551e6-5216-410a-affb-f0753649bc0b None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:13.893491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d551e6-5216-410a-affb-f0753649bc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:13.906481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c716375-a6e6-471f-adcf-4d5a79df9547 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:13.962257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-d6d551e6-5216-410a-affb-f0753649bc0b None None] MFA Rules not processed for user `d1c0575466e44fa4a909b6b0dbc6988a`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:13.964899 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d6d551e6-5216-410a-affb-f0753649bc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:14.036351 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bdbb7-3e31-4196-877f-b5d06b7b5288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:14.037579 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bdbb7-3e31-4196-877f-b5d06b7b5288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:14.037892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bdbb7-3e31-4196-877f-b5d06b7b5288 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:14.038207 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bdbb7-3e31-4196-877f-b5d06b7b5288 admin admin] PATH_INFO: `/v3/users/1653c7faaea04986b5214a881b628956` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:14.042669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bdbb7-3e31-4196-877f-b5d06b7b5288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1653c7faaea04986b5214a881b628956)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:14.044671 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bdbb7-3e31-4196-877f-b5d06b7b5288 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:14.109578 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1013/2015] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:14.110969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb050d0-5d2e-4632-b7fd-9514dcf2a06e None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:14.111264 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb050d0-5d2e-4632-b7fd-9514dcf2a06e None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:14.111939 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb050d0-5d2e-4632-b7fd-9514dcf2a06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:14.117378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:14.146047 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-fbb050d0-5d2e-4632-b7fd-9514dcf2a06e None None] MFA Rules not processed for user `d124899ce94442b6a67265c76b5b7419`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:14.147324 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-fbb050d0-5d2e-4632-b7fd-9514dcf2a06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:14.220947 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1014/2016] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:14.222359 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb050d0-5d2e-4632-b7fd-9514dcf2a06e None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:14.236514 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb050d0-5d2e-4632-b7fd-9514dcf2a06e None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:14.242108 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d406f5c-bde0-4cc0-80a5-b8bc81936e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:14.245207 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d406f5c-bde0-4cc0-80a5-b8bc81936e1b admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:14.245207 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d406f5c-bde0-4cc0-80a5-b8bc81936e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:14.245207 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d406f5c-bde0-4cc0-80a5-b8bc81936e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:14.245207 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d406f5c-bde0-4cc0-80a5-b8bc81936e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:14.245990 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d406f5c-bde0-4cc0-80a5-b8bc81936e1b admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:14.346312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1015/2017] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:59:14 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:14.348291 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d406f5c-bde0-4cc0-80a5-b8bc81936e1b admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:14.358237 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-ed1bdbb7-3e31-4196-877f-b5d06b7b5288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1653c7faaea04986b5214a881b628956'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:14.371694 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-ed1bdbb7-3e31-4196-877f-b5d06b7b5288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1653c7faaea04986b5214a881b628956'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:14.373187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-ed1bdbb7-3e31-4196-877f-b5d06b7b5288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1653c7faaea04986b5214a881b628956'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:14.420625 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d406f5c-bde0-4cc0-80a5-b8bc81936e1b admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:14.424309 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ffdef-b4c6-4f47-9ba0-5f3cd1cdb821 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:14.424993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ffdef-b4c6-4f47-9ba0-5f3cd1cdb821 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:14.425285 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ffdef-b4c6-4f47-9ba0-5f3cd1cdb821 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:14.425563 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ffdef-b4c6-4f47-9ba0-5f3cd1cdb821 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:14.427381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-162ffdef-b4c6-4f47-9ba0-5f3cd1cdb821 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:14.453558 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-ed1bdbb7-3e31-4196-877f-b5d06b7b5288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1653c7faaea04986b5214a881b628956'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:14.454525 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-ed1bdbb7-3e31-4196-877f-b5d06b7b5288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1653c7faaea04986b5214a881b628956'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:14.478194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1003/2018] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:13 2022] DELETE /identity/v3/users/1653c7faaea04986b5214a881b628956 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:14.479123 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bdbb7-3e31-4196-877f-b5d06b7b5288 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:14.480593 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ed1bdbb7-3e31-4196-877f-b5d06b7b5288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:14.495753 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ffdef-b4c6-4f47-9ba0-5f3cd1cdb821 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:14.497302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ffdef-b4c6-4f47-9ba0-5f3cd1cdb821 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:14.507779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1016/2019] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:14.511397 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d8e72-c75c-4028-97ed-98b6db65a1dd None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:14.511949 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d8e72-c75c-4028-97ed-98b6db65a1dd None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:14.512304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d8e72-c75c-4028-97ed-98b6db65a1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:14.543479 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-cc4d8e72-c75c-4028-97ed-98b6db65a1dd None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:14.544753 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-cc4d8e72-c75c-4028-97ed-98b6db65a1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:14.567183 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bdbb7-3e31-4196-877f-b5d06b7b5288 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:14.575380 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a52f52-ae1c-4f43-ab60-aa021b279610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:14.576090 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a52f52-ae1c-4f43-ab60-aa021b279610 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:14.576412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a52f52-ae1c-4f43-ab60-aa021b279610 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:14.576704 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a52f52-ae1c-4f43-ab60-aa021b279610 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:14.577696 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a52f52-ae1c-4f43-ab60-aa021b279610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:14.579698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a52f52-ae1c-4f43-ab60-aa021b279610 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:14.622560 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1017/2020] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:14.632585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d8e72-c75c-4028-97ed-98b6db65a1dd None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:14.634325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-cc4d8e72-c75c-4028-97ed-98b6db65a1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:14.712673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1004/2021] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:14 2022] POST /identity/v3/users => generated 300 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:14.712882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d8e72-c75c-4028-97ed-98b6db65a1dd None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:14.716189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a52f52-ae1c-4f43-ab60-aa021b279610 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:14.717244 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e0725-f95e-482c-b7d9-80d31b0b40af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:14.718069 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e0725-f95e-482c-b7d9-80d31b0b40af service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:14.718453 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e0725-f95e-482c-b7d9-80d31b0b40af service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:14.718818 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e0725-f95e-482c-b7d9-80d31b0b40af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:14.728982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a52f52-ae1c-4f43-ab60-aa021b279610 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:14.731049 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e0725-f95e-482c-b7d9-80d31b0b40af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:14.732001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e0725-f95e-482c-b7d9-80d31b0b40af service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:14.734110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d026e-c020-410b-8982-8d0ba8c3b20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:14.734871 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d026e-c020-410b-8982-8d0ba8c3b20a admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:14.738145 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d026e-c020-410b-8982-8d0ba8c3b20a admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:14.738145 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d026e-c020-410b-8982-8d0ba8c3b20a admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:14.738145 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d026e-c020-410b-8982-8d0ba8c3b20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:14.738145 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d026e-c020-410b-8982-8d0ba8c3b20a admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:14.743181 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1018/2022] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:59:14.752280 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1005/2023] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:59:14.756407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e0725-f95e-482c-b7d9-80d31b0b40af service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:14.767182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e0725-f95e-482c-b7d9-80d31b0b40af service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:14.777648 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce810484-0360-4813-8001-aa7652dd9fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:14.778587 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce810484-0360-4813-8001-aa7652dd9fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:14.778927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce810484-0360-4813-8001-aa7652dd9fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:14.779225 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce810484-0360-4813-8001-aa7652dd9fe4 admin admin] PATH_INFO: `/v3/projects/846e9dad70d34c12b54ec19b8411f1cc/users/7b6ede6f86154a59a4cbfd7c54d8d913/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:14.797800 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce810484-0360-4813-8001-aa7652dd9fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=846e9dad70d34c12b54ec19b8411f1cc, user_id=7b6ede6f86154a59a4cbfd7c54d8d913, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:14.800157 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce810484-0360-4813-8001-aa7652dd9fe4 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:14.909165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1019/2024] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:14 2022] PUT /identity/v3/projects/846e9dad70d34c12b54ec19b8411f1cc/users/7b6ede6f86154a59a4cbfd7c54d8d913/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:14.911589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d026e-c020-410b-8982-8d0ba8c3b20a admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:14.923801 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d026e-c020-410b-8982-8d0ba8c3b20a admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:15.000853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752058c-b0d0-4c9e-94fa-af20c3c62fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:15.002529 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752058c-b0d0-4c9e-94fa-af20c3c62fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:15.003039 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752058c-b0d0-4c9e-94fa-af20c3c62fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:15.003539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752058c-b0d0-4c9e-94fa-af20c3c62fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:15.005044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752058c-b0d0-4c9e-94fa-af20c3c62fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:15.010116 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752058c-b0d0-4c9e-94fa-af20c3c62fb7 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:15.030065 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1006/2025] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:15.034742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce810484-0360-4813-8001-aa7652dd9fe4 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:15.048474 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce810484-0360-4813-8001-aa7652dd9fe4 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:15.056025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d19d43-e8eb-4035-be8a-ab7d7b7d1b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:15.056972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d19d43-e8eb-4035-be8a-ab7d7b7d1b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:15.057255 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d19d43-e8eb-4035-be8a-ab7d7b7d1b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:15.057531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d19d43-e8eb-4035-be8a-ab7d7b7d1b32 admin admin] PATH_INFO: `/v3/projects/846e9dad70d34c12b54ec19b8411f1cc/users/7b6ede6f86154a59a4cbfd7c54d8d913/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:15.060324 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d19d43-e8eb-4035-be8a-ab7d7b7d1b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=846e9dad70d34c12b54ec19b8411f1cc, user_id=7b6ede6f86154a59a4cbfd7c54d8d913, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:15.063072 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d19d43-e8eb-4035-be8a-ab7d7b7d1b32 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:15.077762 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1020/2026] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:15 2022] PUT /identity/v3/projects/846e9dad70d34c12b54ec19b8411f1cc/users/7b6ede6f86154a59a4cbfd7c54d8d913/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:59:15.089663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106a952-6b7e-4972-9287-b7f8c4e4de37 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:15.090274 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106a952-6b7e-4972-9287-b7f8c4e4de37 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:15.091184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106a952-6b7e-4972-9287-b7f8c4e4de37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:15.178855 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-e106a952-6b7e-4972-9287-b7f8c4e4de37 None None] MFA Rules not processed for user `7b6ede6f86154a59a4cbfd7c54d8d913`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:15.181180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e106a952-6b7e-4972-9287-b7f8c4e4de37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:15.248344 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d19d43-e8eb-4035-be8a-ab7d7b7d1b32 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:15.251483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-80d19d43-e8eb-4035-be8a-ab7d7b7d1b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:15.315898 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1007/2027] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:15.370353 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d19d43-e8eb-4035-be8a-ab7d7b7d1b32 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:15.372771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106a952-6b7e-4972-9287-b7f8c4e4de37 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:15.374757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e106a952-6b7e-4972-9287-b7f8c4e4de37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:15.390083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9b797-30ae-4b0f-847e-1fedaa4b40f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:15.391185 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9b797-30ae-4b0f-847e-1fedaa4b40f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:15.391598 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9b797-30ae-4b0f-847e-1fedaa4b40f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:15.391978 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9b797-30ae-4b0f-847e-1fedaa4b40f8 admin admin] PATH_INFO: `/v3/projects/7a533999f5194403b2fbd51d6074a541` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:15.393553 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9b797-30ae-4b0f-847e-1fedaa4b40f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a533999f5194403b2fbd51d6074a541)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:15.407445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9b797-30ae-4b0f-847e-1fedaa4b40f8 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:15.464270 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106a952-6b7e-4972-9287-b7f8c4e4de37 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:15.469249 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a838530-67e8-48fb-9d99-25b3e05cd0d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:15.470291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a838530-67e8-48fb-9d99-25b3e05cd0d6 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:15.470486 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a838530-67e8-48fb-9d99-25b3e05cd0d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:15.470744 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a838530-67e8-48fb-9d99-25b3e05cd0d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:15.485896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a838530-67e8-48fb-9d99-25b3e05cd0d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:15.487715 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a838530-67e8-48fb-9d99-25b3e05cd0d6 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:15.498125 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1008/2028] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:59:15.551612 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-39f9b797-30ae-4b0f-847e-1fedaa4b40f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a533999f5194403b2fbd51d6074a541', 'request_id': 'req-39f9b797-30ae-4b0f-847e-1fedaa4b40f8'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:15.558417 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-39f9b797-30ae-4b0f-847e-1fedaa4b40f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a533999f5194403b2fbd51d6074a541', 'request_id': 'req-39f9b797-30ae-4b0f-847e-1fedaa4b40f8'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:15.631600 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-39f9b797-30ae-4b0f-847e-1fedaa4b40f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a533999f5194403b2fbd51d6074a541', 'request_id': 'req-39f9b797-30ae-4b0f-847e-1fedaa4b40f8'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:15.645027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-39f9b797-30ae-4b0f-847e-1fedaa4b40f8 admin admin] The token cache is being invalidate because project 7a533999f5194403b2fbd51d6074a541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:15.645027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-39f9b797-30ae-4b0f-847e-1fedaa4b40f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:15.645509 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-39f9b797-30ae-4b0f-847e-1fedaa4b40f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:15.647221 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1021/2029] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:15 2022] DELETE /identity/v3/projects/7a533999f5194403b2fbd51d6074a541 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:15.651256 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a838530-67e8-48fb-9d99-25b3e05cd0d6 service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:15.662101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a838530-67e8-48fb-9d99-25b3e05cd0d6 service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:15.722811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76506c58-f303-4816-a852-30b3daaa2905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:15.723672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76506c58-f303-4816-a852-30b3daaa2905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:15.723952 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76506c58-f303-4816-a852-30b3daaa2905 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:15.724230 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76506c58-f303-4816-a852-30b3daaa2905 admin admin] PATH_INFO: `/v3/users/13d168b8dbb94ca8a28715e334ca29dc` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:15.728385 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76506c58-f303-4816-a852-30b3daaa2905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13d168b8dbb94ca8a28715e334ca29dc)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:15.730446 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76506c58-f303-4816-a852-30b3daaa2905 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:15.871331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:15.965398 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-76506c58-f303-4816-a852-30b3daaa2905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13d168b8dbb94ca8a28715e334ca29dc'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:15.972302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-76506c58-f303-4816-a852-30b3daaa2905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13d168b8dbb94ca8a28715e334ca29dc'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:15.973019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-76506c58-f303-4816-a852-30b3daaa2905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13d168b8dbb94ca8a28715e334ca29dc'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:16.036266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-76506c58-f303-4816-a852-30b3daaa2905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13d168b8dbb94ca8a28715e334ca29dc'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:16.037336 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-76506c58-f303-4816-a852-30b3daaa2905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13d168b8dbb94ca8a28715e334ca29dc'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:16.059100 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1009/2030] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:15 2022] DELETE /identity/v3/users/13d168b8dbb94ca8a28715e334ca29dc => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:16.332445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:16.556004 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9b797-30ae-4b0f-847e-1fedaa4b40f8 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:16.567626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-39f9b797-30ae-4b0f-847e-1fedaa4b40f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:16.601940 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9b797-30ae-4b0f-847e-1fedaa4b40f8 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:16.673895 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926171c9-7d2a-46e1-81be-a03b5ac72ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:16.674775 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926171c9-7d2a-46e1-81be-a03b5ac72ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:16.675058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926171c9-7d2a-46e1-81be-a03b5ac72ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:16.675335 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926171c9-7d2a-46e1-81be-a03b5ac72ff7 admin admin] PATH_INFO: `/v3/projects/137912d614db45679dcf10dc69f2daab` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:16.676547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926171c9-7d2a-46e1-81be-a03b5ac72ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=137912d614db45679dcf10dc69f2daab)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:16.678515 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926171c9-7d2a-46e1-81be-a03b5ac72ff7 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:16.791804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-926171c9-7d2a-46e1-81be-a03b5ac72ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '137912d614db45679dcf10dc69f2daab', 'request_id': 'req-926171c9-7d2a-46e1-81be-a03b5ac72ff7'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:16.797198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-926171c9-7d2a-46e1-81be-a03b5ac72ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '137912d614db45679dcf10dc69f2daab', 'request_id': 'req-926171c9-7d2a-46e1-81be-a03b5ac72ff7'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:16.916629 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-926171c9-7d2a-46e1-81be-a03b5ac72ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '137912d614db45679dcf10dc69f2daab', 'request_id': 'req-926171c9-7d2a-46e1-81be-a03b5ac72ff7'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:16.933445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-926171c9-7d2a-46e1-81be-a03b5ac72ff7 admin admin] The token cache is being invalidate because project 137912d614db45679dcf10dc69f2daab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:16.933744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-926171c9-7d2a-46e1-81be-a03b5ac72ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:16.934465 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-926171c9-7d2a-46e1-81be-a03b5ac72ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:16.936081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1022/2031] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:16 2022] DELETE /identity/v3/projects/137912d614db45679dcf10dc69f2daab => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:16.941407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3887068-fe3a-4eb5-aa23-a018d10ebccc None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:16.941919 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3887068-fe3a-4eb5-aa23-a018d10ebccc None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:16.942117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3887068-fe3a-4eb5-aa23-a018d10ebccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:16.968017 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-e3887068-fe3a-4eb5-aa23-a018d10ebccc None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:16.969415 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e3887068-fe3a-4eb5-aa23-a018d10ebccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:17.046689 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1010/2032] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:17.048365 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b4edf-81ba-4efc-86ce-9008e4f093c9 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:17.048754 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b4edf-81ba-4efc-86ce-9008e4f093c9 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:17.058390 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b4edf-81ba-4efc-86ce-9008e4f093c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:17.076542 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-e28b4edf-81ba-4efc-86ce-9008e4f093c9 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:17.078380 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e28b4edf-81ba-4efc-86ce-9008e4f093c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:17.097610 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1023/2033] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:17.099101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3887068-fe3a-4eb5-aa23-a018d10ebccc None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:17.115741 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3887068-fe3a-4eb5-aa23-a018d10ebccc None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:17.122472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dcff21-d7fc-4279-a1a2-ff70dcc320d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:17.123840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcff21-d7fc-4279-a1a2-ff70dcc320d7 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:17.124126 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcff21-d7fc-4279-a1a2-ff70dcc320d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:17.124442 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcff21-d7fc-4279-a1a2-ff70dcc320d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:17.125224 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dcff21-d7fc-4279-a1a2-ff70dcc320d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:59:17.125677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dcff21-d7fc-4279-a1a2-ff70dcc320d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:17.127902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dcff21-d7fc-4279-a1a2-ff70dcc320d7 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:17.144395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1011/2034] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:59:17.149033 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b4edf-81ba-4efc-86ce-9008e4f093c9 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:17.159366 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b4edf-81ba-4efc-86ce-9008e4f093c9 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:17.164412 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b37ccf-2ce6-44f9-b88a-da7f5535dc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:17.165119 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b37ccf-2ce6-44f9-b88a-da7f5535dc2d admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:17.165400 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b37ccf-2ce6-44f9-b88a-da7f5535dc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:17.165671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b37ccf-2ce6-44f9-b88a-da7f5535dc2d admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:17.166370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b37ccf-2ce6-44f9-b88a-da7f5535dc2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:17.168340 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b37ccf-2ce6-44f9-b88a-da7f5535dc2d admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:17.361915 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1024/2035] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:59:17 2022] POST /identity/v3/projects => generated 383 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:59:17.366259 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dcff21-d7fc-4279-a1a2-ff70dcc320d7 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:17.377797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dcff21-d7fc-4279-a1a2-ff70dcc320d7 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:17.412438 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b37ccf-2ce6-44f9-b88a-da7f5535dc2d admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:17.415430 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-68b37ccf-2ce6-44f9-b88a-da7f5535dc2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:17.447935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d103c4c-4f2e-4fa4-87b4-af312ccde7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:17.448626 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d103c4c-4f2e-4fa4-87b4-af312ccde7db admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:17.448941 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d103c4c-4f2e-4fa4-87b4-af312ccde7db admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:17.449214 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d103c4c-4f2e-4fa4-87b4-af312ccde7db admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:17.449907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d103c4c-4f2e-4fa4-87b4-af312ccde7db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:17.451951 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d103c4c-4f2e-4fa4-87b4-af312ccde7db admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:17.495201 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b37ccf-2ce6-44f9-b88a-da7f5535dc2d admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:17.500111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e4870-d0cd-4d8d-8c55-88496460bbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:17.501029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e4870-d0cd-4d8d-8c55-88496460bbe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:17.501315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e4870-d0cd-4d8d-8c55-88496460bbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:17.501592 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e4870-d0cd-4d8d-8c55-88496460bbe2 admin admin] PATH_INFO: `/v3/users/d1c0575466e44fa4a909b6b0dbc6988a` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:17.502830 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e4870-d0cd-4d8d-8c55-88496460bbe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c0575466e44fa4a909b6b0dbc6988a)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:17.504810 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e4870-d0cd-4d8d-8c55-88496460bbe2 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:17.556351 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1012/2036] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:17 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:17.561182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d103c4c-4f2e-4fa4-87b4-af312ccde7db admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:17.572066 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d103c4c-4f2e-4fa4-87b4-af312ccde7db admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:17.577176 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff4911-0cd6-49b3-b459-bcd5eb9675a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:17.577868 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff4911-0cd6-49b3-b459-bcd5eb9675a8 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:17.578150 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff4911-0cd6-49b3-b459-bcd5eb9675a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:17.578459 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff4911-0cd6-49b3-b459-bcd5eb9675a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:17.579191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff4911-0cd6-49b3-b459-bcd5eb9675a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:17.580889 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff4911-0cd6-49b3-b459-bcd5eb9675a8 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:17.591253 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1013/2037] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:59:17.595238 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff4911-0cd6-49b3-b459-bcd5eb9675a8 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:17.610483 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff4911-0cd6-49b3-b459-bcd5eb9675a8 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:17.618661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c73be8-4385-470f-8433-f6acdcdd7e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:17.619551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c73be8-4385-470f-8433-f6acdcdd7e6a admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:17.619858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c73be8-4385-470f-8433-f6acdcdd7e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:17.620184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c73be8-4385-470f-8433-f6acdcdd7e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:17.620923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c73be8-4385-470f-8433-f6acdcdd7e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:17.622582 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c73be8-4385-470f-8433-f6acdcdd7e6a admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:17.635660 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1014/2038] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:59:17.639760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c73be8-4385-470f-8433-f6acdcdd7e6a admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:17.650744 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c73be8-4385-470f-8433-f6acdcdd7e6a admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:17.658714 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bde58-6a27-4792-a15c-68ec009cb4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:17.658714 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bde58-6a27-4792-a15c-68ec009cb4b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:17.658714 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bde58-6a27-4792-a15c-68ec009cb4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:17.658714 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bde58-6a27-4792-a15c-68ec009cb4b0 admin admin] PATH_INFO: `/v3/projects/cbbcbbc639164da7be53dc0842edbe8d/users/2eea1bca1b824c359d82cd145e9dbb0c/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:17.673901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bde58-6a27-4792-a15c-68ec009cb4b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbbcbbc639164da7be53dc0842edbe8d, user_id=2eea1bca1b824c359d82cd145e9dbb0c, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:17.682321 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bde58-6a27-4792-a15c-68ec009cb4b0 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:17.743357 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-256e4870-d0cd-4d8d-8c55-88496460bbe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c0575466e44fa4a909b6b0dbc6988a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:17.755003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-256e4870-d0cd-4d8d-8c55-88496460bbe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c0575466e44fa4a909b6b0dbc6988a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:17.764672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1015/2039] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:17 2022] PUT /identity/v3/projects/cbbcbbc639164da7be53dc0842edbe8d/users/2eea1bca1b824c359d82cd145e9dbb0c/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:59:17.767519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6b8a6-4f3a-4695-a35e-69149477f688 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:17.770411 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6b8a6-4f3a-4695-a35e-69149477f688 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:17.770411 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6b8a6-4f3a-4695-a35e-69149477f688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:17.798934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-67a6b8a6-4f3a-4695-a35e-69149477f688 None None] MFA Rules not processed for user `2eea1bca1b824c359d82cd145e9dbb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:17.800176 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-67a6b8a6-4f3a-4695-a35e-69149477f688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:17.859766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-256e4870-d0cd-4d8d-8c55-88496460bbe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c0575466e44fa4a909b6b0dbc6988a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:17.860828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-256e4870-d0cd-4d8d-8c55-88496460bbe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c0575466e44fa4a909b6b0dbc6988a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:17.861474 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-256e4870-d0cd-4d8d-8c55-88496460bbe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c0575466e44fa4a909b6b0dbc6988a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:17.876181 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1016/2040] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:59:17.880755 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6b8a6-4f3a-4695-a35e-69149477f688 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:17.898636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1025/2041] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:17 2022] DELETE /identity/v3/users/d1c0575466e44fa4a909b6b0dbc6988a => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:17.901746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffc61b-e575-4681-9f00-f1730dcc47a7 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:17.902214 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffc61b-e575-4681-9f00-f1730dcc47a7 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:17.902724 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffc61b-e575-4681-9f00-f1730dcc47a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:17.930169 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-c4ffc61b-e575-4681-9f00-f1730dcc47a7 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:17.931407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c4ffc61b-e575-4681-9f00-f1730dcc47a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:17.951282 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6b8a6-4f3a-4695-a35e-69149477f688 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:17.993684 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1026/2042] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:18.004506 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffc61b-e575-4681-9f00-f1730dcc47a7 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:18.008755 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c4ffc61b-e575-4681-9f00-f1730dcc47a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:18.011300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde1877-c59d-471f-b57b-261f775433df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:18.011996 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde1877-c59d-471f-b57b-261f775433df admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:18.012280 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde1877-c59d-471f-b57b-261f775433df admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:18.012553 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde1877-c59d-471f-b57b-261f775433df admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:18.013300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde1877-c59d-471f-b57b-261f775433df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:18.015257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde1877-c59d-471f-b57b-261f775433df admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:18.040775 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:18.071523 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffc61b-e575-4681-9f00-f1730dcc47a7 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:18.075225 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4fb70-b5a0-4cea-aeb0-dcd306b16fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:18.075879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4fb70-b5a0-4cea-aeb0-dcd306b16fae service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:18.076165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4fb70-b5a0-4cea-aeb0-dcd306b16fae service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:18.076441 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4fb70-b5a0-4cea-aeb0-dcd306b16fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:18.086032 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4fb70-b5a0-4cea-aeb0-dcd306b16fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:18.087450 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4fb70-b5a0-4cea-aeb0-dcd306b16fae service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:18.097410 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1027/2043] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:18.128214 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1017/2044] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:59:17 2022] POST /identity/v3/projects => generated 381 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:59:18.129551 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4fb70-b5a0-4cea-aeb0-dcd306b16fae service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:18.131115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-02b4fb70-b5a0-4cea-aeb0-dcd306b16fae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:18.145037 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4fb70-b5a0-4cea-aeb0-dcd306b16fae service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:18.228279 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dddee-962e-456d-9afd-1e57e94c863f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:18.229008 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dddee-962e-456d-9afd-1e57e94c863f admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:18.229295 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dddee-962e-456d-9afd-1e57e94c863f admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:18.229575 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dddee-962e-456d-9afd-1e57e94c863f admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:18.230285 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547dddee-962e-456d-9afd-1e57e94c863f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:18.232223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547dddee-962e-456d-9afd-1e57e94c863f admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:18.415224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1028/2045] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:18 2022] POST /identity/v3/users => generated 297 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:18.419094 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde1877-c59d-471f-b57b-261f775433df admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:18.430772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde1877-c59d-471f-b57b-261f775433df admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:18.443288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e9387-7580-4b40-814c-0c19a877dfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:18.450676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e9387-7580-4b40-814c-0c19a877dfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:18.450676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e9387-7580-4b40-814c-0c19a877dfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:18.450676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e9387-7580-4b40-814c-0c19a877dfd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:18.450676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e9387-7580-4b40-814c-0c19a877dfd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:18.450676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e9387-7580-4b40-814c-0c19a877dfd1 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:18.461651 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1018/2046] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:18.466030 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dddee-962e-456d-9afd-1e57e94c863f admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:18.477796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dddee-962e-456d-9afd-1e57e94c863f admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:18.484295 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29b4ea-a242-4d14-b6ac-548b2c90288e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:18.485341 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29b4ea-a242-4d14-b6ac-548b2c90288e admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:18.485748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29b4ea-a242-4d14-b6ac-548b2c90288e admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:18.486127 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29b4ea-a242-4d14-b6ac-548b2c90288e admin admin] PATH_INFO: `/v3/projects/8739949b8b114df6841ed0424d2d1ab3/users/d1cc0b6503ac41338f5308a95b3ae6f9/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:18.501528 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:18.504533 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29b4ea-a242-4d14-b6ac-548b2c90288e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8739949b8b114df6841ed0424d2d1ab3, user_id=d1cc0b6503ac41338f5308a95b3ae6f9, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:18.517582 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29b4ea-a242-4d14-b6ac-548b2c90288e admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:18.959516 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1029/2047] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:18 2022] PUT /identity/v3/projects/8739949b8b114df6841ed0424d2d1ab3/users/d1cc0b6503ac41338f5308a95b3ae6f9/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:59:18.964977 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e9387-7580-4b40-814c-0c19a877dfd1 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:18.975361 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e9387-7580-4b40-814c-0c19a877dfd1 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:18.994989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29b4ea-a242-4d14-b6ac-548b2c90288e admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:18.997149 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-3e29b4ea-a242-4d14-b6ac-548b2c90288e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:19.060302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bce3c0-acae-44f6-81e5-e694cdfaff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:19.061531 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bce3c0-acae-44f6-81e5-e694cdfaff19 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:19.063629 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bce3c0-acae-44f6-81e5-e694cdfaff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:19.064022 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bce3c0-acae-44f6-81e5-e694cdfaff19 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:19.066366 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bce3c0-acae-44f6-81e5-e694cdfaff19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:19.068597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bce3c0-acae-44f6-81e5-e694cdfaff19 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:19.094231 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1019/2048] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:19.098445 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bce3c0-acae-44f6-81e5-e694cdfaff19 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:19.112292 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bce3c0-acae-44f6-81e5-e694cdfaff19 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:19.121526 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382ee95-4af6-41a4-be77-1ee6aa31575e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:19.121526 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382ee95-4af6-41a4-be77-1ee6aa31575e admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:19.121741 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382ee95-4af6-41a4-be77-1ee6aa31575e admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:19.122126 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382ee95-4af6-41a4-be77-1ee6aa31575e admin admin] PATH_INFO: `/v3/projects/8739949b8b114df6841ed0424d2d1ab3/users/d1cc0b6503ac41338f5308a95b3ae6f9/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:19.125485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382ee95-4af6-41a4-be77-1ee6aa31575e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8739949b8b114df6841ed0424d2d1ab3, user_id=d1cc0b6503ac41338f5308a95b3ae6f9, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:19.128513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382ee95-4af6-41a4-be77-1ee6aa31575e admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:19.167623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29b4ea-a242-4d14-b6ac-548b2c90288e admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:19.174927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae0bfc-8ec2-49b8-a284-d9ec8922351e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:19.176370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae0bfc-8ec2-49b8-a284-d9ec8922351e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:19.176906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae0bfc-8ec2-49b8-a284-d9ec8922351e admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:19.177515 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae0bfc-8ec2-49b8-a284-d9ec8922351e admin admin] PATH_INFO: `/v3/projects/6c07e8136c7a44c38ba58d08f05125c1` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:19.180378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae0bfc-8ec2-49b8-a284-d9ec8922351e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c07e8136c7a44c38ba58d08f05125c1)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:19.182674 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae0bfc-8ec2-49b8-a284-d9ec8922351e admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:19.237422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1020/2049] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:19 2022] PUT /identity/v3/projects/8739949b8b114df6841ed0424d2d1ab3/users/d1cc0b6503ac41338f5308a95b3ae6f9/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:19.249248 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9acf9-fa22-48cb-8132-48cb7b76ad67 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:19.249772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9acf9-fa22-48cb-8132-48cb7b76ad67 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:19.250270 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9acf9-fa22-48cb-8132-48cb7b76ad67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:19.301432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-97a9acf9-fa22-48cb-8132-48cb7b76ad67 None None] MFA Rules not processed for user `d1cc0b6503ac41338f5308a95b3ae6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:19.302599 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-97a9acf9-fa22-48cb-8132-48cb7b76ad67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:19.340960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d6ae0bfc-8ec2-49b8-a284-d9ec8922351e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c07e8136c7a44c38ba58d08f05125c1', 'request_id': 'req-d6ae0bfc-8ec2-49b8-a284-d9ec8922351e'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:19.352483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d6ae0bfc-8ec2-49b8-a284-d9ec8922351e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c07e8136c7a44c38ba58d08f05125c1', 'request_id': 'req-d6ae0bfc-8ec2-49b8-a284-d9ec8922351e'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:19.393260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1021/2050] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:19.405593 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9acf9-fa22-48cb-8132-48cb7b76ad67 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:19.407065 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-97a9acf9-fa22-48cb-8132-48cb7b76ad67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:19.453705 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d6ae0bfc-8ec2-49b8-a284-d9ec8922351e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c07e8136c7a44c38ba58d08f05125c1', 'request_id': 'req-d6ae0bfc-8ec2-49b8-a284-d9ec8922351e'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:19.469697 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d6ae0bfc-8ec2-49b8-a284-d9ec8922351e admin admin] The token cache is being invalidate because project 6c07e8136c7a44c38ba58d08f05125c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:19.470348 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d6ae0bfc-8ec2-49b8-a284-d9ec8922351e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:19.471394 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d6ae0bfc-8ec2-49b8-a284-d9ec8922351e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:19.474320 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1030/2051] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:18 2022] DELETE /identity/v3/projects/6c07e8136c7a44c38ba58d08f05125c1 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:59:19.479849 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae0bfc-8ec2-49b8-a284-d9ec8922351e admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:19.482572 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d6ae0bfc-8ec2-49b8-a284-d9ec8922351e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:19.484179 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9acf9-fa22-48cb-8132-48cb7b76ad67 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:19.547497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87786575-c998-405c-a4d8-23380994ac66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:19.548312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87786575-c998-405c-a4d8-23380994ac66 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:19.548600 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87786575-c998-405c-a4d8-23380994ac66 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:19.548943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87786575-c998-405c-a4d8-23380994ac66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:19.551333 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-87786575-c998-405c-a4d8-23380994ac66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:19.562969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae0bfc-8ec2-49b8-a284-d9ec8922351e admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:19.573718 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726c545-9db2-4356-9334-5d1c24e51af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:19.574309 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726c545-9db2-4356-9334-5d1c24e51af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:19.574612 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726c545-9db2-4356-9334-5d1c24e51af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:19.574896 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726c545-9db2-4356-9334-5d1c24e51af2 admin admin] PATH_INFO: `/v3/users/7b6ede6f86154a59a4cbfd7c54d8d913` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:19.576420 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726c545-9db2-4356-9334-5d1c24e51af2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b6ede6f86154a59a4cbfd7c54d8d913)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:19.578623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726c545-9db2-4356-9334-5d1c24e51af2 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:19.650630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87786575-c998-405c-a4d8-23380994ac66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:19.652108 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87786575-c998-405c-a4d8-23380994ac66 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:19.668365 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1022/2052] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:59:19.813339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6726c545-9db2-4356-9334-5d1c24e51af2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b6ede6f86154a59a4cbfd7c54d8d913'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:19.821099 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6726c545-9db2-4356-9334-5d1c24e51af2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b6ede6f86154a59a4cbfd7c54d8d913'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:19.846018 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87786575-c998-405c-a4d8-23380994ac66 service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:19.847998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-87786575-c998-405c-a4d8-23380994ac66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:19.862935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87786575-c998-405c-a4d8-23380994ac66 service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:19.868895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ed04b-7fbb-42d6-a358-d8b13f50bb16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:19.868895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ed04b-7fbb-42d6-a358-d8b13f50bb16 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:19.868895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ed04b-7fbb-42d6-a358-d8b13f50bb16 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:19.868895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ed04b-7fbb-42d6-a358-d8b13f50bb16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:19.870318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-515ed04b-7fbb-42d6-a358-d8b13f50bb16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:19.888040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6726c545-9db2-4356-9334-5d1c24e51af2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b6ede6f86154a59a4cbfd7c54d8d913'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:19.890575 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6726c545-9db2-4356-9334-5d1c24e51af2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b6ede6f86154a59a4cbfd7c54d8d913'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:19.892651 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6726c545-9db2-4356-9334-5d1c24e51af2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b6ede6f86154a59a4cbfd7c54d8d913'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:19.927831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1031/2053] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:19 2022] DELETE /identity/v3/users/7b6ede6f86154a59a4cbfd7c54d8d913 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:59:19.969344 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ed04b-7fbb-42d6-a358-d8b13f50bb16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:19.970996 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ed04b-7fbb-42d6-a358-d8b13f50bb16 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:19.983976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1023/2054] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:59:20.022757 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:20.343426 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:20.725747 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726c545-9db2-4356-9334-5d1c24e51af2 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:20.725747 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6726c545-9db2-4356-9334-5d1c24e51af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:20.795186 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726c545-9db2-4356-9334-5d1c24e51af2 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:20.799959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48b211-d8bc-40e6-9444-baa38232317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:20.800869 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48b211-d8bc-40e6-9444-baa38232317a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:20.801151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48b211-d8bc-40e6-9444-baa38232317a admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:20.801427 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48b211-d8bc-40e6-9444-baa38232317a admin admin] PATH_INFO: `/v3/users/2eea1bca1b824c359d82cd145e9dbb0c` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:20.802698 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48b211-d8bc-40e6-9444-baa38232317a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eea1bca1b824c359d82cd145e9dbb0c)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:20.805205 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48b211-d8bc-40e6-9444-baa38232317a admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:20.817927 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ed04b-7fbb-42d6-a358-d8b13f50bb16 service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:20.829904 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ed04b-7fbb-42d6-a358-d8b13f50bb16 service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:20.841019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ef9ab-bde4-47a1-8369-4270d826c2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:20.852164 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ef9ab-bde4-47a1-8369-4270d826c2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:20.852164 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ef9ab-bde4-47a1-8369-4270d826c2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:20.852164 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ef9ab-bde4-47a1-8369-4270d826c2e1 admin admin] PATH_INFO: `/v3/projects/846e9dad70d34c12b54ec19b8411f1cc` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:20.852164 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ef9ab-bde4-47a1-8369-4270d826c2e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=846e9dad70d34c12b54ec19b8411f1cc)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:20.852164 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ef9ab-bde4-47a1-8369-4270d826c2e1 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:21.086533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c42ef9ab-bde4-47a1-8369-4270d826c2e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '846e9dad70d34c12b54ec19b8411f1cc', 'request_id': 'req-c42ef9ab-bde4-47a1-8369-4270d826c2e1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:21.089204 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ba48b211-d8bc-40e6-9444-baa38232317a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eea1bca1b824c359d82cd145e9dbb0c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:21.099139 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ba48b211-d8bc-40e6-9444-baa38232317a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eea1bca1b824c359d82cd145e9dbb0c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:21.215175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c42ef9ab-bde4-47a1-8369-4270d826c2e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '846e9dad70d34c12b54ec19b8411f1cc', 'request_id': 'req-c42ef9ab-bde4-47a1-8369-4270d826c2e1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:21.222152 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c42ef9ab-bde4-47a1-8369-4270d826c2e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '846e9dad70d34c12b54ec19b8411f1cc', 'request_id': 'req-c42ef9ab-bde4-47a1-8369-4270d826c2e1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:21.237194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c42ef9ab-bde4-47a1-8369-4270d826c2e1 admin admin] The token cache is being invalidate because project 846e9dad70d34c12b54ec19b8411f1cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:21.237495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c42ef9ab-bde4-47a1-8369-4270d826c2e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:21.240930 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c42ef9ab-bde4-47a1-8369-4270d826c2e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:21.240930 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1024/2055] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:20 2022] DELETE /identity/v3/projects/846e9dad70d34c12b54ec19b8411f1cc => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:21.242776 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ef9ab-bde4-47a1-8369-4270d826c2e1 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:21.246875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c42ef9ab-bde4-47a1-8369-4270d826c2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:21.317112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ba48b211-d8bc-40e6-9444-baa38232317a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eea1bca1b824c359d82cd145e9dbb0c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:21.317779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ba48b211-d8bc-40e6-9444-baa38232317a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eea1bca1b824c359d82cd145e9dbb0c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:21.318401 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ba48b211-d8bc-40e6-9444-baa38232317a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eea1bca1b824c359d82cd145e9dbb0c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:21.327390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ef9ab-bde4-47a1-8369-4270d826c2e1 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:21.333196 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113cc9b-e35d-4c2d-b764-2e346dd3cd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:21.334102 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113cc9b-e35d-4c2d-b764-2e346dd3cd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:21.334388 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113cc9b-e35d-4c2d-b764-2e346dd3cd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:21.334669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113cc9b-e35d-4c2d-b764-2e346dd3cd99 admin admin] PATH_INFO: `/v3/users/9b5d4f7e3323441798c12711448557c3` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:21.336789 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113cc9b-e35d-4c2d-b764-2e346dd3cd99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b5d4f7e3323441798c12711448557c3)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:21.338830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113cc9b-e35d-4c2d-b764-2e346dd3cd99 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:21.350929 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1032/2056] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:20 2022] DELETE /identity/v3/users/2eea1bca1b824c359d82cd145e9dbb0c => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:21.357733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769b485-e485-4660-ae30-08bbfb867528 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:21.358033 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769b485-e485-4660-ae30-08bbfb867528 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:21.358316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769b485-e485-4660-ae30-08bbfb867528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:21.385179 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-a769b485-e485-4660-ae30-08bbfb867528 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:21.387337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-a769b485-e485-4660-ae30-08bbfb867528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:21.470790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1033/2057] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:21.472164 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a8a94-1569-470c-a83e-621f0e5e1466 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:21.472460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a8a94-1569-470c-a83e-621f0e5e1466 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:21.472776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a8a94-1569-470c-a83e-621f0e5e1466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:21.492358 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-8a7a8a94-1569-470c-a83e-621f0e5e1466 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:21.493662 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-8a7a8a94-1569-470c-a83e-621f0e5e1466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:21.502151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1034/2058] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:21.503452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d1ea-407f-4b97-8c39-0539356f0566 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:21.503748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d1ea-407f-4b97-8c39-0539356f0566 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:21.504029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d1ea-407f-4b97-8c39-0539356f0566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:21.526554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-2b57d1ea-407f-4b97-8c39-0539356f0566 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:21.528021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-2b57d1ea-407f-4b97-8c39-0539356f0566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:21.543743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1035/2059] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:21.544850 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57d1ea-407f-4b97-8c39-0539356f0566 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:21.548874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-2b57d1ea-407f-4b97-8c39-0539356f0566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:21.584747 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6113cc9b-e35d-4c2d-b764-2e346dd3cd99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b5d4f7e3323441798c12711448557c3'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:21.595141 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6113cc9b-e35d-4c2d-b764-2e346dd3cd99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b5d4f7e3323441798c12711448557c3'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:21.596160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6113cc9b-e35d-4c2d-b764-2e346dd3cd99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b5d4f7e3323441798c12711448557c3'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:21.646466 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57d1ea-407f-4b97-8c39-0539356f0566 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:21.653228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466d719-8b03-4768-966f-e319de48428f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:21.653925 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466d719-8b03-4768-966f-e319de48428f service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:21.654270 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466d719-8b03-4768-966f-e319de48428f service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:21.654514 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466d719-8b03-4768-966f-e319de48428f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:21.656742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d466d719-8b03-4768-966f-e319de48428f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:21.674448 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466d719-8b03-4768-966f-e319de48428f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:21.675942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466d719-8b03-4768-966f-e319de48428f service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:21.686519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6113cc9b-e35d-4c2d-b764-2e346dd3cd99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b5d4f7e3323441798c12711448557c3'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:21.687428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6113cc9b-e35d-4c2d-b764-2e346dd3cd99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b5d4f7e3323441798c12711448557c3'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:21.688578 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1036/2060] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:21.689477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466d719-8b03-4768-966f-e319de48428f service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:21.690949 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d466d719-8b03-4768-966f-e319de48428f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:21.707644 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466d719-8b03-4768-966f-e319de48428f service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:21.713281 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfe6d6-c70e-48ed-99bd-70e89855303a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:21.713967 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfe6d6-c70e-48ed-99bd-70e89855303a admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:21.714362 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfe6d6-c70e-48ed-99bd-70e89855303a admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:21.714708 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfe6d6-c70e-48ed-99bd-70e89855303a admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:21.715708 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1025/2061] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:21 2022] DELETE /identity/v3/users/9b5d4f7e3323441798c12711448557c3 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:21.715833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfe6d6-c70e-48ed-99bd-70e89855303a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:59:21.716008 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfe6d6-c70e-48ed-99bd-70e89855303a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:21.718815 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfe6d6-c70e-48ed-99bd-70e89855303a admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:21.721454 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9ed4a-c7ba-4b71-8b5a-14cd09c47f32 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:21.721760 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9ed4a-c7ba-4b71-8b5a-14cd09c47f32 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:21.722034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9ed4a-c7ba-4b71-8b5a-14cd09c47f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:21.737437 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1037/2062] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:59:21.741057 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfe6d6-c70e-48ed-99bd-70e89855303a admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:21.755815 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfe6d6-c70e-48ed-99bd-70e89855303a admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:21.764578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-11b9ed4a-c7ba-4b71-8b5a-14cd09c47f32 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:21.766406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-11b9ed4a-c7ba-4b71-8b5a-14cd09c47f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:21.843874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9341d-b04f-4652-b07a-bf8dd10604f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:21.844960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9341d-b04f-4652-b07a-bf8dd10604f2 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:21.845801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9341d-b04f-4652-b07a-bf8dd10604f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:21.846241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9341d-b04f-4652-b07a-bf8dd10604f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:21.847373 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9341d-b04f-4652-b07a-bf8dd10604f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:21.851730 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9341d-b04f-4652-b07a-bf8dd10604f2 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:21.868844 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1026/2063] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:21.873867 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9ed4a-c7ba-4b71-8b5a-14cd09c47f32 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:21.875712 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-11b9ed4a-c7ba-4b71-8b5a-14cd09c47f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:21.963146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9ed4a-c7ba-4b71-8b5a-14cd09c47f32 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:21.967845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535c2ad-e3ed-47a1-b065-52d9beb5573c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:21.969177 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535c2ad-e3ed-47a1-b065-52d9beb5573c service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:21.969661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535c2ad-e3ed-47a1-b065-52d9beb5573c service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:21.970172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535c2ad-e3ed-47a1-b065-52d9beb5573c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:21.986067 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535c2ad-e3ed-47a1-b065-52d9beb5573c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:21.990272 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1038/2064] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:59:21 2022] POST /identity/v3/projects => generated 373 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:59:21.992208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9341d-b04f-4652-b07a-bf8dd10604f2 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:21.994936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535c2ad-e3ed-47a1-b065-52d9beb5573c service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:22.028059 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1027/2065] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:59:22.042894 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:22.125666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9341d-b04f-4652-b07a-bf8dd10604f2 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:22.132732 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554ea94-6a6f-4ae6-92a4-ef02fd4cb938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:22.133909 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554ea94-6a6f-4ae6-92a4-ef02fd4cb938 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:22.134859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554ea94-6a6f-4ae6-92a4-ef02fd4cb938 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:22.134859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554ea94-6a6f-4ae6-92a4-ef02fd4cb938 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:22.135508 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554ea94-6a6f-4ae6-92a4-ef02fd4cb938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:22.137491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554ea94-6a6f-4ae6-92a4-ef02fd4cb938 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:22.240596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1039/2066] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:21 2022] POST /identity/v3/users => generated 287 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:22.245098 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535c2ad-e3ed-47a1-b065-52d9beb5573c service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:22.255329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535c2ad-e3ed-47a1-b065-52d9beb5573c service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:22.260879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc98a09-db37-4bfb-bed4-dbe5a8af26d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:22.261624 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc98a09-db37-4bfb-bed4-dbe5a8af26d9 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:22.261861 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc98a09-db37-4bfb-bed4-dbe5a8af26d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:22.262146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc98a09-db37-4bfb-bed4-dbe5a8af26d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:22.262926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc98a09-db37-4bfb-bed4-dbe5a8af26d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:22.264564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc98a09-db37-4bfb-bed4-dbe5a8af26d9 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:22.277236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1028/2067] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:22.281697 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554ea94-6a6f-4ae6-92a4-ef02fd4cb938 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:22.298293 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554ea94-6a6f-4ae6-92a4-ef02fd4cb938 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:22.303320 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c5067-f186-4bda-9adf-d741f5e39615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:22.304996 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c5067-f186-4bda-9adf-d741f5e39615 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:22.305294 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c5067-f186-4bda-9adf-d741f5e39615 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:22.305596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c5067-f186-4bda-9adf-d741f5e39615 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:22.306408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c5067-f186-4bda-9adf-d741f5e39615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:22.308066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c5067-f186-4bda-9adf-d741f5e39615 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:22.318600 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1040/2068] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:59:22.323287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc98a09-db37-4bfb-bed4-dbe5a8af26d9 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:22.333438 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc98a09-db37-4bfb-bed4-dbe5a8af26d9 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:22.339646 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dba68a-c2cd-455a-91fe-832242ac9c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:22.340563 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dba68a-c2cd-455a-91fe-832242ac9c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:22.340888 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dba68a-c2cd-455a-91fe-832242ac9c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:22.341171 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dba68a-c2cd-455a-91fe-832242ac9c2e admin admin] PATH_INFO: `/v3/projects/dfa5a5c0422e400890f3bcfa362a79da/users/bccecb6fc9ee4b2f98546fe39bf03ba7/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:22.353899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:22.366017 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dba68a-c2cd-455a-91fe-832242ac9c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa5a5c0422e400890f3bcfa362a79da, user_id=bccecb6fc9ee4b2f98546fe39bf03ba7, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:22.366017 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dba68a-c2cd-455a-91fe-832242ac9c2e admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:22.477186 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c5067-f186-4bda-9adf-d741f5e39615 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:22.478553 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1029/2069] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:22 2022] PUT /identity/v3/projects/dfa5a5c0422e400890f3bcfa362a79da/users/bccecb6fc9ee4b2f98546fe39bf03ba7/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:22.480380 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-a88c5067-f186-4bda-9adf-d741f5e39615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:22.484361 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644357f-8cf4-47b8-8ae5-bec206aae4d9 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:22.484784 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644357f-8cf4-47b8-8ae5-bec206aae4d9 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:22.485198 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644357f-8cf4-47b8-8ae5-bec206aae4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:22.521108 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-b644357f-8cf4-47b8-8ae5-bec206aae4d9 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:22.521108 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-b644357f-8cf4-47b8-8ae5-bec206aae4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:22.521438 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c5067-f186-4bda-9adf-d741f5e39615 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:22.680774 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733afc11-28f9-4ae4-8c13-5059bbc1b7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:22.685328 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1030/2070] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:22.685644 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733afc11-28f9-4ae4-8c13-5059bbc1b7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:22.685644 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733afc11-28f9-4ae4-8c13-5059bbc1b7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:22.685644 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733afc11-28f9-4ae4-8c13-5059bbc1b7f6 admin admin] PATH_INFO: `/v3/projects/cbbcbbc639164da7be53dc0842edbe8d` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:22.685991 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644357f-8cf4-47b8-8ae5-bec206aae4d9 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:22.686147 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733afc11-28f9-4ae4-8c13-5059bbc1b7f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbbcbbc639164da7be53dc0842edbe8d)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:22.686289 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-b644357f-8cf4-47b8-8ae5-bec206aae4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:22.689520 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733afc11-28f9-4ae4-8c13-5059bbc1b7f6 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:22.703552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644357f-8cf4-47b8-8ae5-bec206aae4d9 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:22.708254 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d064379-2ecf-4434-8b72-cbd7c7d05750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:22.709213 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d064379-2ecf-4434-8b72-cbd7c7d05750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:22.709497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d064379-2ecf-4434-8b72-cbd7c7d05750 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:22.709775 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d064379-2ecf-4434-8b72-cbd7c7d05750 admin admin] PATH_INFO: `/v3/users/d124899ce94442b6a67265c76b5b7419` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:22.711205 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d064379-2ecf-4434-8b72-cbd7c7d05750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d124899ce94442b6a67265c76b5b7419)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:22.713389 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d064379-2ecf-4434-8b72-cbd7c7d05750 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:22.814311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-733afc11-28f9-4ae4-8c13-5059bbc1b7f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbbcbbc639164da7be53dc0842edbe8d', 'request_id': 'req-733afc11-28f9-4ae4-8c13-5059bbc1b7f6'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:22.833240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-733afc11-28f9-4ae4-8c13-5059bbc1b7f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbbcbbc639164da7be53dc0842edbe8d', 'request_id': 'req-733afc11-28f9-4ae4-8c13-5059bbc1b7f6'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:22.918811 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-733afc11-28f9-4ae4-8c13-5059bbc1b7f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbbcbbc639164da7be53dc0842edbe8d', 'request_id': 'req-733afc11-28f9-4ae4-8c13-5059bbc1b7f6'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:22.929701 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4d064379-2ecf-4434-8b72-cbd7c7d05750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd124899ce94442b6a67265c76b5b7419'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:22.946319 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4d064379-2ecf-4434-8b72-cbd7c7d05750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd124899ce94442b6a67265c76b5b7419'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:22.946319 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4d064379-2ecf-4434-8b72-cbd7c7d05750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd124899ce94442b6a67265c76b5b7419'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:22.950379 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-733afc11-28f9-4ae4-8c13-5059bbc1b7f6 admin admin] The token cache is being invalidate because project cbbcbbc639164da7be53dc0842edbe8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:22.950700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-733afc11-28f9-4ae4-8c13-5059bbc1b7f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:22.952434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-733afc11-28f9-4ae4-8c13-5059bbc1b7f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:22.959620 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1041/2071] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:22 2022] DELETE /identity/v3/projects/cbbcbbc639164da7be53dc0842edbe8d => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:22.961236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733afc11-28f9-4ae4-8c13-5059bbc1b7f6 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:22.963525 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-733afc11-28f9-4ae4-8c13-5059bbc1b7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:23.034936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4d064379-2ecf-4434-8b72-cbd7c7d05750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd124899ce94442b6a67265c76b5b7419'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:23.035662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4d064379-2ecf-4434-8b72-cbd7c7d05750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd124899ce94442b6a67265c76b5b7419'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:23.065934 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733afc11-28f9-4ae4-8c13-5059bbc1b7f6 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:23.072943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1031/2072] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:22 2022] DELETE /identity/v3/users/d124899ce94442b6a67265c76b5b7419 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:23.075235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d064379-2ecf-4434-8b72-cbd7c7d05750 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:23.076059 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4d064379-2ecf-4434-8b72-cbd7c7d05750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:23.077879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5fcad-ac25-4dd6-a1ee-1bb51ff61105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:23.079755 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5fcad-ac25-4dd6-a1ee-1bb51ff61105 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:23.082306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5fcad-ac25-4dd6-a1ee-1bb51ff61105 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:23.083127 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5fcad-ac25-4dd6-a1ee-1bb51ff61105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:23.086855 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-0cb5fcad-ac25-4dd6-a1ee-1bb51ff61105 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:23.184141 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d064379-2ecf-4434-8b72-cbd7c7d05750 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:23.189691 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c6870-ac3c-4838-9e58-46e4d35534fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:23.191509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c6870-ac3c-4838-9e58-46e4d35534fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:23.192190 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c6870-ac3c-4838-9e58-46e4d35534fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:23.192874 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c6870-ac3c-4838-9e58-46e4d35534fd admin admin] PATH_INFO: `/v3/projects/b010aa705fa449fd9fa6d0eea90bb608` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:23.195170 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c6870-ac3c-4838-9e58-46e4d35534fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b010aa705fa449fd9fa6d0eea90bb608)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:23.197566 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c6870-ac3c-4838-9e58-46e4d35534fd admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:23.226194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5fcad-ac25-4dd6-a1ee-1bb51ff61105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:23.227869 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5fcad-ac25-4dd6-a1ee-1bb51ff61105 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:23.240325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1042/2073] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:23.245336 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5fcad-ac25-4dd6-a1ee-1bb51ff61105 service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:23.248516 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-0cb5fcad-ac25-4dd6-a1ee-1bb51ff61105 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:23.265917 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5fcad-ac25-4dd6-a1ee-1bb51ff61105 service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:23.270930 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05c835-a298-4496-811f-3b028567abbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:23.272289 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c835-a298-4496-811f-3b028567abbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:23.272607 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c835-a298-4496-811f-3b028567abbf admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:23.273241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c835-a298-4496-811f-3b028567abbf admin admin] PATH_INFO: `/v3/users/d1cc0b6503ac41338f5308a95b3ae6f9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:23.274873 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05c835-a298-4496-811f-3b028567abbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1cc0b6503ac41338f5308a95b3ae6f9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:23.277327 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05c835-a298-4496-811f-3b028567abbf admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:23.341823 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-666c6870-ac3c-4838-9e58-46e4d35534fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b010aa705fa449fd9fa6d0eea90bb608', 'request_id': 'req-666c6870-ac3c-4838-9e58-46e4d35534fd'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:23.350136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:23.432122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-666c6870-ac3c-4838-9e58-46e4d35534fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b010aa705fa449fd9fa6d0eea90bb608', 'request_id': 'req-666c6870-ac3c-4838-9e58-46e4d35534fd'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:23.438778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-666c6870-ac3c-4838-9e58-46e4d35534fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b010aa705fa449fd9fa6d0eea90bb608', 'request_id': 'req-666c6870-ac3c-4838-9e58-46e4d35534fd'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:23.457944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-666c6870-ac3c-4838-9e58-46e4d35534fd admin admin] The token cache is being invalidate because project b010aa705fa449fd9fa6d0eea90bb608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:23.459631 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-666c6870-ac3c-4838-9e58-46e4d35534fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:23.459631 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-666c6870-ac3c-4838-9e58-46e4d35534fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:23.461155 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1032/2074] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:23 2022] DELETE /identity/v3/projects/b010aa705fa449fd9fa6d0eea90bb608 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:23.466713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285b3be-7d81-4864-a61c-98cefd8ab501 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:23.467761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285b3be-7d81-4864-a61c-98cefd8ab501 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:23.468121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285b3be-7d81-4864-a61c-98cefd8ab501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:23.489056 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-7b05c835-a298-4496-811f-3b028567abbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1cc0b6503ac41338f5308a95b3ae6f9'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:23.501706 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-7b05c835-a298-4496-811f-3b028567abbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1cc0b6503ac41338f5308a95b3ae6f9'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:23.507658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-f285b3be-7d81-4864-a61c-98cefd8ab501 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:23.508925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f285b3be-7d81-4864-a61c-98cefd8ab501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:23.539295 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:23.578406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1033/2075] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:23.579610 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285b3be-7d81-4864-a61c-98cefd8ab501 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:23.581383 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f285b3be-7d81-4864-a61c-98cefd8ab501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:23.590192 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-7b05c835-a298-4496-811f-3b028567abbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1cc0b6503ac41338f5308a95b3ae6f9'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:23.591496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-7b05c835-a298-4496-811f-3b028567abbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1cc0b6503ac41338f5308a95b3ae6f9'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:23.592040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-7b05c835-a298-4496-811f-3b028567abbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1cc0b6503ac41338f5308a95b3ae6f9'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:23.608605 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285b3be-7d81-4864-a61c-98cefd8ab501 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:23.614158 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a01b9-db35-4281-be45-2189805964f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:23.620879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a01b9-db35-4281-be45-2189805964f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:23.620879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a01b9-db35-4281-be45-2189805964f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:23.620879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a01b9-db35-4281-be45-2189805964f3 admin admin] PATH_INFO: `/v3/users/3ea57212bfb74d6181be33d7e64696f7` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:23.620879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a01b9-db35-4281-be45-2189805964f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ea57212bfb74d6181be33d7e64696f7)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:23.620879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a01b9-db35-4281-be45-2189805964f3 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:23.632812 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1043/2076] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:23 2022] DELETE /identity/v3/users/d1cc0b6503ac41338f5308a95b3ae6f9 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:23.635554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05c835-a298-4496-811f-3b028567abbf admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:23.637948 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-7b05c835-a298-4496-811f-3b028567abbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:23.714455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05c835-a298-4496-811f-3b028567abbf admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:23.718540 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c5f29-c154-4dc2-9665-be4736a4dccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:23.719325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c5f29-c154-4dc2-9665-be4736a4dccb service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:23.720027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c5f29-c154-4dc2-9665-be4736a4dccb service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:23.720178 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c5f29-c154-4dc2-9665-be4736a4dccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:23.722382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-619c5f29-c154-4dc2-9665-be4736a4dccb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:23.815202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c5f29-c154-4dc2-9665-be4736a4dccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:23.816877 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c5f29-c154-4dc2-9665-be4736a4dccb service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:23.829529 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1044/2077] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:23.895295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-da9a01b9-db35-4281-be45-2189805964f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ea57212bfb74d6181be33d7e64696f7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:23.906019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-da9a01b9-db35-4281-be45-2189805964f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ea57212bfb74d6181be33d7e64696f7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:23.906838 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-da9a01b9-db35-4281-be45-2189805964f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ea57212bfb74d6181be33d7e64696f7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:23.944204 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c5f29-c154-4dc2-9665-be4736a4dccb service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:23.948116 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-619c5f29-c154-4dc2-9665-be4736a4dccb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:23.977266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c5f29-c154-4dc2-9665-be4736a4dccb service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:23.985986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea443ad4-4c3d-499d-a8d3-f6d375ae85a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:23.988408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea443ad4-4c3d-499d-a8d3-f6d375ae85a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:23.989279 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea443ad4-4c3d-499d-a8d3-f6d375ae85a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:23.989858 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea443ad4-4c3d-499d-a8d3-f6d375ae85a2 admin admin] PATH_INFO: `/v3/users/ff368431091d41ea898afc9b081eee6d` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:23.998551 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea443ad4-4c3d-499d-a8d3-f6d375ae85a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff368431091d41ea898afc9b081eee6d)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:23.998551 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea443ad4-4c3d-499d-a8d3-f6d375ae85a2 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:24.016389 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-da9a01b9-db35-4281-be45-2189805964f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ea57212bfb74d6181be33d7e64696f7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:24.017088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-da9a01b9-db35-4281-be45-2189805964f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ea57212bfb74d6181be33d7e64696f7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:24.059479 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1034/2078] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:23 2022] DELETE /identity/v3/users/3ea57212bfb74d6181be33d7e64696f7 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:24.308046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ea443ad4-4c3d-499d-a8d3-f6d375ae85a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff368431091d41ea898afc9b081eee6d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:24.317891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ea443ad4-4c3d-499d-a8d3-f6d375ae85a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff368431091d41ea898afc9b081eee6d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:24.346953 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a01b9-db35-4281-be45-2189805964f3 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:24.348868 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-da9a01b9-db35-4281-be45-2189805964f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:24.434020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ea443ad4-4c3d-499d-a8d3-f6d375ae85a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff368431091d41ea898afc9b081eee6d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:24.434712 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ea443ad4-4c3d-499d-a8d3-f6d375ae85a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff368431091d41ea898afc9b081eee6d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:24.435491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ea443ad4-4c3d-499d-a8d3-f6d375ae85a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff368431091d41ea898afc9b081eee6d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:24.441937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a01b9-db35-4281-be45-2189805964f3 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:24.457792 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d70f5-c26b-4046-9ce7-ddb08bda9437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:24.458733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d70f5-c26b-4046-9ce7-ddb08bda9437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:24.459014 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d70f5-c26b-4046-9ce7-ddb08bda9437 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:24.459288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d70f5-c26b-4046-9ce7-ddb08bda9437 admin admin] PATH_INFO: `/v3/projects/8739949b8b114df6841ed0424d2d1ab3` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:24.460603 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d70f5-c26b-4046-9ce7-ddb08bda9437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8739949b8b114df6841ed0424d2d1ab3)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:24.462602 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d70f5-c26b-4046-9ce7-ddb08bda9437 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:24.466508 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1045/2079] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:23 2022] DELETE /identity/v3/users/ff368431091d41ea898afc9b081eee6d => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:24.559753 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea443ad4-4c3d-499d-a8d3-f6d375ae85a2 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:24.561582 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ea443ad4-4c3d-499d-a8d3-f6d375ae85a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:24.575151 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:24.614515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-241d70f5-c26b-4046-9ce7-ddb08bda9437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8739949b8b114df6841ed0424d2d1ab3', 'request_id': 'req-241d70f5-c26b-4046-9ce7-ddb08bda9437'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:24.681823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea443ad4-4c3d-499d-a8d3-f6d375ae85a2 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:24.724812 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-241d70f5-c26b-4046-9ce7-ddb08bda9437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8739949b8b114df6841ed0424d2d1ab3', 'request_id': 'req-241d70f5-c26b-4046-9ce7-ddb08bda9437'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:24.733436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-241d70f5-c26b-4046-9ce7-ddb08bda9437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8739949b8b114df6841ed0424d2d1ab3', 'request_id': 'req-241d70f5-c26b-4046-9ce7-ddb08bda9437'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:24.746323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-241d70f5-c26b-4046-9ce7-ddb08bda9437 admin admin] The token cache is being invalidate because project 8739949b8b114df6841ed0424d2d1ab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:24.746790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-241d70f5-c26b-4046-9ce7-ddb08bda9437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:24.747530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-241d70f5-c26b-4046-9ce7-ddb08bda9437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:24.749649 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1035/2080] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:24 2022] DELETE /identity/v3/projects/8739949b8b114df6841ed0424d2d1ab3 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:24.750091 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031997f5-aa95-4fc3-8f0a-42f1d01951b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:24.750982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031997f5-aa95-4fc3-8f0a-42f1d01951b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:24.751273 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031997f5-aa95-4fc3-8f0a-42f1d01951b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:24.752050 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031997f5-aa95-4fc3-8f0a-42f1d01951b8 admin admin] PATH_INFO: `/v3/projects/218be21339384d408a00726a53198c41` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:24.754018 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031997f5-aa95-4fc3-8f0a-42f1d01951b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=218be21339384d408a00726a53198c41)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:24.755667 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031997f5-aa95-4fc3-8f0a-42f1d01951b8 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:24.768529 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d70f5-c26b-4046-9ce7-ddb08bda9437 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:24.770459 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-241d70f5-c26b-4046-9ce7-ddb08bda9437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:24.800619 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d70f5-c26b-4046-9ce7-ddb08bda9437 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:24.813921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:24.814143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512f67e-aed3-4fd6-b757-c1462b09401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:24.817532 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512f67e-aed3-4fd6-b757-c1462b09401f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:24.817532 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512f67e-aed3-4fd6-b757-c1462b09401f admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:24.817532 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512f67e-aed3-4fd6-b757-c1462b09401f admin admin] PATH_INFO: `/v3/projects/cfc5c3a6a27d41e492b23f2d6a309658` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:24.817866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512f67e-aed3-4fd6-b757-c1462b09401f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc5c3a6a27d41e492b23f2d6a309658)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:24.820099 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512f67e-aed3-4fd6-b757-c1462b09401f admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:24.885345 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-031997f5-aa95-4fc3-8f0a-42f1d01951b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '218be21339384d408a00726a53198c41', 'request_id': 'req-031997f5-aa95-4fc3-8f0a-42f1d01951b8'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:24.898131 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-031997f5-aa95-4fc3-8f0a-42f1d01951b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '218be21339384d408a00726a53198c41', 'request_id': 'req-031997f5-aa95-4fc3-8f0a-42f1d01951b8'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:24.981887 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8512f67e-aed3-4fd6-b757-c1462b09401f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc5c3a6a27d41e492b23f2d6a309658', 'request_id': 'req-8512f67e-aed3-4fd6-b757-c1462b09401f'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:24.982405 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-031997f5-aa95-4fc3-8f0a-42f1d01951b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '218be21339384d408a00726a53198c41', 'request_id': 'req-031997f5-aa95-4fc3-8f0a-42f1d01951b8'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:24.997558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-031997f5-aa95-4fc3-8f0a-42f1d01951b8 admin admin] The token cache is being invalidate because project 218be21339384d408a00726a53198c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:24.997766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-031997f5-aa95-4fc3-8f0a-42f1d01951b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:24.998548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-031997f5-aa95-4fc3-8f0a-42f1d01951b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:25.001231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1046/2081] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:24 2022] DELETE /identity/v3/projects/218be21339384d408a00726a53198c41 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:59:25.008131 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28608c5f-8fcc-4d3c-918b-5bffe882d54d None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:25.008545 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28608c5f-8fcc-4d3c-918b-5bffe882d54d None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:25.009033 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28608c5f-8fcc-4d3c-918b-5bffe882d54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:25.035141 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-28608c5f-8fcc-4d3c-918b-5bffe882d54d None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:25.036850 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-28608c5f-8fcc-4d3c-918b-5bffe882d54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:25.062533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8512f67e-aed3-4fd6-b757-c1462b09401f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc5c3a6a27d41e492b23f2d6a309658', 'request_id': 'req-8512f67e-aed3-4fd6-b757-c1462b09401f'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:25.070381 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8512f67e-aed3-4fd6-b757-c1462b09401f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc5c3a6a27d41e492b23f2d6a309658', 'request_id': 'req-8512f67e-aed3-4fd6-b757-c1462b09401f'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:25.083980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8512f67e-aed3-4fd6-b757-c1462b09401f admin admin] The token cache is being invalidate because project cfc5c3a6a27d41e492b23f2d6a309658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:25.084268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8512f67e-aed3-4fd6-b757-c1462b09401f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:25.085735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8512f67e-aed3-4fd6-b757-c1462b09401f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:25.087347 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1036/2082] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:24 2022] DELETE /identity/v3/projects/cfc5c3a6a27d41e492b23f2d6a309658 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:25.098946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512f67e-aed3-4fd6-b757-c1462b09401f admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:25.098946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8512f67e-aed3-4fd6-b757-c1462b09401f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:25.126070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1047/2083] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:59:25.132833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbc726-721a-485c-bfbd-29f4b94ff163 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:25.132833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbc726-721a-485c-bfbd-29f4b94ff163 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:25.132833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbc726-721a-485c-bfbd-29f4b94ff163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:25.147054 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-cefbc726-721a-485c-bfbd-29f4b94ff163 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:25.150588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-cefbc726-721a-485c-bfbd-29f4b94ff163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:25.157606 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1048/2084] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:25.159414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8d3d9-dcab-4c71-856d-d93f17f55799 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:25.159925 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8d3d9-dcab-4c71-856d-d93f17f55799 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:25.160442 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8d3d9-dcab-4c71-856d-d93f17f55799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:25.167075 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512f67e-aed3-4fd6-b757-c1462b09401f admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:25.174122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf3f1d-5262-473e-9976-e21900e0811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:25.174122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf3f1d-5262-473e-9976-e21900e0811d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:25.174122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf3f1d-5262-473e-9976-e21900e0811d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:25.174122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf3f1d-5262-473e-9976-e21900e0811d admin admin] PATH_INFO: `/v3/projects/2069f994dd544669ab561848b4a42e36` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:25.175897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf3f1d-5262-473e-9976-e21900e0811d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2069f994dd544669ab561848b4a42e36)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:25.178047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf3f1d-5262-473e-9976-e21900e0811d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:25.194173 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-64a8d3d9-dcab-4c71-856d-d93f17f55799 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:25.195603 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-64a8d3d9-dcab-4c71-856d-d93f17f55799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:25.204097 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1049/2085] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:25.207396 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5497d-b184-4ac4-9599-2c61bae5f138 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:25.207396 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5497d-b184-4ac4-9599-2c61bae5f138 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:25.207396 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5497d-b184-4ac4-9599-2c61bae5f138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:25.227519 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-f7c5497d-b184-4ac4-9599-2c61bae5f138 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:25.235737 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-f7c5497d-b184-4ac4-9599-2c61bae5f138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:25.237267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1050/2086] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:25.238202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5497d-b184-4ac4-9599-2c61bae5f138 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:25.248385 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5497d-b184-4ac4-9599-2c61bae5f138 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:25.252948 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6d1ad-872a-4bc9-9176-d3ae3efafb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:25.253562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6d1ad-872a-4bc9-9176-d3ae3efafb98 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:25.253846 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6d1ad-872a-4bc9-9176-d3ae3efafb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:25.254124 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6d1ad-872a-4bc9-9176-d3ae3efafb98 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:25.254926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6d1ad-872a-4bc9-9176-d3ae3efafb98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:59:25.255241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6d1ad-872a-4bc9-9176-d3ae3efafb98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:25.257275 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6d1ad-872a-4bc9-9176-d3ae3efafb98 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:25.271111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1051/2087] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:59:25.271971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6d1ad-872a-4bc9-9176-d3ae3efafb98 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:25.285485 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6d1ad-872a-4bc9-9176-d3ae3efafb98 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:25.295155 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640b959-867d-435a-8b05-ad45b5c138b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:25.295986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640b959-867d-435a-8b05-ad45b5c138b8 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:25.296272 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640b959-867d-435a-8b05-ad45b5c138b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:25.296547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640b959-867d-435a-8b05-ad45b5c138b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:25.297745 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640b959-867d-435a-8b05-ad45b5c138b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:59:25.297745 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640b959-867d-435a-8b05-ad45b5c138b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:25.304324 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640b959-867d-435a-8b05-ad45b5c138b8 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:25.313070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4adf3f1d-5262-473e-9976-e21900e0811d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2069f994dd544669ab561848b4a42e36', 'request_id': 'req-4adf3f1d-5262-473e-9976-e21900e0811d'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:25.313978 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1052/2088] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:59:25.314874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640b959-867d-435a-8b05-ad45b5c138b8 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:25.326618 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640b959-867d-435a-8b05-ad45b5c138b8 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:25.388711 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cc7cc-b0d1-4903-93cb-a50c075aeee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:25.389387 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cc7cc-b0d1-4903-93cb-a50c075aeee3 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:25.390042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cc7cc-b0d1-4903-93cb-a50c075aeee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:25.390042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cc7cc-b0d1-4903-93cb-a50c075aeee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:25.390745 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cc7cc-b0d1-4903-93cb-a50c075aeee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:25.392724 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cc7cc-b0d1-4903-93cb-a50c075aeee3 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:25.405612 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4adf3f1d-5262-473e-9976-e21900e0811d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2069f994dd544669ab561848b4a42e36', 'request_id': 'req-4adf3f1d-5262-473e-9976-e21900e0811d'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:25.412738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4adf3f1d-5262-473e-9976-e21900e0811d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2069f994dd544669ab561848b4a42e36', 'request_id': 'req-4adf3f1d-5262-473e-9976-e21900e0811d'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:25.426189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4adf3f1d-5262-473e-9976-e21900e0811d admin admin] The token cache is being invalidate because project 2069f994dd544669ab561848b4a42e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:25.426476 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4adf3f1d-5262-473e-9976-e21900e0811d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:25.430376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4adf3f1d-5262-473e-9976-e21900e0811d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:25.430376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1037/2089] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:25 2022] DELETE /identity/v3/projects/2069f994dd544669ab561848b4a42e36 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:25.430376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ae2db-7663-4285-9062-a070a089e2df None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:25.430669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ae2db-7663-4285-9062-a070a089e2df None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:25.430846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ae2db-7663-4285-9062-a070a089e2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:25.460415 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-2f2ae2db-7663-4285-9062-a070a089e2df None None] MFA Rules not processed for user `bccecb6fc9ee4b2f98546fe39bf03ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:25.461656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-2f2ae2db-7663-4285-9062-a070a089e2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:25.533029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1053/2090] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:59:25 2022] POST /identity/v3/projects => generated 385 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:25.533760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cc7cc-b0d1-4903-93cb-a50c075aeee3 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:25.534390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1038/2091] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:25.536083 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03baefe-1162-4fc3-84e5-2936d50d5539 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:25.536215 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03baefe-1162-4fc3-84e5-2936d50d5539 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:25.536448 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03baefe-1162-4fc3-84e5-2936d50d5539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:25.539760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-613cc7cc-b0d1-4903-93cb-a50c075aeee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:25.556382 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-c03baefe-1162-4fc3-84e5-2936d50d5539 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:25.557801 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c03baefe-1162-4fc3-84e5-2936d50d5539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:25.605713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:25.614785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cc7cc-b0d1-4903-93cb-a50c075aeee3 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:25.620298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f3b00-bd1e-4516-8767-6e8e234d0e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:25.621023 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f3b00-bd1e-4516-8767-6e8e234d0e32 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:25.621511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f3b00-bd1e-4516-8767-6e8e234d0e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:25.621679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f3b00-bd1e-4516-8767-6e8e234d0e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:25.622400 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f3b00-bd1e-4516-8767-6e8e234d0e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:25.624578 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f3b00-bd1e-4516-8767-6e8e234d0e32 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:25.627064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1039/2092] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:25.628035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03baefe-1162-4fc3-84e5-2936d50d5539 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:25.629468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c03baefe-1162-4fc3-84e5-2936d50d5539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:25.643361 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03baefe-1162-4fc3-84e5-2936d50d5539 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:25.649291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80ef05-9c59-4a2d-bac3-785d2ecc0cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:25.649976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80ef05-9c59-4a2d-bac3-785d2ecc0cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:25.650265 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80ef05-9c59-4a2d-bac3-785d2ecc0cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:25.650545 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80ef05-9c59-4a2d-bac3-785d2ecc0cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:25.651248 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80ef05-9c59-4a2d-bac3-785d2ecc0cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:25.653273 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80ef05-9c59-4a2d-bac3-785d2ecc0cf9 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:25.763512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1054/2093] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:59:25 2022] POST /identity/v3/projects => generated 383 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:25.763512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f3b00-bd1e-4516-8767-6e8e234d0e32 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:25.764585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9f7f3b00-bd1e-4516-8767-6e8e234d0e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:25.776325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:25.781400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1040/2094] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:25 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:25.781568 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66efb0-0a45-4582-9c41-90961bc3f25c None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:25.781829 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66efb0-0a45-4582-9c41-90961bc3f25c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:25.784172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66efb0-0a45-4582-9c41-90961bc3f25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:25.800406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-fa66efb0-0a45-4582-9c41-90961bc3f25c None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:25.801668 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-fa66efb0-0a45-4582-9c41-90961bc3f25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:25.840689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f3b00-bd1e-4516-8767-6e8e234d0e32 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:25.845986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db602a3c-7265-43a6-9edb-99c44a9e2a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:25.846948 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db602a3c-7265-43a6-9edb-99c44a9e2a82 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:25.847385 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db602a3c-7265-43a6-9edb-99c44a9e2a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:25.847927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db602a3c-7265-43a6-9edb-99c44a9e2a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:25.848985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db602a3c-7265-43a6-9edb-99c44a9e2a82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:25.851489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db602a3c-7265-43a6-9edb-99c44a9e2a82 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:25.875455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1041/2095] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:25.876349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66efb0-0a45-4582-9c41-90961bc3f25c None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:25.886709 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66efb0-0a45-4582-9c41-90961bc3f25c None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:25.891693 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459c347-d242-40e5-8dd1-a921dd4c4b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:25.892383 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459c347-d242-40e5-8dd1-a921dd4c4b75 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:25.892940 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459c347-d242-40e5-8dd1-a921dd4c4b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:25.893181 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459c347-d242-40e5-8dd1-a921dd4c4b75 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:25.894060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459c347-d242-40e5-8dd1-a921dd4c4b75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:25.896031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459c347-d242-40e5-8dd1-a921dd4c4b75 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:25.938629 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1055/2096] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:59:25 2022] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:25.939477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db602a3c-7265-43a6-9edb-99c44a9e2a82 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:26.003118 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db602a3c-7265-43a6-9edb-99c44a9e2a82 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:26.008739 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5617315-c2d9-48ff-a4e9-ddba12ac2fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:26.009414 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5617315-c2d9-48ff-a4e9-ddba12ac2fad admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:26.009708 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5617315-c2d9-48ff-a4e9-ddba12ac2fad admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:26.009986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5617315-c2d9-48ff-a4e9-ddba12ac2fad admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:26.010720 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5617315-c2d9-48ff-a4e9-ddba12ac2fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:26.012324 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5617315-c2d9-48ff-a4e9-ddba12ac2fad admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:26.013041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1042/2097] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:25 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:26.014048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459c347-d242-40e5-8dd1-a921dd4c4b75 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:26.023788 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1056/2098] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:26.024624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5617315-c2d9-48ff-a4e9-ddba12ac2fad admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:26.025711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459c347-d242-40e5-8dd1-a921dd4c4b75 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:26.031463 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc4601-3c55-4159-8b75-0da7058b23e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:26.032126 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc4601-3c55-4159-8b75-0da7058b23e8 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:26.032410 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc4601-3c55-4159-8b75-0da7058b23e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:26.032718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc4601-3c55-4159-8b75-0da7058b23e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:26.033453 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc4601-3c55-4159-8b75-0da7058b23e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:59:26.033756 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc4601-3c55-4159-8b75-0da7058b23e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:26.035434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc4601-3c55-4159-8b75-0da7058b23e8 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:26.036285 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5617315-c2d9-48ff-a4e9-ddba12ac2fad admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:26.041176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f961f-4794-4e76-b06a-65e8ea394bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:26.041867 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f961f-4794-4e76-b06a-65e8ea394bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:26.042156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f961f-4794-4e76-b06a-65e8ea394bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:26.042436 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f961f-4794-4e76-b06a-65e8ea394bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:26.043322 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f961f-4794-4e76-b06a-65e8ea394bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:26.045140 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f961f-4794-4e76-b06a-65e8ea394bb7 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:26.048988 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1043/2099] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:59:26.049833 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc4601-3c55-4159-8b75-0da7058b23e8 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:26.060295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc4601-3c55-4159-8b75-0da7058b23e8 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:26.065066 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f48ed7-0c84-4eec-934a-ac5a8a6ec222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:26.066011 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f48ed7-0c84-4eec-934a-ac5a8a6ec222 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:26.066244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f48ed7-0c84-4eec-934a-ac5a8a6ec222 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:26.066485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f48ed7-0c84-4eec-934a-ac5a8a6ec222 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:26.067220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f48ed7-0c84-4eec-934a-ac5a8a6ec222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:26.068850 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f48ed7-0c84-4eec-934a-ac5a8a6ec222 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:26.079578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1044/2100] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:26.080833 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f48ed7-0c84-4eec-934a-ac5a8a6ec222 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:26.090573 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f48ed7-0c84-4eec-934a-ac5a8a6ec222 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:26.095416 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59137092-d969-4b22-8af2-2a806a67dc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:26.096025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59137092-d969-4b22-8af2-2a806a67dc94 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:26.096305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59137092-d969-4b22-8af2-2a806a67dc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:26.096577 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59137092-d969-4b22-8af2-2a806a67dc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:26.097337 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59137092-d969-4b22-8af2-2a806a67dc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:26.098939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59137092-d969-4b22-8af2-2a806a67dc94 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:26.109829 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1045/2101] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:26.110626 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59137092-d969-4b22-8af2-2a806a67dc94 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:26.121655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59137092-d969-4b22-8af2-2a806a67dc94 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:26.127025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b65ba-1fae-490c-b839-756c1db6efc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:26.127860 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b65ba-1fae-490c-b839-756c1db6efc1 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:26.128153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b65ba-1fae-490c-b839-756c1db6efc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:26.128438 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b65ba-1fae-490c-b839-756c1db6efc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:26.129186 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b65ba-1fae-490c-b839-756c1db6efc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:26.131436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b65ba-1fae-490c-b839-756c1db6efc1 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:26.145545 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1057/2102] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:26 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:26.145545 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f961f-4794-4e76-b06a-65e8ea394bb7 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:26.160155 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f961f-4794-4e76-b06a-65e8ea394bb7 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:26.167602 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe3476-b475-49a1-b16e-a2828efa824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:26.168590 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe3476-b475-49a1-b16e-a2828efa824d admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:26.169128 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe3476-b475-49a1-b16e-a2828efa824d admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:26.169619 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe3476-b475-49a1-b16e-a2828efa824d admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:26.170948 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe3476-b475-49a1-b16e-a2828efa824d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:26.173967 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe3476-b475-49a1-b16e-a2828efa824d admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:26.191899 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1058/2103] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:26.193244 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe3476-b475-49a1-b16e-a2828efa824d admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:26.209624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe3476-b475-49a1-b16e-a2828efa824d admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:26.216779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b559094-7ad1-47fa-97da-b5e7a0fd9829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:26.218202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b559094-7ad1-47fa-97da-b5e7a0fd9829 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:26.218664 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b559094-7ad1-47fa-97da-b5e7a0fd9829 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:26.219112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b559094-7ad1-47fa-97da-b5e7a0fd9829 admin admin] PATH_INFO: `/v3/projects/9ae8619305cc43a6a83385c98121ef49/users/73622ae98f444912879c7190b7490110/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:26.244885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b559094-7ad1-47fa-97da-b5e7a0fd9829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ae8619305cc43a6a83385c98121ef49, user_id=73622ae98f444912879c7190b7490110, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:26.247661 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b559094-7ad1-47fa-97da-b5e7a0fd9829 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:26.262132 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1046/2104] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:59:26 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:26.263128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b65ba-1fae-490c-b839-756c1db6efc1 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:26.325578 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1059/2105] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:26 2022] PUT /identity/v3/projects/9ae8619305cc43a6a83385c98121ef49/users/73622ae98f444912879c7190b7490110/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:26.326320 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b559094-7ad1-47fa-97da-b5e7a0fd9829 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:26.327735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b65ba-1fae-490c-b839-756c1db6efc1 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:26.396263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b559094-7ad1-47fa-97da-b5e7a0fd9829 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:26.401204 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1898d4-3c3b-47f5-a120-3e181218b9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:26.401365 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43e510-d09b-4e1a-8d42-dc080556f311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:26.402011 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43e510-d09b-4e1a-8d42-dc080556f311 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:26.402152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1898d4-3c3b-47f5-a120-3e181218b9e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:26.402294 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43e510-d09b-4e1a-8d42-dc080556f311 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:26.402387 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1898d4-3c3b-47f5-a120-3e181218b9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:26.402721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43e510-d09b-4e1a-8d42-dc080556f311 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:26.402834 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1898d4-3c3b-47f5-a120-3e181218b9e2 admin admin] PATH_INFO: `/v3/projects/561651ced9884bc783f06c0d82fd89fc/users/fd902c6ec95f4e73b79410d274a4b3a9/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:26.403498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43e510-d09b-4e1a-8d42-dc080556f311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:26.405322 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43e510-d09b-4e1a-8d42-dc080556f311 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:26.417827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1047/2106] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:26.420768 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43e510-d09b-4e1a-8d42-dc080556f311 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:26.420888 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1898d4-3c3b-47f5-a120-3e181218b9e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=561651ced9884bc783f06c0d82fd89fc, user_id=fd902c6ec95f4e73b79410d274a4b3a9, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:26.422724 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1898d4-3c3b-47f5-a120-3e181218b9e2 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:26.430234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43e510-d09b-4e1a-8d42-dc080556f311 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:26.435399 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351871c9-2946-4fa6-8b55-a4af2a5068ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:26.436075 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351871c9-2946-4fa6-8b55-a4af2a5068ae admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:26.436365 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351871c9-2946-4fa6-8b55-a4af2a5068ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:26.436659 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351871c9-2946-4fa6-8b55-a4af2a5068ae admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:26.437445 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351871c9-2946-4fa6-8b55-a4af2a5068ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:26.440479 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351871c9-2946-4fa6-8b55-a4af2a5068ae admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:26.522146 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1060/2107] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:26 2022] PUT /identity/v3/projects/561651ced9884bc783f06c0d82fd89fc/users/fd902c6ec95f4e73b79410d274a4b3a9/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:26.524393 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97af47-6fe1-4683-9b11-f69f30ed4725 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:26.524708 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97af47-6fe1-4683-9b11-f69f30ed4725 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:26.524996 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97af47-6fe1-4683-9b11-f69f30ed4725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:26.550754 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1048/2108] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:26 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:26.550754 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351871c9-2946-4fa6-8b55-a4af2a5068ae admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:26.552613 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-7c97af47-6fe1-4683-9b11-f69f30ed4725 None None] MFA Rules not processed for user `73622ae98f444912879c7190b7490110`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:26.554046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-7c97af47-6fe1-4683-9b11-f69f30ed4725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:26.561280 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351871c9-2946-4fa6-8b55-a4af2a5068ae admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:26.630845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fb291-78a6-4a20-8ac7-accc6d870d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:26.632284 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fb291-78a6-4a20-8ac7-accc6d870d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:26.632576 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fb291-78a6-4a20-8ac7-accc6d870d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:26.632918 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fb291-78a6-4a20-8ac7-accc6d870d75 admin admin] PATH_INFO: `/v3/projects/ab16355968ea4e9dbf850c91760aa46b/users/061d406d88034afa855750b04a8a1de6/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:26.634945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1061/2109] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:26.636269 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cb0a8-0d0d-4f40-a57f-9e292e10dac3 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:26.636566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cb0a8-0d0d-4f40-a57f-9e292e10dac3 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:26.637095 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cb0a8-0d0d-4f40-a57f-9e292e10dac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:26.641066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:26.650707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fb291-78a6-4a20-8ac7-accc6d870d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab16355968ea4e9dbf850c91760aa46b, user_id=061d406d88034afa855750b04a8a1de6, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:26.653781 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fb291-78a6-4a20-8ac7-accc6d870d75 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:26.667824 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-b05cb0a8-0d0d-4f40-a57f-9e292e10dac3 None None] MFA Rules not processed for user `fd902c6ec95f4e73b79410d274a4b3a9`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:26.669135 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b05cb0a8-0d0d-4f40-a57f-9e292e10dac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:26.744790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1062/2110] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:26.745659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cb0a8-0d0d-4f40-a57f-9e292e10dac3 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:26.756126 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cb0a8-0d0d-4f40-a57f-9e292e10dac3 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:26.761969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c40754-4222-4703-9c2a-8389df91facc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:26.762665 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c40754-4222-4703-9c2a-8389df91facc admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:26.763026 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c40754-4222-4703-9c2a-8389df91facc admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:26.763408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c40754-4222-4703-9c2a-8389df91facc admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:26.764073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c40754-4222-4703-9c2a-8389df91facc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:26.765784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c40754-4222-4703-9c2a-8389df91facc admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:26.780796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1063/2111] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:26.783738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c40754-4222-4703-9c2a-8389df91facc admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:26.788038 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1049/2112] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:26 2022] PUT /identity/v3/projects/ab16355968ea4e9dbf850c91760aa46b/users/061d406d88034afa855750b04a8a1de6/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:26.789147 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fb291-78a6-4a20-8ac7-accc6d870d75 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:26.792971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c40754-4222-4703-9c2a-8389df91facc admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:26.865528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917820a0-d599-4c30-9eca-dce1d984bfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:26.867122 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917820a0-d599-4c30-9eca-dce1d984bfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:26.867516 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917820a0-d599-4c30-9eca-dce1d984bfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:26.867797 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917820a0-d599-4c30-9eca-dce1d984bfb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:26.868500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917820a0-d599-4c30-9eca-dce1d984bfb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:26.871198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917820a0-d599-4c30-9eca-dce1d984bfb3 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:26.871737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fb291-78a6-4a20-8ac7-accc6d870d75 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:26.878923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8812e-70c6-4648-a67b-d88e0cf26c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:26.879745 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8812e-70c6-4648-a67b-d88e0cf26c71 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:26.880584 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8812e-70c6-4648-a67b-d88e0cf26c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:26.880584 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8812e-70c6-4648-a67b-d88e0cf26c71 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:26.882504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8812e-70c6-4648-a67b-d88e0cf26c71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:26.885810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8812e-70c6-4648-a67b-d88e0cf26c71 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:26.914307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:26.977890 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1064/2113] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:59:26 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:26.978896 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917820a0-d599-4c30-9eca-dce1d984bfb3 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:27.008339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1050/2114] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:59:26 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:27.009834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8812e-70c6-4648-a67b-d88e0cf26c71 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:27.065816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917820a0-d599-4c30-9eca-dce1d984bfb3 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:27.079455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8812e-70c6-4648-a67b-d88e0cf26c71 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:27.085166 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56a45b-efb8-4f27-9957-89cfcabfd774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:27.085752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56a45b-efb8-4f27-9957-89cfcabfd774 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:27.086040 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56a45b-efb8-4f27-9957-89cfcabfd774 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:27.086315 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56a45b-efb8-4f27-9957-89cfcabfd774 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:27.087089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56a45b-efb8-4f27-9957-89cfcabfd774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:27.096788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56a45b-efb8-4f27-9957-89cfcabfd774 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:27.111088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1051/2115] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:27.117350 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56a45b-efb8-4f27-9957-89cfcabfd774 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:27.130799 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc2768-5bca-454d-be80-32385d89ea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:27.131777 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc2768-5bca-454d-be80-32385d89ea08 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:27.132056 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc2768-5bca-454d-be80-32385d89ea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:27.132341 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc2768-5bca-454d-be80-32385d89ea08 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:27.132597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56a45b-efb8-4f27-9957-89cfcabfd774 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:27.133269 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc2768-5bca-454d-be80-32385d89ea08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:27.135044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc2768-5bca-454d-be80-32385d89ea08 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:27.140296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc415986-9be3-4084-be1e-84e8a8ac915b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:27.141385 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc415986-9be3-4084-be1e-84e8a8ac915b admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:27.141739 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc415986-9be3-4084-be1e-84e8a8ac915b admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:27.142433 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc415986-9be3-4084-be1e-84e8a8ac915b admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:27.143185 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc415986-9be3-4084-be1e-84e8a8ac915b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:27.145863 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc415986-9be3-4084-be1e-84e8a8ac915b admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:27.151366 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1065/2116] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:27.152921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc2768-5bca-454d-be80-32385d89ea08 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:27.169529 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc2768-5bca-454d-be80-32385d89ea08 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:27.174279 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c465d5-acc6-4451-a680-07ec4b04a2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:27.174952 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c465d5-acc6-4451-a680-07ec4b04a2fb admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:27.175274 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c465d5-acc6-4451-a680-07ec4b04a2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:27.175514 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c465d5-acc6-4451-a680-07ec4b04a2fb admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:27.176209 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c465d5-acc6-4451-a680-07ec4b04a2fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:27.178174 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c465d5-acc6-4451-a680-07ec4b04a2fb admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:27.218376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1052/2117] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:27 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:27.219441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc415986-9be3-4084-be1e-84e8a8ac915b admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:27.230626 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc415986-9be3-4084-be1e-84e8a8ac915b admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:27.235536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c8280-497b-4f80-b1df-63aef4914e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:27.236441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c8280-497b-4f80-b1df-63aef4914e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:27.236764 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c8280-497b-4f80-b1df-63aef4914e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:27.237043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c8280-497b-4f80-b1df-63aef4914e41 admin admin] PATH_INFO: `/v3/projects/ab16355968ea4e9dbf850c91760aa46b/users/061d406d88034afa855750b04a8a1de6/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:27.239087 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c8280-497b-4f80-b1df-63aef4914e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab16355968ea4e9dbf850c91760aa46b, user_id=061d406d88034afa855750b04a8a1de6, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:27.242669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c8280-497b-4f80-b1df-63aef4914e41 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:27.257136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1053/2118] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:27 2022] PUT /identity/v3/projects/ab16355968ea4e9dbf850c91760aa46b/users/061d406d88034afa855750b04a8a1de6/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:27.260517 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c8280-497b-4f80-b1df-63aef4914e41 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:27.263354 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1066/2119] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:27 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:27.267213 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c465d5-acc6-4451-a680-07ec4b04a2fb admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:27.278840 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c465d5-acc6-4451-a680-07ec4b04a2fb admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:27.328825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c8280-497b-4f80-b1df-63aef4914e41 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:27.338930 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db79417-1da8-49e9-88ce-c2b6a70427a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:27.339945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db79417-1da8-49e9-88ce-c2b6a70427a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:27.340305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db79417-1da8-49e9-88ce-c2b6a70427a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:27.340546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db79417-1da8-49e9-88ce-c2b6a70427a0 admin admin] PATH_INFO: `/v3/projects/25e666c4a15b4def86ead990aba121f7/users/9c2faaf082a34c2eb654012695d91bda/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:27.345087 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f92d5-15c7-45b8-bdda-3388bdd73a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:27.363592 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f92d5-15c7-45b8-bdda-3388bdd73a67 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:27.363592 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f92d5-15c7-45b8-bdda-3388bdd73a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:27.363592 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f92d5-15c7-45b8-bdda-3388bdd73a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:27.363592 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f92d5-15c7-45b8-bdda-3388bdd73a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:27.363592 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f92d5-15c7-45b8-bdda-3388bdd73a67 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:27.363592 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1067/2120] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:27.364072 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f92d5-15c7-45b8-bdda-3388bdd73a67 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:27.364148 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db79417-1da8-49e9-88ce-c2b6a70427a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e666c4a15b4def86ead990aba121f7, user_id=9c2faaf082a34c2eb654012695d91bda, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:27.365113 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db79417-1da8-49e9-88ce-c2b6a70427a0 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:27.373067 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f92d5-15c7-45b8-bdda-3388bdd73a67 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:27.377915 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589d770-d0ca-48ae-854e-a8fc159e2469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:27.378609 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589d770-d0ca-48ae-854e-a8fc159e2469 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:27.378890 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589d770-d0ca-48ae-854e-a8fc159e2469 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:27.379170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589d770-d0ca-48ae-854e-a8fc159e2469 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:27.380124 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589d770-d0ca-48ae-854e-a8fc159e2469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:27.381790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589d770-d0ca-48ae-854e-a8fc159e2469 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:27.395267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1068/2121] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:27.395267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589d770-d0ca-48ae-854e-a8fc159e2469 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:27.403765 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589d770-d0ca-48ae-854e-a8fc159e2469 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:27.409051 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5e5b4-0520-4967-b6f4-5190885a71a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:27.409729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5e5b4-0520-4967-b6f4-5190885a71a1 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:27.410014 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5e5b4-0520-4967-b6f4-5190885a71a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:27.410295 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5e5b4-0520-4967-b6f4-5190885a71a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:27.411024 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5e5b4-0520-4967-b6f4-5190885a71a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:27.412799 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5e5b4-0520-4967-b6f4-5190885a71a1 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:27.424719 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1069/2122] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:27.425572 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5e5b4-0520-4967-b6f4-5190885a71a1 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:27.438284 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5e5b4-0520-4967-b6f4-5190885a71a1 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:27.443416 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5030b4b-c09f-4719-a90b-958b4ff32c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:27.444376 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5030b4b-c09f-4719-a90b-958b4ff32c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:27.444734 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5030b4b-c09f-4719-a90b-958b4ff32c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:27.445027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5030b4b-c09f-4719-a90b-958b4ff32c64 admin admin] PATH_INFO: `/v3/projects/b3c0c7b9db154fceb7579a0634dd17f9/users/1b285d3b900444c6acf9b7e723335577/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:27.464602 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5030b4b-c09f-4719-a90b-958b4ff32c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c0c7b9db154fceb7579a0634dd17f9, user_id=1b285d3b900444c6acf9b7e723335577, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:27.466972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1054/2123] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:27 2022] PUT /identity/v3/projects/25e666c4a15b4def86ead990aba121f7/users/9c2faaf082a34c2eb654012695d91bda/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:27.471794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5030b4b-c09f-4719-a90b-958b4ff32c64 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:27.471938 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db79417-1da8-49e9-88ce-c2b6a70427a0 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:27.492776 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:27.546227 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1070/2124] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:27 2022] PUT /identity/v3/projects/b3c0c7b9db154fceb7579a0634dd17f9/users/1b285d3b900444c6acf9b7e723335577/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:27.549353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db79417-1da8-49e9-88ce-c2b6a70427a0 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:27.549459 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5126cba-ab9a-49e1-9abc-5d73f8912a58 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:27.549459 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5126cba-ab9a-49e1-9abc-5d73f8912a58 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:27.549459 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5126cba-ab9a-49e1-9abc-5d73f8912a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:27.567620 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-a5126cba-ab9a-49e1-9abc-5d73f8912a58 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:27.568975 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-a5126cba-ab9a-49e1-9abc-5d73f8912a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:27.614284 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f897b-c111-423e-a909-396d24fd3f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:27.615352 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f897b-c111-423e-a909-396d24fd3f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:27.615909 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f897b-c111-423e-a909-396d24fd3f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:27.616369 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f897b-c111-423e-a909-396d24fd3f60 admin admin] PATH_INFO: `/v3/projects/4240fa56b6354ba0a33c477757a8a55d/users/fcaa203456b1470da17d48b90574919f/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:27.645035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f897b-c111-423e-a909-396d24fd3f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4240fa56b6354ba0a33c477757a8a55d, user_id=fcaa203456b1470da17d48b90574919f, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:27.645035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f897b-c111-423e-a909-396d24fd3f60 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:27.669747 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1071/2125] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:27.670882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5126cba-ab9a-49e1-9abc-5d73f8912a58 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:27.686754 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5126cba-ab9a-49e1-9abc-5d73f8912a58 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:27.695710 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46539b4b-3e10-4a88-92ff-cfdfe1ea72f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:27.696431 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46539b4b-3e10-4a88-92ff-cfdfe1ea72f5 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:27.696793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46539b4b-3e10-4a88-92ff-cfdfe1ea72f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:27.697302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46539b4b-3e10-4a88-92ff-cfdfe1ea72f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:27.697922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46539b4b-3e10-4a88-92ff-cfdfe1ea72f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:27.699503 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46539b4b-3e10-4a88-92ff-cfdfe1ea72f5 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:27.702609 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:27.713575 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1072/2126] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:27.714046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46539b4b-3e10-4a88-92ff-cfdfe1ea72f5 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:27.716043 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-46539b4b-3e10-4a88-92ff-cfdfe1ea72f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:27.736311 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1055/2127] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:27 2022] PUT /identity/v3/projects/4240fa56b6354ba0a33c477757a8a55d/users/fcaa203456b1470da17d48b90574919f/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:27.737797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f897b-c111-423e-a909-396d24fd3f60 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:27.787656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46539b4b-3e10-4a88-92ff-cfdfe1ea72f5 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:27.827085 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f897b-c111-423e-a909-396d24fd3f60 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:27.834088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8cb88-09fd-4d6c-add0-8152234e66bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:27.835878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8cb88-09fd-4d6c-add0-8152234e66bb admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:27.835878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8cb88-09fd-4d6c-add0-8152234e66bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:27.836144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8cb88-09fd-4d6c-add0-8152234e66bb admin admin] PATH_INFO: `/v3/projects/b3c0c7b9db154fceb7579a0634dd17f9/users/1b285d3b900444c6acf9b7e723335577/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:27.838420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8cb88-09fd-4d6c-add0-8152234e66bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c0c7b9db154fceb7579a0634dd17f9, user_id=1b285d3b900444c6acf9b7e723335577, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:27.841165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8cb88-09fd-4d6c-add0-8152234e66bb admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:27.852886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1056/2128] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:27 2022] PUT /identity/v3/projects/b3c0c7b9db154fceb7579a0634dd17f9/users/1b285d3b900444c6acf9b7e723335577/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:27.854300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a747b5a-1e47-4239-855e-d7f86ac5b315 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:27.854600 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a747b5a-1e47-4239-855e-d7f86ac5b315 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:27.854887 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a747b5a-1e47-4239-855e-d7f86ac5b315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:27.863460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b33e7c-a34d-4576-90a6-6acb64eebb46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:27.864247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b33e7c-a34d-4576-90a6-6acb64eebb46 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:27.864880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b33e7c-a34d-4576-90a6-6acb64eebb46 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:27.865173 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b33e7c-a34d-4576-90a6-6acb64eebb46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:27.876031 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b33e7c-a34d-4576-90a6-6acb64eebb46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:27.877555 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b33e7c-a34d-4576-90a6-6acb64eebb46 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:27.890057 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-6a747b5a-1e47-4239-855e-d7f86ac5b315 None None] MFA Rules not processed for user `fcaa203456b1470da17d48b90574919f`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:27.893244 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1073/2129] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:27.893359 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-6a747b5a-1e47-4239-855e-d7f86ac5b315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:27.893800 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431972a6-3967-4aba-87f1-87c5428c192e None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:27.894466 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431972a6-3967-4aba-87f1-87c5428c192e None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:27.894762 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431972a6-3967-4aba-87f1-87c5428c192e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:27.941318 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-431972a6-3967-4aba-87f1-87c5428c192e None None] MFA Rules not processed for user `1b285d3b900444c6acf9b7e723335577`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:27.942694 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-431972a6-3967-4aba-87f1-87c5428c192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:27.975663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1057/2130] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:27.981436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a747b5a-1e47-4239-855e-d7f86ac5b315 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:28.027137 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1074/2131] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:28.037628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:28.041865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431972a6-3967-4aba-87f1-87c5428c192e None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:28.043517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-431972a6-3967-4aba-87f1-87c5428c192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:28.056221 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a747b5a-1e47-4239-855e-d7f86ac5b315 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:28.061319 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6803441-9740-4dc0-b9c1-b7915a58e286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:28.061945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6803441-9740-4dc0-b9c1-b7915a58e286 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:28.062230 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6803441-9740-4dc0-b9c1-b7915a58e286 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:28.062508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6803441-9740-4dc0-b9c1-b7915a58e286 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:28.063216 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6803441-9740-4dc0-b9c1-b7915a58e286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:28.065343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6803441-9740-4dc0-b9c1-b7915a58e286 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:28.117084 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431972a6-3967-4aba-87f1-87c5428c192e None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:28.121552 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaadd21-122e-462e-88b3-551bfb8eb2b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:28.122591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaadd21-122e-462e-88b3-551bfb8eb2b3 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:28.122729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaadd21-122e-462e-88b3-551bfb8eb2b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:28.123098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaadd21-122e-462e-88b3-551bfb8eb2b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:28.203185 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1058/2132] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:59:27 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:28.203288 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaadd21-122e-462e-88b3-551bfb8eb2b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:28.203288 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaadd21-122e-462e-88b3-551bfb8eb2b3 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:28.203462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6803441-9740-4dc0-b9c1-b7915a58e286 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:28.206657 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1075/2133] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:59:28.299413 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6803441-9740-4dc0-b9c1-b7915a58e286 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:28.309765 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ffb53-8bb2-4cb5-9f7d-626fc3d3c6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:28.310595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ffb53-8bb2-4cb5-9f7d-626fc3d3c6bf admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:28.311088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ffb53-8bb2-4cb5-9f7d-626fc3d3c6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:28.313162 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ffb53-8bb2-4cb5-9f7d-626fc3d3c6bf admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:28.314246 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ffb53-8bb2-4cb5-9f7d-626fc3d3c6bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:28.320576 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ffb53-8bb2-4cb5-9f7d-626fc3d3c6bf admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:28.490991 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1059/2134] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:28 2022] POST /identity/v3/users => generated 298 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:28.497310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaadd21-122e-462e-88b3-551bfb8eb2b3 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:28.511324 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaadd21-122e-462e-88b3-551bfb8eb2b3 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:28.516741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7a7df-259a-451e-99d6-65e72dc7536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:28.517434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7a7df-259a-451e-99d6-65e72dc7536c admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:28.523026 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7a7df-259a-451e-99d6-65e72dc7536c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:28.523026 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7a7df-259a-451e-99d6-65e72dc7536c admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:28.523026 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7a7df-259a-451e-99d6-65e72dc7536c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:28.523026 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7a7df-259a-451e-99d6-65e72dc7536c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:28.536597 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1076/2135] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:28.541213 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ffb53-8bb2-4cb5-9f7d-626fc3d3c6bf admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:28.552488 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ffb53-8bb2-4cb5-9f7d-626fc3d3c6bf admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:28.558624 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff5d82-7d4b-4a03-b91a-2600da89fd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:28.559537 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff5d82-7d4b-4a03-b91a-2600da89fd66 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:28.559826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff5d82-7d4b-4a03-b91a-2600da89fd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:28.560724 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff5d82-7d4b-4a03-b91a-2600da89fd66 admin admin] PATH_INFO: `/v3/projects/38545091acc24bb98eef65b0055f290b/users/cf1285dd9c36428789de557a324e5893/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:28.584313 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff5d82-7d4b-4a03-b91a-2600da89fd66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38545091acc24bb98eef65b0055f290b, user_id=cf1285dd9c36428789de557a324e5893, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:28.590481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff5d82-7d4b-4a03-b91a-2600da89fd66 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:28.596591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:28.696687 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1060/2136] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:28 2022] PUT /identity/v3/projects/38545091acc24bb98eef65b0055f290b/users/cf1285dd9c36428789de557a324e5893/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:59:28.700926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7a7df-259a-451e-99d6-65e72dc7536c admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:28.711226 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7a7df-259a-451e-99d6-65e72dc7536c admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:28.774968 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12dccf-dece-4714-b9f4-1a2d0b327338 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:28.775264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12dccf-dece-4714-b9f4-1a2d0b327338 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:28.776108 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12dccf-dece-4714-b9f4-1a2d0b327338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:28.789089 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7e2dc-f873-4ee8-9ca8-548dd81d57df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:28.790595 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7e2dc-f873-4ee8-9ca8-548dd81d57df admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:28.793971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7e2dc-f873-4ee8-9ca8-548dd81d57df admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:28.793971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7e2dc-f873-4ee8-9ca8-548dd81d57df admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:28.794294 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7e2dc-f873-4ee8-9ca8-548dd81d57df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:28.797980 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7e2dc-f873-4ee8-9ca8-548dd81d57df admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:28.809232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1077/2137] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:28.813213 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7e2dc-f873-4ee8-9ca8-548dd81d57df admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:28.814111 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-9d12dccf-dece-4714-b9f4-1a2d0b327338 None None] MFA Rules not processed for user `061d406d88034afa855750b04a8a1de6`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:28.816916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-9d12dccf-dece-4714-b9f4-1a2d0b327338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:28.824988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7e2dc-f873-4ee8-9ca8-548dd81d57df admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:28.830365 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3a5bf-31ba-4a9a-8066-6c3be285b7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:28.831598 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3a5bf-31ba-4a9a-8066-6c3be285b7d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:28.832047 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3a5bf-31ba-4a9a-8066-6c3be285b7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:28.832479 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3a5bf-31ba-4a9a-8066-6c3be285b7d5 admin admin] PATH_INFO: `/v3/projects/38545091acc24bb98eef65b0055f290b/users/cf1285dd9c36428789de557a324e5893/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:28.835527 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3a5bf-31ba-4a9a-8066-6c3be285b7d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38545091acc24bb98eef65b0055f290b, user_id=cf1285dd9c36428789de557a324e5893, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:28.838984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3a5bf-31ba-4a9a-8066-6c3be285b7d5 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:28.855001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1078/2138] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:28 2022] PUT /identity/v3/projects/38545091acc24bb98eef65b0055f290b/users/cf1285dd9c36428789de557a324e5893/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:28.865849 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dc1fe-a2be-47cf-b49c-ec548f387ce1 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:28.866693 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dc1fe-a2be-47cf-b49c-ec548f387ce1 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:28.867111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dc1fe-a2be-47cf-b49c-ec548f387ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:28.911928 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-944dc1fe-a2be-47cf-b49c-ec548f387ce1 None None] MFA Rules not processed for user `cf1285dd9c36428789de557a324e5893`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:28.913252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-944dc1fe-a2be-47cf-b49c-ec548f387ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:28.972740 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1061/2139] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:28.977669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb78d1-3519-490d-81d8-03ccaeda1508 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:28.979917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb78d1-3519-490d-81d8-03ccaeda1508 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:28.980217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb78d1-3519-490d-81d8-03ccaeda1508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:29.016260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-82eb78d1-3519-490d-81d8-03ccaeda1508 None None] MFA Rules not processed for user `bccecb6fc9ee4b2f98546fe39bf03ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:29.017185 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-82eb78d1-3519-490d-81d8-03ccaeda1508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:29.032691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1079/2140] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:59:29.045113 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944dc1fe-a2be-47cf-b49c-ec548f387ce1 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:29.084490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1062/2141] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:29.095979 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb78d1-3519-490d-81d8-03ccaeda1508 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:29.097345 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-82eb78d1-3519-490d-81d8-03ccaeda1508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:29.119025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944dc1fe-a2be-47cf-b49c-ec548f387ce1 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:29.124123 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a47df-7806-4fe8-bdb4-b5e82b3ce459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:29.125811 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a47df-7806-4fe8-bdb4-b5e82b3ce459 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:29.126279 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a47df-7806-4fe8-bdb4-b5e82b3ce459 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:29.126812 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a47df-7806-4fe8-bdb4-b5e82b3ce459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:29.128000 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:29.207538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a47df-7806-4fe8-bdb4-b5e82b3ce459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:29.209100 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a47df-7806-4fe8-bdb4-b5e82b3ce459 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:29.213522 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb78d1-3519-490d-81d8-03ccaeda1508 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:29.221905 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a564a2b-ce62-460d-a64d-afc950ec7b6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:29.221905 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a564a2b-ce62-460d-a64d-afc950ec7b6a service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:29.221905 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a564a2b-ce62-460d-a64d-afc950ec7b6a service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:29.221905 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a564a2b-ce62-460d-a64d-afc950ec7b6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:29.222620 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1080/2142] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:59:29.233138 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a564a2b-ce62-460d-a64d-afc950ec7b6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:29.235053 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a564a2b-ce62-460d-a64d-afc950ec7b6a service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:29.246812 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1063/2143] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:59:30.493070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:31.410119 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:31.551650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a47df-7806-4fe8-bdb4-b5e82b3ce459 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:31.553255 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ae6a47df-7806-4fe8-bdb4-b5e82b3ce459 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:31.567327 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a47df-7806-4fe8-bdb4-b5e82b3ce459 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:31.575502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9297c-00de-40e5-844d-5cb9d6cc8666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:31.575502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9297c-00de-40e5-844d-5cb9d6cc8666 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:31.575502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9297c-00de-40e5-844d-5cb9d6cc8666 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:31.575502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9297c-00de-40e5-844d-5cb9d6cc8666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:31.687510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9297c-00de-40e5-844d-5cb9d6cc8666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:31.690214 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9297c-00de-40e5-844d-5cb9d6cc8666 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:31.708979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1081/2144] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:32.877562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:33.635666 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a564a2b-ce62-460d-a64d-afc950ec7b6a service nova] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:33.654616 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a564a2b-ce62-460d-a64d-afc950ec7b6a service nova] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:33.662056 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c14f6-05f3-4933-9fb2-95255f01ac97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:33.664085 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c14f6-05f3-4933-9fb2-95255f01ac97 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:33.664725 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c14f6-05f3-4933-9fb2-95255f01ac97 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:33.665288 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c14f6-05f3-4933-9fb2-95255f01ac97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:33.687465 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c14f6-05f3-4933-9fb2-95255f01ac97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:33.701662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c14f6-05f3-4933-9fb2-95255f01ac97 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:33.714004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:33.724341 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1064/2145] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:59:34.182008 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9297c-00de-40e5-844d-5cb9d6cc8666 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:34.194908 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9297c-00de-40e5-844d-5cb9d6cc8666 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:34.204228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3dbe6-6794-40cb-99f0-4c85ac2c76f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:34.204995 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3dbe6-6794-40cb-99f0-4c85ac2c76f7 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:34.205504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3dbe6-6794-40cb-99f0-4c85ac2c76f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:34.205746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3dbe6-6794-40cb-99f0-4c85ac2c76f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:34.308583 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3dbe6-6794-40cb-99f0-4c85ac2c76f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:34.310677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3dbe6-6794-40cb-99f0-4c85ac2c76f7 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:34.328851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1082/2146] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:34.789328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:35.012339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15900cbe-a444-4df3-809c-e6d523b6dc51 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:35.013200 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15900cbe-a444-4df3-809c-e6d523b6dc51 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:35.013677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15900cbe-a444-4df3-809c-e6d523b6dc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:35.051786 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-15900cbe-a444-4df3-809c-e6d523b6dc51 None None] MFA Rules not processed for user `9c2faaf082a34c2eb654012695d91bda`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:35.053831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-15900cbe-a444-4df3-809c-e6d523b6dc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:35.172910 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1065/2147] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:35.183301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3dbe6-6794-40cb-99f0-4c85ac2c76f7 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:35.208941 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3dbe6-6794-40cb-99f0-4c85ac2c76f7 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:35.224781 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf7a86-6fa8-4612-9110-a9bc7166ddd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:35.226588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf7a86-6fa8-4612-9110-a9bc7166ddd5 service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:35.229834 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf7a86-6fa8-4612-9110-a9bc7166ddd5 service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:35.230398 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf7a86-6fa8-4612-9110-a9bc7166ddd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:35.250318 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf7a86-6fa8-4612-9110-a9bc7166ddd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:35.255828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf7a86-6fa8-4612-9110-a9bc7166ddd5 service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:35.285490 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1083/2148] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:59:35.953336 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:37.382974 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:38.290034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:38.693945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055632a-09d5-45b3-a44d-2ae3d2891b50 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:38.694328 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055632a-09d5-45b3-a44d-2ae3d2891b50 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:38.695057 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055632a-09d5-45b3-a44d-2ae3d2891b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:38.721476 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-b055632a-09d5-45b3-a44d-2ae3d2891b50 None None] MFA Rules not processed for user `9c2faaf082a34c2eb654012695d91bda`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:38.723243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-b055632a-09d5-45b3-a44d-2ae3d2891b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:38.739090 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1066/2149] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:38.779972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf7a86-6fa8-4612-9110-a9bc7166ddd5 service nova] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:38.857743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf7a86-6fa8-4612-9110-a9bc7166ddd5 service nova] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:38.863089 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818ee5e-38c6-45f8-91c9-7cc678d21b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:38.863991 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818ee5e-38c6-45f8-91c9-7cc678d21b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:38.864271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818ee5e-38c6-45f8-91c9-7cc678d21b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:38.864552 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818ee5e-38c6-45f8-91c9-7cc678d21b15 admin admin] PATH_INFO: `/v3/users/73622ae98f444912879c7190b7490110` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:38.866564 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818ee5e-38c6-45f8-91c9-7cc678d21b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73622ae98f444912879c7190b7490110)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:38.868787 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818ee5e-38c6-45f8-91c9-7cc678d21b15 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:39.103854 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b818ee5e-38c6-45f8-91c9-7cc678d21b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73622ae98f444912879c7190b7490110'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:39.112716 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b818ee5e-38c6-45f8-91c9-7cc678d21b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73622ae98f444912879c7190b7490110'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:39.200286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b818ee5e-38c6-45f8-91c9-7cc678d21b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73622ae98f444912879c7190b7490110'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:39.200286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b818ee5e-38c6-45f8-91c9-7cc678d21b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73622ae98f444912879c7190b7490110'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:39.201620 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b818ee5e-38c6-45f8-91c9-7cc678d21b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73622ae98f444912879c7190b7490110'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:39.224321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1084/2150] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:38 2022] DELETE /identity/v3/users/73622ae98f444912879c7190b7490110 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:39.230021 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0fa7d-85c6-41e4-93cc-e05a3fa945c4 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:39.230389 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0fa7d-85c6-41e4-93cc-e05a3fa945c4 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:39.230683 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0fa7d-85c6-41e4-93cc-e05a3fa945c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:39.250884 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-c2b0fa7d-85c6-41e4-93cc-e05a3fa945c4 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:39.252198 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c2b0fa7d-85c6-41e4-93cc-e05a3fa945c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:39.269881 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:39.329034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1067/2151] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:39.338978 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818ee5e-38c6-45f8-91c9-7cc678d21b15 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:39.341263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b818ee5e-38c6-45f8-91c9-7cc678d21b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:39.415017 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818ee5e-38c6-45f8-91c9-7cc678d21b15 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:39.418814 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2fae2-e82f-451d-bb3d-779c8f13a925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:39.419478 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2fae2-e82f-451d-bb3d-779c8f13a925 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:39.419765 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2fae2-e82f-451d-bb3d-779c8f13a925 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:39.420046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2fae2-e82f-451d-bb3d-779c8f13a925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:39.430432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2fae2-e82f-451d-bb3d-779c8f13a925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:39.431927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2fae2-e82f-451d-bb3d-779c8f13a925 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:39.442962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1085/2152] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:59:40.033665 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0fa7d-85c6-41e4-93cc-e05a3fa945c4 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:40.039495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c2b0fa7d-85c6-41e4-93cc-e05a3fa945c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:40.062041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0fa7d-85c6-41e4-93cc-e05a3fa945c4 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:40.075332 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85378ca1-ec5c-40f1-9b0d-1714fecf3b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:40.076464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85378ca1-ec5c-40f1-9b0d-1714fecf3b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:40.077143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85378ca1-ec5c-40f1-9b0d-1714fecf3b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:40.077895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85378ca1-ec5c-40f1-9b0d-1714fecf3b01 admin admin] PATH_INFO: `/v3/projects/9ae8619305cc43a6a83385c98121ef49` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:40.080058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85378ca1-ec5c-40f1-9b0d-1714fecf3b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ae8619305cc43a6a83385c98121ef49)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:40.082664 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85378ca1-ec5c-40f1-9b0d-1714fecf3b01 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:40.227089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:40.248025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-85378ca1-ec5c-40f1-9b0d-1714fecf3b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ae8619305cc43a6a83385c98121ef49', 'request_id': 'req-85378ca1-ec5c-40f1-9b0d-1714fecf3b01'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:40.341928 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-85378ca1-ec5c-40f1-9b0d-1714fecf3b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ae8619305cc43a6a83385c98121ef49', 'request_id': 'req-85378ca1-ec5c-40f1-9b0d-1714fecf3b01'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:40.349711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-85378ca1-ec5c-40f1-9b0d-1714fecf3b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ae8619305cc43a6a83385c98121ef49', 'request_id': 'req-85378ca1-ec5c-40f1-9b0d-1714fecf3b01'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:40.362137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-85378ca1-ec5c-40f1-9b0d-1714fecf3b01 admin admin] The token cache is being invalidate because project 9ae8619305cc43a6a83385c98121ef49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:40.363048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-85378ca1-ec5c-40f1-9b0d-1714fecf3b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:40.364617 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-85378ca1-ec5c-40f1-9b0d-1714fecf3b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:40.366900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1068/2153] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:40 2022] DELETE /identity/v3/projects/9ae8619305cc43a6a83385c98121ef49 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:40.375472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2fae2-e82f-451d-bb3d-779c8f13a925 service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:40.386338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2fae2-e82f-451d-bb3d-779c8f13a925 service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:40.449389 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb4a97-cb1f-44df-8014-00f266e867ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:40.450279 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb4a97-cb1f-44df-8014-00f266e867ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:40.450565 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb4a97-cb1f-44df-8014-00f266e867ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:40.450845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb4a97-cb1f-44df-8014-00f266e867ae admin admin] PATH_INFO: `/v3/users/fcaa203456b1470da17d48b90574919f` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:40.452087 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb4a97-cb1f-44df-8014-00f266e867ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcaa203456b1470da17d48b90574919f)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:40.454650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb4a97-cb1f-44df-8014-00f266e867ae admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:40.659262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a0bb4a97-cb1f-44df-8014-00f266e867ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcaa203456b1470da17d48b90574919f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:40.666980 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a0bb4a97-cb1f-44df-8014-00f266e867ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcaa203456b1470da17d48b90574919f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:40.744346 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a0bb4a97-cb1f-44df-8014-00f266e867ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcaa203456b1470da17d48b90574919f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:40.744346 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a0bb4a97-cb1f-44df-8014-00f266e867ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcaa203456b1470da17d48b90574919f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:40.744346 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a0bb4a97-cb1f-44df-8014-00f266e867ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcaa203456b1470da17d48b90574919f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:40.762438 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1086/2154] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:40 2022] DELETE /identity/v3/users/fcaa203456b1470da17d48b90574919f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:40.764308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:40.921583 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85378ca1-ec5c-40f1-9b0d-1714fecf3b01 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:40.923085 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-85378ca1-ec5c-40f1-9b0d-1714fecf3b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:40.951280 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85378ca1-ec5c-40f1-9b0d-1714fecf3b01 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:41.048990 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f80f3-326a-4eb6-8d66-acd85b91e2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:41.049928 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f80f3-326a-4eb6-8d66-acd85b91e2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:41.050203 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f80f3-326a-4eb6-8d66-acd85b91e2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:41.050656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f80f3-326a-4eb6-8d66-acd85b91e2b5 admin admin] PATH_INFO: `/v3/users/fd902c6ec95f4e73b79410d274a4b3a9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:41.052482 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f80f3-326a-4eb6-8d66-acd85b91e2b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd902c6ec95f4e73b79410d274a4b3a9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:41.055419 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f80f3-326a-4eb6-8d66-acd85b91e2b5 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:41.286488 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb4a97-cb1f-44df-8014-00f266e867ae admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:41.289451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-a0bb4a97-cb1f-44df-8014-00f266e867ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:41.318510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb4a97-cb1f-44df-8014-00f266e867ae admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:41.321376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-3c7f80f3-326a-4eb6-8d66-acd85b91e2b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd902c6ec95f4e73b79410d274a4b3a9'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:41.329522 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-3c7f80f3-326a-4eb6-8d66-acd85b91e2b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd902c6ec95f4e73b79410d274a4b3a9'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:41.330269 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118aca0-32a8-486d-8804-a65ac32f62ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:41.330532 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-3c7f80f3-326a-4eb6-8d66-acd85b91e2b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd902c6ec95f4e73b79410d274a4b3a9'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:41.331159 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118aca0-32a8-486d-8804-a65ac32f62ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:41.331449 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118aca0-32a8-486d-8804-a65ac32f62ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:41.331836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118aca0-32a8-486d-8804-a65ac32f62ea admin admin] PATH_INFO: `/v3/projects/4240fa56b6354ba0a33c477757a8a55d` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:41.334119 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118aca0-32a8-486d-8804-a65ac32f62ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=4240fa56b6354ba0a33c477757a8a55d)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:41.338670 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118aca0-32a8-486d-8804-a65ac32f62ea admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:41.419044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-3c7f80f3-326a-4eb6-8d66-acd85b91e2b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd902c6ec95f4e73b79410d274a4b3a9'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:41.419721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-3c7f80f3-326a-4eb6-8d66-acd85b91e2b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd902c6ec95f4e73b79410d274a4b3a9'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:41.455314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1069/2155] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:40 2022] DELETE /identity/v3/users/fd902c6ec95f4e73b79410d274a4b3a9 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:41.457473 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432a4f9-8b22-4e0a-9f07-3880b82efd2e None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:41.457857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432a4f9-8b22-4e0a-9f07-3880b82efd2e None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:41.458063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432a4f9-8b22-4e0a-9f07-3880b82efd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:41.480694 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-a432a4f9-8b22-4e0a-9f07-3880b82efd2e None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:41.494417 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a432a4f9-8b22-4e0a-9f07-3880b82efd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:41.513714 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6118aca0-32a8-486d-8804-a65ac32f62ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4240fa56b6354ba0a33c477757a8a55d', 'request_id': 'req-6118aca0-32a8-486d-8804-a65ac32f62ea'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:41.516436 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6118aca0-32a8-486d-8804-a65ac32f62ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4240fa56b6354ba0a33c477757a8a55d', 'request_id': 'req-6118aca0-32a8-486d-8804-a65ac32f62ea'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:41.603228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6118aca0-32a8-486d-8804-a65ac32f62ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4240fa56b6354ba0a33c477757a8a55d', 'request_id': 'req-6118aca0-32a8-486d-8804-a65ac32f62ea'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:41.613772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1070/2156] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:41.625065 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432a4f9-8b22-4e0a-9f07-3880b82efd2e None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:41.626695 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a432a4f9-8b22-4e0a-9f07-3880b82efd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:41.627075 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6118aca0-32a8-486d-8804-a65ac32f62ea admin admin] The token cache is being invalidate because project 4240fa56b6354ba0a33c477757a8a55d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:41.627643 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6118aca0-32a8-486d-8804-a65ac32f62ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:41.629937 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6118aca0-32a8-486d-8804-a65ac32f62ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:41.632226 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1087/2157] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:41 2022] DELETE /identity/v3/projects/4240fa56b6354ba0a33c477757a8a55d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:59:41.638460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118aca0-32a8-486d-8804-a65ac32f62ea admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:41.642776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6118aca0-32a8-486d-8804-a65ac32f62ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:41.665894 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118aca0-32a8-486d-8804-a65ac32f62ea admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:41.670971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b58181-8aba-4e9f-ba74-6b72b6c3892b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:41.671859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b58181-8aba-4e9f-ba74-6b72b6c3892b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:41.672154 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b58181-8aba-4e9f-ba74-6b72b6c3892b admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:41.672429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b58181-8aba-4e9f-ba74-6b72b6c3892b admin admin] PATH_INFO: `/v3/users/cf1285dd9c36428789de557a324e5893` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:41.674000 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b58181-8aba-4e9f-ba74-6b72b6c3892b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1285dd9c36428789de557a324e5893)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:41.675946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b58181-8aba-4e9f-ba74-6b72b6c3892b admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:41.700532 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:41.711924 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432a4f9-8b22-4e0a-9f07-3880b82efd2e None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:41.715695 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab831a0-94c7-4d8d-8eb4-b3998c0e178a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:41.716362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab831a0-94c7-4d8d-8eb4-b3998c0e178a service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:41.716681 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab831a0-94c7-4d8d-8eb4-b3998c0e178a service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:41.716973 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab831a0-94c7-4d8d-8eb4-b3998c0e178a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:41.718879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-aab831a0-94c7-4d8d-8eb4-b3998c0e178a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:41.732530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab831a0-94c7-4d8d-8eb4-b3998c0e178a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:41.734051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab831a0-94c7-4d8d-8eb4-b3998c0e178a service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:41.745329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1071/2158] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:41.782165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:41.877295 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-e8b58181-8aba-4e9f-ba74-6b72b6c3892b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1285dd9c36428789de557a324e5893'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:41.885905 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-e8b58181-8aba-4e9f-ba74-6b72b6c3892b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1285dd9c36428789de557a324e5893'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:42.005150 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-e8b58181-8aba-4e9f-ba74-6b72b6c3892b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1285dd9c36428789de557a324e5893'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:42.006225 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-e8b58181-8aba-4e9f-ba74-6b72b6c3892b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1285dd9c36428789de557a324e5893'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:42.007960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-e8b58181-8aba-4e9f-ba74-6b72b6c3892b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1285dd9c36428789de557a324e5893'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:42.027109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1088/2159] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:41 2022] DELETE /identity/v3/users/cf1285dd9c36428789de557a324e5893 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:42.198423 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab831a0-94c7-4d8d-8eb4-b3998c0e178a service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:42.201301 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-aab831a0-94c7-4d8d-8eb4-b3998c0e178a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:42.215548 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab831a0-94c7-4d8d-8eb4-b3998c0e178a service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:42.294994 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d53d9-6780-43eb-924a-134e09bbe3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:42.295956 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d53d9-6780-43eb-924a-134e09bbe3f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:42.296308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d53d9-6780-43eb-924a-134e09bbe3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:42.296692 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d53d9-6780-43eb-924a-134e09bbe3f0 admin admin] PATH_INFO: `/v3/projects/561651ced9884bc783f06c0d82fd89fc` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:42.298465 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d53d9-6780-43eb-924a-134e09bbe3f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=561651ced9884bc783f06c0d82fd89fc)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:42.302912 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d53d9-6780-43eb-924a-134e09bbe3f0 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:42.470033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-ad2d53d9-6780-43eb-924a-134e09bbe3f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561651ced9884bc783f06c0d82fd89fc', 'request_id': 'req-ad2d53d9-6780-43eb-924a-134e09bbe3f0'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:42.556172 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b58181-8aba-4e9f-ba74-6b72b6c3892b admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:42.556172 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e8b58181-8aba-4e9f-ba74-6b72b6c3892b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:42.579948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-ad2d53d9-6780-43eb-924a-134e09bbe3f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561651ced9884bc783f06c0d82fd89fc', 'request_id': 'req-ad2d53d9-6780-43eb-924a-134e09bbe3f0'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:42.592194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-ad2d53d9-6780-43eb-924a-134e09bbe3f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561651ced9884bc783f06c0d82fd89fc', 'request_id': 'req-ad2d53d9-6780-43eb-924a-134e09bbe3f0'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:42.594129 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b58181-8aba-4e9f-ba74-6b72b6c3892b admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:42.616914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-ad2d53d9-6780-43eb-924a-134e09bbe3f0 admin admin] The token cache is being invalidate because project 561651ced9884bc783f06c0d82fd89fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:42.617626 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-ad2d53d9-6780-43eb-924a-134e09bbe3f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:42.619282 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-ad2d53d9-6780-43eb-924a-134e09bbe3f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:42.621033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1072/2160] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:42 2022] DELETE /identity/v3/projects/561651ced9884bc783f06c0d82fd89fc => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:42.625606 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d53d9-6780-43eb-924a-134e09bbe3f0 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:42.627089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ad2d53d9-6780-43eb-924a-134e09bbe3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:42.670692 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181755a7-469a-4c1c-b831-daf9c529f1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:42.672187 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181755a7-469a-4c1c-b831-daf9c529f1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:42.673310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181755a7-469a-4c1c-b831-daf9c529f1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:42.673809 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181755a7-469a-4c1c-b831-daf9c529f1f0 admin admin] PATH_INFO: `/v3/projects/38545091acc24bb98eef65b0055f290b` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:42.675351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181755a7-469a-4c1c-b831-daf9c529f1f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38545091acc24bb98eef65b0055f290b)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:42.677792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181755a7-469a-4c1c-b831-daf9c529f1f0 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:42.710935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d53d9-6780-43eb-924a-134e09bbe3f0 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:42.716229 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a994e6-8ed0-402d-b302-68cbdf6344f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:42.719817 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a994e6-8ed0-402d-b302-68cbdf6344f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:42.719817 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a994e6-8ed0-402d-b302-68cbdf6344f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:42.719817 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a994e6-8ed0-402d-b302-68cbdf6344f0 admin admin] PATH_INFO: `/v3/users/1b285d3b900444c6acf9b7e723335577` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:42.719817 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a994e6-8ed0-402d-b302-68cbdf6344f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b285d3b900444c6acf9b7e723335577)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:42.721731 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a994e6-8ed0-402d-b302-68cbdf6344f0 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:42.847683 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-181755a7-469a-4c1c-b831-daf9c529f1f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38545091acc24bb98eef65b0055f290b', 'request_id': 'req-181755a7-469a-4c1c-b831-daf9c529f1f0'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:42.858325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-181755a7-469a-4c1c-b831-daf9c529f1f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38545091acc24bb98eef65b0055f290b', 'request_id': 'req-181755a7-469a-4c1c-b831-daf9c529f1f0'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:42.938096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-181755a7-469a-4c1c-b831-daf9c529f1f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38545091acc24bb98eef65b0055f290b', 'request_id': 'req-181755a7-469a-4c1c-b831-daf9c529f1f0'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:42.955183 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-181755a7-469a-4c1c-b831-daf9c529f1f0 admin admin] The token cache is being invalidate because project 38545091acc24bb98eef65b0055f290b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:42.956394 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-181755a7-469a-4c1c-b831-daf9c529f1f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:42.957601 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a3a994e6-8ed0-402d-b302-68cbdf6344f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b285d3b900444c6acf9b7e723335577'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:42.958042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-181755a7-469a-4c1c-b831-daf9c529f1f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:42.961500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1089/2161] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:42 2022] DELETE /identity/v3/projects/38545091acc24bb98eef65b0055f290b => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:59:42.969101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a3a994e6-8ed0-402d-b302-68cbdf6344f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b285d3b900444c6acf9b7e723335577'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:42.969362 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f60e4e-67cc-4fa8-995a-4890fbab1922 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:42.969507 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f60e4e-67cc-4fa8-995a-4890fbab1922 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:42.969634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a3a994e6-8ed0-402d-b302-68cbdf6344f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b285d3b900444c6acf9b7e723335577'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:42.973112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f60e4e-67cc-4fa8-995a-4890fbab1922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:43.003413 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-91f60e4e-67cc-4fa8-995a-4890fbab1922 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:43.004932 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-91f60e4e-67cc-4fa8-995a-4890fbab1922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:43.078407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1090/2162] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:43.083263 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a3a994e6-8ed0-402d-b302-68cbdf6344f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b285d3b900444c6acf9b7e723335577'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:43.085741 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a3a994e6-8ed0-402d-b302-68cbdf6344f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b285d3b900444c6acf9b7e723335577'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:43.087914 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f5e6d-85f8-45f0-aed9-cd12032ea169 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:43.088274 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f5e6d-85f8-45f0-aed9-cd12032ea169 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:43.088654 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f5e6d-85f8-45f0-aed9-cd12032ea169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:43.113234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-8d0f5e6d-85f8-45f0-aed9-cd12032ea169 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:43.118557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-8d0f5e6d-85f8-45f0-aed9-cd12032ea169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:43.125430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1073/2163] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 10:59:42 2022] DELETE /identity/v3/users/1b285d3b900444c6acf9b7e723335577 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:43.128551 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1091/2164] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:59:43.129531 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a994e6-8ed0-402d-b302-68cbdf6344f0 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:43.218872 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a994e6-8ed0-402d-b302-68cbdf6344f0 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:43.226002 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530e99d-f0de-49ed-86b0-2464c33e21de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:43.227098 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530e99d-f0de-49ed-86b0-2464c33e21de admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:43.227609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530e99d-f0de-49ed-86b0-2464c33e21de admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:43.227981 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530e99d-f0de-49ed-86b0-2464c33e21de admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:43.229296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530e99d-f0de-49ed-86b0-2464c33e21de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:59:43.229848 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530e99d-f0de-49ed-86b0-2464c33e21de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:43.233174 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530e99d-f0de-49ed-86b0-2464c33e21de admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:43.260625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1074/2165] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:59:43.261815 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f5e6d-85f8-45f0-aed9-cd12032ea169 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:43.272938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f5e6d-85f8-45f0-aed9-cd12032ea169 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:43.278632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5df74-ca60-4749-805a-ecfa2bb665e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:43.279396 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5df74-ca60-4749-805a-ecfa2bb665e9 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:43.279752 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5df74-ca60-4749-805a-ecfa2bb665e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:43.280096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5df74-ca60-4749-805a-ecfa2bb665e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:43.281072 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5df74-ca60-4749-805a-ecfa2bb665e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:43.283696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5df74-ca60-4749-805a-ecfa2bb665e9 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:43.403705 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1092/2166] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:59:43 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:43.407734 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530e99d-f0de-49ed-86b0-2464c33e21de admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:43.423107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530e99d-f0de-49ed-86b0-2464c33e21de admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:43.516583 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f615f-f00f-4eff-800c-fde1ab6683e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:43.517985 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f615f-f00f-4eff-800c-fde1ab6683e5 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:43.518282 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f615f-f00f-4eff-800c-fde1ab6683e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:43.518684 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f615f-f00f-4eff-800c-fde1ab6683e5 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:43.519404 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f615f-f00f-4eff-800c-fde1ab6683e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:43.521926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f615f-f00f-4eff-800c-fde1ab6683e5 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:43.636406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1075/2167] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:43 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:59:43.637770 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5df74-ca60-4749-805a-ecfa2bb665e9 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:43.649579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5df74-ca60-4749-805a-ecfa2bb665e9 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:43.657246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c22ac-4f22-4415-8dc7-96d78c2effee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:43.657946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c22ac-4f22-4415-8dc7-96d78c2effee admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:43.658245 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c22ac-4f22-4415-8dc7-96d78c2effee admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:43.658531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c22ac-4f22-4415-8dc7-96d78c2effee admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:43.659291 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c22ac-4f22-4415-8dc7-96d78c2effee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:43.661016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c22ac-4f22-4415-8dc7-96d78c2effee admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:43.681024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f615f-f00f-4eff-800c-fde1ab6683e5 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:43.683134 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-2a0f615f-f00f-4eff-800c-fde1ab6683e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:43.689025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1093/2168] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:43.692068 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c22ac-4f22-4415-8dc7-96d78c2effee admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:43.696773 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f615f-f00f-4eff-800c-fde1ab6683e5 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:43.704209 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c22ac-4f22-4415-8dc7-96d78c2effee admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:43.712977 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d06ed-7198-4ece-9eb9-7cd593ae581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:43.714501 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d06ed-7198-4ece-9eb9-7cd593ae581c admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:43.715206 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d06ed-7198-4ece-9eb9-7cd593ae581c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:43.715847 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d06ed-7198-4ece-9eb9-7cd593ae581c admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:43.715928 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3db64-8844-4160-b3ec-10b0aac5f64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:43.716883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3db64-8844-4160-b3ec-10b0aac5f64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:43.717177 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3db64-8844-4160-b3ec-10b0aac5f64c admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:43.717462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3db64-8844-4160-b3ec-10b0aac5f64c admin admin] PATH_INFO: `/v3/projects/b3c0c7b9db154fceb7579a0634dd17f9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:43.718171 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d06ed-7198-4ece-9eb9-7cd593ae581c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:43.719328 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3db64-8844-4160-b3ec-10b0aac5f64c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c0c7b9db154fceb7579a0634dd17f9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:43.721428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3db64-8844-4160-b3ec-10b0aac5f64c admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:43.722176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d06ed-7198-4ece-9eb9-7cd593ae581c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:43.735258 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1094/2169] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:43.739336 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d06ed-7198-4ece-9eb9-7cd593ae581c admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:43.758490 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d06ed-7198-4ece-9eb9-7cd593ae581c admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:43.764033 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172610b-172c-4167-a118-4a8966d4be5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:43.764971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172610b-172c-4167-a118-4a8966d4be5c admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:43.765269 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172610b-172c-4167-a118-4a8966d4be5c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:43.765539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172610b-172c-4167-a118-4a8966d4be5c admin admin] PATH_INFO: `/v3/projects/3a42085bfa2a470db6a254e3db656919/users/63a8775de0ea405793d65dbdf9afc2c1/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:43.797114 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172610b-172c-4167-a118-4a8966d4be5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a42085bfa2a470db6a254e3db656919, user_id=63a8775de0ea405793d65dbdf9afc2c1, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:43.801041 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172610b-172c-4167-a118-4a8966d4be5c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:43.920767 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1095/2170] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:43 2022] PUT /identity/v3/projects/3a42085bfa2a470db6a254e3db656919/users/63a8775de0ea405793d65dbdf9afc2c1/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:59:43.937790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c7cee-97d4-4077-b6cf-bfd280add008 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:43.938214 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c7cee-97d4-4077-b6cf-bfd280add008 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:43.938609 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c7cee-97d4-4077-b6cf-bfd280add008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:43.947470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-41c3db64-8844-4160-b3ec-10b0aac5f64c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c0c7b9db154fceb7579a0634dd17f9', 'request_id': 'req-41c3db64-8844-4160-b3ec-10b0aac5f64c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:43.984331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-d85c7cee-97d4-4077-b6cf-bfd280add008 None None] MFA Rules not processed for user `63a8775de0ea405793d65dbdf9afc2c1`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:43.986474 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d85c7cee-97d4-4077-b6cf-bfd280add008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:44.049354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-41c3db64-8844-4160-b3ec-10b0aac5f64c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c0c7b9db154fceb7579a0634dd17f9', 'request_id': 'req-41c3db64-8844-4160-b3ec-10b0aac5f64c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:44.056599 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-41c3db64-8844-4160-b3ec-10b0aac5f64c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c0c7b9db154fceb7579a0634dd17f9', 'request_id': 'req-41c3db64-8844-4160-b3ec-10b0aac5f64c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:44.081326 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-41c3db64-8844-4160-b3ec-10b0aac5f64c admin admin] The token cache is being invalidate because project b3c0c7b9db154fceb7579a0634dd17f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:59:44.085776 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-41c3db64-8844-4160-b3ec-10b0aac5f64c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:44.085776 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-41c3db64-8844-4160-b3ec-10b0aac5f64c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:59:44.087891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1076/2171] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 10:59:43 2022] DELETE /identity/v3/projects/b3c0c7b9db154fceb7579a0634dd17f9 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:44.093600 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c36057-69fd-42d5-ab0d-3ef2a2eef862 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:44.097660 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c36057-69fd-42d5-ab0d-3ef2a2eef862 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:44.098134 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c36057-69fd-42d5-ab0d-3ef2a2eef862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:44.103611 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1096/2172] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:44.116885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c7cee-97d4-4077-b6cf-bfd280add008 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:44.118324 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d85c7cee-97d4-4077-b6cf-bfd280add008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:44.127808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-23c36057-69fd-42d5-ab0d-3ef2a2eef862 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:44.129328 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-23c36057-69fd-42d5-ab0d-3ef2a2eef862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:44.196897 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c7cee-97d4-4077-b6cf-bfd280add008 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:44.205406 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2f874-15a9-448b-b480-470cc9f61764 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06498e12426947908d5217e2c948519d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:44.206161 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2f874-15a9-448b-b480-470cc9f61764 service glance] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:44.209051 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2f874-15a9-448b-b480-470cc9f61764 service glance] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:44.210472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2f874-15a9-448b-b480-470cc9f61764 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:44.213333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6cb2f874-15a9-448b-b480-470cc9f61764 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:44.228601 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1077/2173] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:59:44.239342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2f874-15a9-448b-b480-470cc9f61764 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:44.240038 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b5f6d-4d2b-43ff-b7c6-227b09e27196 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:44.240815 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b5f6d-4d2b-43ff-b7c6-227b09e27196 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:44.241131 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b5f6d-4d2b-43ff-b7c6-227b09e27196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:44.243860 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2f874-15a9-448b-b480-470cc9f61764 service glance] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:44.259718 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1097/2174] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:59:44.265378 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-e54b5f6d-4d2b-43ff-b7c6-227b09e27196 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:44.267419 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e54b5f6d-4d2b-43ff-b7c6-227b09e27196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:44.305095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1078/2175] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:44.313584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2f874-15a9-448b-b480-470cc9f61764 service glance] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:44.324452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2f874-15a9-448b-b480-470cc9f61764 service glance] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:44.330066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdbc47-c04e-4e4d-a9f5-301f282457f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:44.330866 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdbc47-c04e-4e4d-a9f5-301f282457f1 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:44.331350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdbc47-c04e-4e4d-a9f5-301f282457f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:44.331630 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdbc47-c04e-4e4d-a9f5-301f282457f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:44.332373 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdbc47-c04e-4e4d-a9f5-301f282457f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:59:44.332710 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdbc47-c04e-4e4d-a9f5-301f282457f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:44.334329 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdbc47-c04e-4e4d-a9f5-301f282457f1 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:44.344992 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:44.352692 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1098/2176] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 10:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:59:44.354656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b5f6d-4d2b-43ff-b7c6-227b09e27196 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:44.366903 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b5f6d-4d2b-43ff-b7c6-227b09e27196 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:44.377292 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182e252-de3f-4ca4-9c5c-70e308ef1388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:44.381989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182e252-de3f-4ca4-9c5c-70e308ef1388 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:44.381989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182e252-de3f-4ca4-9c5c-70e308ef1388 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:44.381989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182e252-de3f-4ca4-9c5c-70e308ef1388 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:44.381989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182e252-de3f-4ca4-9c5c-70e308ef1388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:44.381989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182e252-de3f-4ca4-9c5c-70e308ef1388 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:44.427666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:44.495647 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1079/2177] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 10:59:44 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:44.501497 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdbc47-c04e-4e4d-a9f5-301f282457f1 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:44.507940 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdbc47-c04e-4e4d-a9f5-301f282457f1 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:44.589027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88b106-ccc7-40f6-9683-03fb554708c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:44.589725 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88b106-ccc7-40f6-9683-03fb554708c6 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:44.590014 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88b106-ccc7-40f6-9683-03fb554708c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:44.590483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88b106-ccc7-40f6-9683-03fb554708c6 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:44.591206 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88b106-ccc7-40f6-9683-03fb554708c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:44.593227 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88b106-ccc7-40f6-9683-03fb554708c6 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:44.737458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1099/2178] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 10:59:44 2022] POST /identity/v3/users => generated 291 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:59:44.741796 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182e252-de3f-4ca4-9c5c-70e308ef1388 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:44.752341 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182e252-de3f-4ca4-9c5c-70e308ef1388 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:44.757931 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23193f-1328-4bab-9f71-c84c64838011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:44.758602 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23193f-1328-4bab-9f71-c84c64838011 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:44.758883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23193f-1328-4bab-9f71-c84c64838011 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:44.759158 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23193f-1328-4bab-9f71-c84c64838011 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:44.759899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23193f-1328-4bab-9f71-c84c64838011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:44.761540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23193f-1328-4bab-9f71-c84c64838011 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:44.778939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1080/2179] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:59:44.780624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88b106-ccc7-40f6-9683-03fb554708c6 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:44.791315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88b106-ccc7-40f6-9683-03fb554708c6 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:44.796234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46406bdd-58df-4cad-b14c-d8706cfd1065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:44.796939 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46406bdd-58df-4cad-b14c-d8706cfd1065 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:44.797246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46406bdd-58df-4cad-b14c-d8706cfd1065 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:44.797522 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46406bdd-58df-4cad-b14c-d8706cfd1065 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:44.798253 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46406bdd-58df-4cad-b14c-d8706cfd1065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:44.799865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46406bdd-58df-4cad-b14c-d8706cfd1065 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:44.814740 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1100/2180] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 10:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:59:44.815937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23193f-1328-4bab-9f71-c84c64838011 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:44.827189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23193f-1328-4bab-9f71-c84c64838011 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:44.832089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3d85e-2bc8-4e5a-b7d6-bd80a8721248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:44.833018 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3d85e-2bc8-4e5a-b7d6-bd80a8721248 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:44.833299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3d85e-2bc8-4e5a-b7d6-bd80a8721248 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:44.833578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3d85e-2bc8-4e5a-b7d6-bd80a8721248 admin admin] PATH_INFO: `/v3/projects/33512f60e9f1431cbad80af8e457fb44/users/84b50be01a034624bb3bf62d0fe481ab/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:44.857258 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3d85e-2bc8-4e5a-b7d6-bd80a8721248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33512f60e9f1431cbad80af8e457fb44, user_id=84b50be01a034624bb3bf62d0fe481ab, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:44.861007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3d85e-2bc8-4e5a-b7d6-bd80a8721248 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:44.968559 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1081/2181] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 10:59:44 2022] PUT /identity/v3/projects/33512f60e9f1431cbad80af8e457fb44/users/84b50be01a034624bb3bf62d0fe481ab/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:59:44.974476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936baa2-5bb8-4fe2-b193-6889c31ffa2d None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:44.974476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936baa2-5bb8-4fe2-b193-6889c31ffa2d None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:44.974476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936baa2-5bb8-4fe2-b193-6889c31ffa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:44.996940 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-9936baa2-5bb8-4fe2-b193-6889c31ffa2d None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:44.999149 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9936baa2-5bb8-4fe2-b193-6889c31ffa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:45.070187 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1101/2182] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:45.080125 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3d85e-2bc8-4e5a-b7d6-bd80a8721248 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:45.082343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-6fe3d85e-2bc8-4e5a-b7d6-bd80a8721248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:45.158618 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3d85e-2bc8-4e5a-b7d6-bd80a8721248 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:45.162579 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f26a0-9e57-4e65-868e-0025fc45403f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:45.164061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f26a0-9e57-4e65-868e-0025fc45403f service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:45.164350 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f26a0-9e57-4e65-868e-0025fc45403f service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:45.164690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f26a0-9e57-4e65-868e-0025fc45403f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:45.177012 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f26a0-9e57-4e65-868e-0025fc45403f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:45.178573 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f26a0-9e57-4e65-868e-0025fc45403f service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:45.193184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1082/2183] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:45.765128 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:46.223024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:46.986197 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1ab88-f013-4644-befb-6503165af310 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:46.987055 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1ab88-f013-4644-befb-6503165af310 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:46.987459 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1ab88-f013-4644-befb-6503165af310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:47.019394 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-9fe1ab88-f013-4644-befb-6503165af310 None None] MFA Rules not processed for user `84b50be01a034624bb3bf62d0fe481ab`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:47.020512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9fe1ab88-f013-4644-befb-6503165af310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:47.091388 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1102/2184] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:47.103739 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f26a0-9e57-4e65-868e-0025fc45403f service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:47.105283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-2a4f26a0-9e57-4e65-868e-0025fc45403f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:47.134083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:47.178831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f26a0-9e57-4e65-868e-0025fc45403f service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:47.182989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c247f8-433d-40cc-95e6-575fe97a31b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:47.183683 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c247f8-433d-40cc-95e6-575fe97a31b6 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:47.183970 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c247f8-433d-40cc-95e6-575fe97a31b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:47.185029 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c247f8-433d-40cc-95e6-575fe97a31b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:47.195279 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c247f8-433d-40cc-95e6-575fe97a31b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:47.196756 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c247f8-433d-40cc-95e6-575fe97a31b6 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:47.206326 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1083/2185] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:59:47.653596 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:48.247684 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:48.879634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:48.990470 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f7053-0508-4b60-815f-f09b6dfae7d5 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:48.990961 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f7053-0508-4b60-815f-f09b6dfae7d5 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:48.991460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f7053-0508-4b60-815f-f09b6dfae7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:49.014211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-4e1f7053-0508-4b60-815f-f09b6dfae7d5 None None] MFA Rules not processed for user `84b50be01a034624bb3bf62d0fe481ab`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:49.015463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-4e1f7053-0508-4b60-815f-f09b6dfae7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:49.023763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1103/2186] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 10:59:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:49.322490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c247f8-433d-40cc-95e6-575fe97a31b6 service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:49.323976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-90c247f8-433d-40cc-95e6-575fe97a31b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:49.335084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c247f8-433d-40cc-95e6-575fe97a31b6 service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:49.338827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa84e4-b9b4-4891-8eac-747e6b2e0e73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:49.339476 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa84e4-b9b4-4891-8eac-747e6b2e0e73 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:49.339763 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa84e4-b9b4-4891-8eac-747e6b2e0e73 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:49.340082 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa84e4-b9b4-4891-8eac-747e6b2e0e73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:49.343021 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-82fa84e4-b9b4-4891-8eac-747e6b2e0e73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:49.412140 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa84e4-b9b4-4891-8eac-747e6b2e0e73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:49.414234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa84e4-b9b4-4891-8eac-747e6b2e0e73 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:49.424318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1084/2187] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:49 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:49.582653 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:49.862541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:51.162528 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:51.259397 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:52.971223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:53.070601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:54.000587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:54.614544 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:54.905488 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:55.385351 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:55.839943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:56.422110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:57.139037 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:57.365705 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:57.507673 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:58.062628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:58.154358 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:58.473888 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:58.520089 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:59.316462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:59.405351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:00.711803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:01.051479 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:01.623504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab0359-7c97-4f11-b8d5-4d1f72f74887 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:01.624086 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab0359-7c97-4f11-b8d5-4d1f72f74887 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:01.624711 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab0359-7c97-4f11-b8d5-4d1f72f74887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:01.652980 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-c8ab0359-7c97-4f11-b8d5-4d1f72f74887 None None] MFA Rules not processed for user `c3f7f25cf67c40b5a03f4f692a198146`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:01.656261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c8ab0359-7c97-4f11-b8d5-4d1f72f74887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:01.725802 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1104/2188] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:00:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:01.962718 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:02.397553 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:03.529779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:03.869294 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:04.710626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:05.074586 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:05.636464 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:05.766852 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:06.059824 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:06.675839 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:07.003504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:07.187955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:07.739144 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:08.318291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:08.457804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=76,keystone:DELETE=22,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:09.705439 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:09.772739 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:10.342952 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:10.550853 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:11.299340 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:11.408045 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:13.675996 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa84e4-b9b4-4891-8eac-747e6b2e0e73 service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:13.677457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-82fa84e4-b9b4-4891-8eac-747e6b2e0e73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:13.765095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa84e4-b9b4-4891-8eac-747e6b2e0e73 service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:13.769733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ab1fb-36c4-4a1c-9520-ff1c354c8a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:13.770611 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ab1fb-36c4-4a1c-9520-ff1c354c8a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:13.770891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ab1fb-36c4-4a1c-9520-ff1c354c8a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:13.771167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ab1fb-36c4-4a1c-9520-ff1c354c8a0d admin admin] PATH_INFO: `/v3/users/63a8775de0ea405793d65dbdf9afc2c1` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:13.772373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ab1fb-36c4-4a1c-9520-ff1c354c8a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=63a8775de0ea405793d65dbdf9afc2c1)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:13.775037 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ab1fb-36c4-4a1c-9520-ff1c354c8a0d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:13.959310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-794ab1fb-36c4-4a1c-9520-ff1c354c8a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63a8775de0ea405793d65dbdf9afc2c1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:13.970033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-794ab1fb-36c4-4a1c-9520-ff1c354c8a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63a8775de0ea405793d65dbdf9afc2c1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:13.971168 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-794ab1fb-36c4-4a1c-9520-ff1c354c8a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63a8775de0ea405793d65dbdf9afc2c1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:14.059471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-794ab1fb-36c4-4a1c-9520-ff1c354c8a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63a8775de0ea405793d65dbdf9afc2c1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:14.059471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-794ab1fb-36c4-4a1c-9520-ff1c354c8a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63a8775de0ea405793d65dbdf9afc2c1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:14.083157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1085/2189] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:00:13 2022] DELETE /identity/v3/users/63a8775de0ea405793d65dbdf9afc2c1 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:14.088501 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845977a9-9d57-4a31-a754-c4b75b215651 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:14.089000 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845977a9-9d57-4a31-a754-c4b75b215651 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:14.089187 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845977a9-9d57-4a31-a754-c4b75b215651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:14.117902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-845977a9-9d57-4a31-a754-c4b75b215651 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:14.119586 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-845977a9-9d57-4a31-a754-c4b75b215651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:14.195641 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1105/2190] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:00:14.206786 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ab1fb-36c4-4a1c-9520-ff1c354c8a0d admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:14.208279 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-794ab1fb-36c4-4a1c-9520-ff1c354c8a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:14.212227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:14.325649 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ab1fb-36c4-4a1c-9520-ff1c354c8a0d admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:14.330593 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdf0b2-fe66-43aa-b4d1-ea3a99f6cbfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:14.331231 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdf0b2-fe66-43aa-b4d1-ea3a99f6cbfa service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:14.331512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdf0b2-fe66-43aa-b4d1-ea3a99f6cbfa service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:14.331890 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdf0b2-fe66-43aa-b4d1-ea3a99f6cbfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:14.343131 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdf0b2-fe66-43aa-b4d1-ea3a99f6cbfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:14.344590 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdf0b2-fe66-43aa-b4d1-ea3a99f6cbfa service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:14.355535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1086/2191] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:14.959823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845977a9-9d57-4a31-a754-c4b75b215651 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:14.962122 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-845977a9-9d57-4a31-a754-c4b75b215651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:14.975437 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845977a9-9d57-4a31-a754-c4b75b215651 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:14.980376 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84b6bd-c2a3-4eee-8274-0c3c964e806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:14.981296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84b6bd-c2a3-4eee-8274-0c3c964e806f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:14.981581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84b6bd-c2a3-4eee-8274-0c3c964e806f admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:14.981858 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84b6bd-c2a3-4eee-8274-0c3c964e806f admin admin] PATH_INFO: `/v3/projects/3a42085bfa2a470db6a254e3db656919` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:14.983093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84b6bd-c2a3-4eee-8274-0c3c964e806f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a42085bfa2a470db6a254e3db656919)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:14.985184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84b6bd-c2a3-4eee-8274-0c3c964e806f admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:15.086818 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-5d84b6bd-c2a3-4eee-8274-0c3c964e806f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a42085bfa2a470db6a254e3db656919', 'request_id': 'req-5d84b6bd-c2a3-4eee-8274-0c3c964e806f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:15.093566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-5d84b6bd-c2a3-4eee-8274-0c3c964e806f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a42085bfa2a470db6a254e3db656919', 'request_id': 'req-5d84b6bd-c2a3-4eee-8274-0c3c964e806f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:15.241756 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-5d84b6bd-c2a3-4eee-8274-0c3c964e806f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a42085bfa2a470db6a254e3db656919', 'request_id': 'req-5d84b6bd-c2a3-4eee-8274-0c3c964e806f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:15.265223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-5d84b6bd-c2a3-4eee-8274-0c3c964e806f admin admin] The token cache is being invalidate because project 3a42085bfa2a470db6a254e3db656919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:00:15.265223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-5d84b6bd-c2a3-4eee-8274-0c3c964e806f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:15.265223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-5d84b6bd-c2a3-4eee-8274-0c3c964e806f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:15.265223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1106/2192] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:00:14 2022] DELETE /identity/v3/projects/3a42085bfa2a470db6a254e3db656919 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:15.268476 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67a5f2-9dad-4916-a9e6-bdd1fa6b3925 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:15.269019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67a5f2-9dad-4916-a9e6-bdd1fa6b3925 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:15.269215 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67a5f2-9dad-4916-a9e6-bdd1fa6b3925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:15.335784 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-ba67a5f2-9dad-4916-a9e6-bdd1fa6b3925 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:15.337473 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ba67a5f2-9dad-4916-a9e6-bdd1fa6b3925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:15.426462 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1087/2193] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:15.436533 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2a082-6dbf-41d4-a53b-080406fa1a15 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:15.436847 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2a082-6dbf-41d4-a53b-080406fa1a15 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:15.437356 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2a082-6dbf-41d4-a53b-080406fa1a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:15.464580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-d1b2a082-6dbf-41d4-a53b-080406fa1a15 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:15.465607 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d1b2a082-6dbf-41d4-a53b-080406fa1a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:15.473771 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1107/2194] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:15.478989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67a5f2-9dad-4916-a9e6-bdd1fa6b3925 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:15.489398 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67a5f2-9dad-4916-a9e6-bdd1fa6b3925 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:15.495313 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a801f9-f712-4131-a532-595016d69099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:15.496443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a801f9-f712-4131-a532-595016d69099 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:15.497413 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a801f9-f712-4131-a532-595016d69099 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:15.497413 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a801f9-f712-4131-a532-595016d69099 admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:15.498321 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a801f9-f712-4131-a532-595016d69099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:00:15.498644 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a801f9-f712-4131-a532-595016d69099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:15.500828 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a801f9-f712-4131-a532-595016d69099 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:15.514665 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1088/2195] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:00:15.518960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2a082-6dbf-41d4-a53b-080406fa1a15 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:15.529228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2a082-6dbf-41d4-a53b-080406fa1a15 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:15.534630 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4184b-63df-4ba2-a632-996767c35b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:15.534770 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4184b-63df-4ba2-a632-996767c35b29 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:15.535034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4184b-63df-4ba2-a632-996767c35b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:15.535316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4184b-63df-4ba2-a632-996767c35b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:15.536246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4184b-63df-4ba2-a632-996767c35b29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:15.538421 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4184b-63df-4ba2-a632-996767c35b29 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:15.545078 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:15.684773 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1108/2196] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:00:15 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:15.688471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a801f9-f712-4131-a532-595016d69099 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:15.703284 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a801f9-f712-4131-a532-595016d69099 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:15.753900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:15.800405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f9e80-2fe5-478b-b8cf-fa6286137e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:15.801116 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f9e80-2fe5-478b-b8cf-fa6286137e8f admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:15.801585 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f9e80-2fe5-478b-b8cf-fa6286137e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:15.802208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f9e80-2fe5-478b-b8cf-fa6286137e8f admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:15.802946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f9e80-2fe5-478b-b8cf-fa6286137e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:15.806259 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f9e80-2fe5-478b-b8cf-fa6286137e8f admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:15.904318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1089/2197] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:00:15 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:15.905610 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4184b-63df-4ba2-a632-996767c35b29 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:15.922780 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4184b-63df-4ba2-a632-996767c35b29 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:15.931623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a128b-d393-4c1b-831a-e843b652d587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:15.933074 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a128b-d393-4c1b-831a-e843b652d587 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:15.933588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a128b-d393-4c1b-831a-e843b652d587 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:15.934077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a128b-d393-4c1b-831a-e843b652d587 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:15.935338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a128b-d393-4c1b-831a-e843b652d587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:15.937350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a128b-d393-4c1b-831a-e843b652d587 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:15.956301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1109/2198] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:15.957678 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f9e80-2fe5-478b-b8cf-fa6286137e8f admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:15.982007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f9e80-2fe5-478b-b8cf-fa6286137e8f admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:15.987215 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe75fc-cd61-4dab-9d82-9cbecaf8506a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:15.987996 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe75fc-cd61-4dab-9d82-9cbecaf8506a admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:15.991991 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe75fc-cd61-4dab-9d82-9cbecaf8506a admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:15.992433 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe75fc-cd61-4dab-9d82-9cbecaf8506a admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:15.993275 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe75fc-cd61-4dab-9d82-9cbecaf8506a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:15.994950 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe75fc-cd61-4dab-9d82-9cbecaf8506a admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:16.008873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1090/2199] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:16.013250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a128b-d393-4c1b-831a-e843b652d587 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:16.024402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a128b-d393-4c1b-831a-e843b652d587 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:16.030101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bc519-1ff6-44e2-acf1-213235bae292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:16.031009 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bc519-1ff6-44e2-acf1-213235bae292 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:16.031288 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bc519-1ff6-44e2-acf1-213235bae292 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:16.031564 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bc519-1ff6-44e2-acf1-213235bae292 admin admin] PATH_INFO: `/v3/projects/aeae7339493c4515baa9104e9a567a81/users/bccdf7ec1d274913aa64322a2a67b10c/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:16.048602 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48bc519-1ff6-44e2-acf1-213235bae292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeae7339493c4515baa9104e9a567a81, user_id=bccdf7ec1d274913aa64322a2a67b10c, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:16.051591 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48bc519-1ff6-44e2-acf1-213235bae292 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:16.154497 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1110/2200] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:16 2022] PUT /identity/v3/projects/aeae7339493c4515baa9104e9a567a81/users/bccdf7ec1d274913aa64322a2a67b10c/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:16.159858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbe7ea-c382-4319-8814-41724298d9a5 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:16.160151 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbe7ea-c382-4319-8814-41724298d9a5 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:16.160464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbe7ea-c382-4319-8814-41724298d9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:16.198618 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-43fbe7ea-c382-4319-8814-41724298d9a5 None None] MFA Rules not processed for user `bccdf7ec1d274913aa64322a2a67b10c`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:16.203320 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-43fbe7ea-c382-4319-8814-41724298d9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:16.289237 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1091/2201] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:00:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:16.298223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bc519-1ff6-44e2-acf1-213235bae292 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:16.301473 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e48bc519-1ff6-44e2-acf1-213235bae292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:16.388544 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bc519-1ff6-44e2-acf1-213235bae292 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:16.393060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95765e4a-b846-4aa1-a466-15537197a1d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:16.393804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95765e4a-b846-4aa1-a466-15537197a1d3 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:16.394101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95765e4a-b846-4aa1-a466-15537197a1d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:16.394384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95765e4a-b846-4aa1-a466-15537197a1d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:16.405467 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95765e4a-b846-4aa1-a466-15537197a1d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:16.407036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95765e4a-b846-4aa1-a466-15537197a1d3 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:16.418536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1111/2202] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:17.200941 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbe7ea-c382-4319-8814-41724298d9a5 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:17.202382 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-43fbe7ea-c382-4319-8814-41724298d9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:17.285334 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbe7ea-c382-4319-8814-41724298d9a5 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:17.291795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5bf4e-c8fe-4aed-943d-7ff8f7c99ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:17.293460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5bf4e-c8fe-4aed-943d-7ff8f7c99ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:17.293947 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5bf4e-c8fe-4aed-943d-7ff8f7c99ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:17.294419 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5bf4e-c8fe-4aed-943d-7ff8f7c99ca8 admin admin] PATH_INFO: `/v3/users/bccecb6fc9ee4b2f98546fe39bf03ba7` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:17.296257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5bf4e-c8fe-4aed-943d-7ff8f7c99ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bccecb6fc9ee4b2f98546fe39bf03ba7)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:17.298471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5bf4e-c8fe-4aed-943d-7ff8f7c99ca8 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:17.527761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:17.529651 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-acc5bf4e-c8fe-4aed-943d-7ff8f7c99ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bccecb6fc9ee4b2f98546fe39bf03ba7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:17.538258 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-acc5bf4e-c8fe-4aed-943d-7ff8f7c99ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bccecb6fc9ee4b2f98546fe39bf03ba7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:17.539597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-acc5bf4e-c8fe-4aed-943d-7ff8f7c99ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bccecb6fc9ee4b2f98546fe39bf03ba7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:17.645110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-acc5bf4e-c8fe-4aed-943d-7ff8f7c99ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bccecb6fc9ee4b2f98546fe39bf03ba7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:17.648984 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-acc5bf4e-c8fe-4aed-943d-7ff8f7c99ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bccecb6fc9ee4b2f98546fe39bf03ba7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:17.675443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1092/2203] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:00:17 2022] DELETE /identity/v3/users/bccecb6fc9ee4b2f98546fe39bf03ba7 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:17.997938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95765e4a-b846-4aa1-a466-15537197a1d3 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:18.010378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95765e4a-b846-4aa1-a466-15537197a1d3 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:18.084315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cd252-7feb-4ca0-82e4-2cd5b54f992f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:18.085259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cd252-7feb-4ca0-82e4-2cd5b54f992f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:18.085604 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cd252-7feb-4ca0-82e4-2cd5b54f992f admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:18.086477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cd252-7feb-4ca0-82e4-2cd5b54f992f admin admin] PATH_INFO: `/v3/projects/dfa5a5c0422e400890f3bcfa362a79da` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:18.087844 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cd252-7feb-4ca0-82e4-2cd5b54f992f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa5a5c0422e400890f3bcfa362a79da)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:18.089900 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cd252-7feb-4ca0-82e4-2cd5b54f992f admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:18.224457 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-970cd252-7feb-4ca0-82e4-2cd5b54f992f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa5a5c0422e400890f3bcfa362a79da', 'request_id': 'req-970cd252-7feb-4ca0-82e4-2cd5b54f992f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:18.231207 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:18.232723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-970cd252-7feb-4ca0-82e4-2cd5b54f992f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa5a5c0422e400890f3bcfa362a79da', 'request_id': 'req-970cd252-7feb-4ca0-82e4-2cd5b54f992f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:18.338729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-970cd252-7feb-4ca0-82e4-2cd5b54f992f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa5a5c0422e400890f3bcfa362a79da', 'request_id': 'req-970cd252-7feb-4ca0-82e4-2cd5b54f992f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:18.353671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-970cd252-7feb-4ca0-82e4-2cd5b54f992f admin admin] The token cache is being invalidate because project dfa5a5c0422e400890f3bcfa362a79da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:00:18.353963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-970cd252-7feb-4ca0-82e4-2cd5b54f992f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:18.354877 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-970cd252-7feb-4ca0-82e4-2cd5b54f992f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:18.359804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1112/2204] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:00:17 2022] DELETE /identity/v3/projects/dfa5a5c0422e400890f3bcfa362a79da => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:18.361255 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5bf4e-c8fe-4aed-943d-7ff8f7c99ca8 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:18.363883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-acc5bf4e-c8fe-4aed-943d-7ff8f7c99ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:18.380262 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5bf4e-c8fe-4aed-943d-7ff8f7c99ca8 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:18.468883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c0b44-0ab4-436a-b0bb-4c966a683b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:18.469772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c0b44-0ab4-436a-b0bb-4c966a683b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:18.470052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c0b44-0ab4-436a-b0bb-4c966a683b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:18.470328 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c0b44-0ab4-436a-b0bb-4c966a683b60 admin admin] PATH_INFO: `/v3/users/061d406d88034afa855750b04a8a1de6` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:18.471806 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c0b44-0ab4-436a-b0bb-4c966a683b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=061d406d88034afa855750b04a8a1de6)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:18.473852 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c0b44-0ab4-436a-b0bb-4c966a683b60 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:18.743945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-185c0b44-0ab4-436a-b0bb-4c966a683b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '061d406d88034afa855750b04a8a1de6'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:18.751474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-185c0b44-0ab4-436a-b0bb-4c966a683b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '061d406d88034afa855750b04a8a1de6'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:18.752213 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-185c0b44-0ab4-436a-b0bb-4c966a683b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '061d406d88034afa855750b04a8a1de6'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:18.825769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-185c0b44-0ab4-436a-b0bb-4c966a683b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '061d406d88034afa855750b04a8a1de6'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:18.826842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-185c0b44-0ab4-436a-b0bb-4c966a683b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '061d406d88034afa855750b04a8a1de6'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:18.847769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1093/2205] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:00:18 2022] DELETE /identity/v3/users/061d406d88034afa855750b04a8a1de6 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:19.198748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cd252-7feb-4ca0-82e4-2cd5b54f992f admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:19.200249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-970cd252-7feb-4ca0-82e4-2cd5b54f992f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:19.216491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cd252-7feb-4ca0-82e4-2cd5b54f992f admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:19.283311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41382a-d4de-4426-b18a-2958db07e96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:19.284782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41382a-d4de-4426-b18a-2958db07e96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:19.284782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41382a-d4de-4426-b18a-2958db07e96c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:19.285040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41382a-d4de-4426-b18a-2958db07e96c admin admin] PATH_INFO: `/v3/projects/ab16355968ea4e9dbf850c91760aa46b` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:19.286364 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41382a-d4de-4426-b18a-2958db07e96c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab16355968ea4e9dbf850c91760aa46b)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:19.288377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41382a-d4de-4426-b18a-2958db07e96c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:19.442434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-4e41382a-d4de-4426-b18a-2958db07e96c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab16355968ea4e9dbf850c91760aa46b', 'request_id': 'req-4e41382a-d4de-4426-b18a-2958db07e96c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:19.450109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-4e41382a-d4de-4426-b18a-2958db07e96c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab16355968ea4e9dbf850c91760aa46b', 'request_id': 'req-4e41382a-d4de-4426-b18a-2958db07e96c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:19.549452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-4e41382a-d4de-4426-b18a-2958db07e96c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab16355968ea4e9dbf850c91760aa46b', 'request_id': 'req-4e41382a-d4de-4426-b18a-2958db07e96c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:19.564049 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-4e41382a-d4de-4426-b18a-2958db07e96c admin admin] The token cache is being invalidate because project ab16355968ea4e9dbf850c91760aa46b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:00:19.575192 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-4e41382a-d4de-4426-b18a-2958db07e96c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:19.575192 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-4e41382a-d4de-4426-b18a-2958db07e96c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:19.575192 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1113/2206] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:00:19 2022] DELETE /identity/v3/projects/ab16355968ea4e9dbf850c91760aa46b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:19.575500 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbd261-e4d9-47ab-bcbd-cf834e6cff1a None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:19.575500 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbd261-e4d9-47ab-bcbd-cf834e6cff1a None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:19.575500 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbd261-e4d9-47ab-bcbd-cf834e6cff1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:19.598292 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-93fbd261-e4d9-47ab-bcbd-cf834e6cff1a None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:19.600239 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-93fbd261-e4d9-47ab-bcbd-cf834e6cff1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:19.661463 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:19.686743 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1094/2207] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:19.694850 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97590679-2a45-453d-9d57-e2655e9e8ed2 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:19.699806 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97590679-2a45-453d-9d57-e2655e9e8ed2 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:19.699806 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97590679-2a45-453d-9d57-e2655e9e8ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:19.718801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-97590679-2a45-453d-9d57-e2655e9e8ed2 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:19.720350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-97590679-2a45-453d-9d57-e2655e9e8ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:19.733545 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1114/2208] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:19.738607 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbd261-e4d9-47ab-bcbd-cf834e6cff1a None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:19.751745 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbd261-e4d9-47ab-bcbd-cf834e6cff1a None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:19.762551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe644101-3e8e-4e2b-9771-5ed7ce8a6fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:19.763401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe644101-3e8e-4e2b-9771-5ed7ce8a6fec admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:19.763971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe644101-3e8e-4e2b-9771-5ed7ce8a6fec admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:19.763971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe644101-3e8e-4e2b-9771-5ed7ce8a6fec admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:19.764746 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe644101-3e8e-4e2b-9771-5ed7ce8a6fec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:00:19.765071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe644101-3e8e-4e2b-9771-5ed7ce8a6fec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:19.767043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe644101-3e8e-4e2b-9771-5ed7ce8a6fec admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:19.779377 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1095/2209] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:00:19.784459 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97590679-2a45-453d-9d57-e2655e9e8ed2 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:19.795917 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97590679-2a45-453d-9d57-e2655e9e8ed2 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:19.801470 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01619960-29a6-43c7-8d71-51a8209181cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:19.802267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01619960-29a6-43c7-8d71-51a8209181cf admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:19.802621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01619960-29a6-43c7-8d71-51a8209181cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:19.802974 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01619960-29a6-43c7-8d71-51a8209181cf admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:19.803790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01619960-29a6-43c7-8d71-51a8209181cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:19.806638 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01619960-29a6-43c7-8d71-51a8209181cf admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:19.822490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe644101-3e8e-4e2b-9771-5ed7ce8a6fec admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:19.822490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-fe644101-3e8e-4e2b-9771-5ed7ce8a6fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:19.838141 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe644101-3e8e-4e2b-9771-5ed7ce8a6fec admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:19.847458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa16843-ab6c-439e-940a-060f529339ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:19.851683 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa16843-ab6c-439e-940a-060f529339ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:19.851683 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa16843-ab6c-439e-940a-060f529339ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:19.851683 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa16843-ab6c-439e-940a-060f529339ad admin admin] PATH_INFO: `/v3/users/bccdf7ec1d274913aa64322a2a67b10c` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:19.851683 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa16843-ab6c-439e-940a-060f529339ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=bccdf7ec1d274913aa64322a2a67b10c)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:19.853452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa16843-ab6c-439e-940a-060f529339ad admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:19.913041 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1115/2210] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:00:19 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:19.915082 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01619960-29a6-43c7-8d71-51a8209181cf admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:19.980654 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:19.995764 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01619960-29a6-43c7-8d71-51a8209181cf admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:20.000605 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb0e4f-79f9-424a-95a5-d34a9db46d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:20.006683 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb0e4f-79f9-424a-95a5-d34a9db46d50 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:20.006683 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb0e4f-79f9-424a-95a5-d34a9db46d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:20.006683 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb0e4f-79f9-424a-95a5-d34a9db46d50 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:20.006683 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb0e4f-79f9-424a-95a5-d34a9db46d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:20.006683 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb0e4f-79f9-424a-95a5-d34a9db46d50 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:20.096417 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-bfa16843-ab6c-439e-940a-060f529339ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bccdf7ec1d274913aa64322a2a67b10c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:20.121722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-bfa16843-ab6c-439e-940a-060f529339ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bccdf7ec1d274913aa64322a2a67b10c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:20.121722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-bfa16843-ab6c-439e-940a-060f529339ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bccdf7ec1d274913aa64322a2a67b10c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:20.176698 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1116/2211] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:00:19 2022] POST /identity/v3/users => generated 287 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:20.185240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb0e4f-79f9-424a-95a5-d34a9db46d50 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:20.189863 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9ddb0e4f-79f9-424a-95a5-d34a9db46d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:20.215691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb0e4f-79f9-424a-95a5-d34a9db46d50 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:20.225631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08785659-860e-4237-9b49-0fea225967ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:20.226929 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08785659-860e-4237-9b49-0fea225967ac admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:20.227229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08785659-860e-4237-9b49-0fea225967ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:20.227539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08785659-860e-4237-9b49-0fea225967ac admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:20.228548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08785659-860e-4237-9b49-0fea225967ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:20.231497 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08785659-860e-4237-9b49-0fea225967ac admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:20.233571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-bfa16843-ab6c-439e-940a-060f529339ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bccdf7ec1d274913aa64322a2a67b10c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:20.238701 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-bfa16843-ab6c-439e-940a-060f529339ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bccdf7ec1d274913aa64322a2a67b10c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:20.243263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1117/2212] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:20.248009 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08785659-860e-4237-9b49-0fea225967ac admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:20.268746 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1096/2213] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:00:19 2022] DELETE /identity/v3/users/bccdf7ec1d274913aa64322a2a67b10c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:20.268974 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08785659-860e-4237-9b49-0fea225967ac admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:20.270675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80f4ee-dcc0-4f79-9283-d08b40ea62ef None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:20.270964 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80f4ee-dcc0-4f79-9283-d08b40ea62ef None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:20.271884 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80f4ee-dcc0-4f79-9283-d08b40ea62ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:20.293059 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-5a80f4ee-dcc0-4f79-9283-d08b40ea62ef None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:20.294290 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-5a80f4ee-dcc0-4f79-9283-d08b40ea62ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:20.344722 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e5705-9e12-4a14-ab49-01c6c6481192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:20.345931 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e5705-9e12-4a14-ab49-01c6c6481192 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:20.346521 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e5705-9e12-4a14-ab49-01c6c6481192 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:20.347035 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e5705-9e12-4a14-ab49-01c6c6481192 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:20.349266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e5705-9e12-4a14-ab49-01c6c6481192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:20.352112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e5705-9e12-4a14-ab49-01c6c6481192 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:20.363184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1118/2214] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:00:20.372631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e5705-9e12-4a14-ab49-01c6c6481192 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:20.377996 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1097/2215] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:20.384055 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e5705-9e12-4a14-ab49-01c6c6481192 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:20.394981 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80f4ee-dcc0-4f79-9283-d08b40ea62ef None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:20.395310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8610e2-a1f1-4e3e-95c2-2740c5894a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:20.396566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8610e2-a1f1-4e3e-95c2-2740c5894a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:20.396978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-5a80f4ee-dcc0-4f79-9283-d08b40ea62ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:20.397238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8610e2-a1f1-4e3e-95c2-2740c5894a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:20.398703 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8610e2-a1f1-4e3e-95c2-2740c5894a80 admin admin] PATH_INFO: `/v3/projects/78c47619ef7e4bd4b2563391c015523b/users/1a1c2b8b9ba44e41a5b94931d49e2f51/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:20.430114 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8610e2-a1f1-4e3e-95c2-2740c5894a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c47619ef7e4bd4b2563391c015523b, user_id=1a1c2b8b9ba44e41a5b94931d49e2f51, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:20.436038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8610e2-a1f1-4e3e-95c2-2740c5894a80 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:20.483730 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:20.501358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80f4ee-dcc0-4f79-9283-d08b40ea62ef None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:20.511150 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c3ce0-c127-4268-a14f-8dc7516d537c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:20.511831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c3ce0-c127-4268-a14f-8dc7516d537c service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:20.512124 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c3ce0-c127-4268-a14f-8dc7516d537c service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:20.512433 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c3ce0-c127-4268-a14f-8dc7516d537c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:20.530424 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c3ce0-c127-4268-a14f-8dc7516d537c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:20.530424 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c3ce0-c127-4268-a14f-8dc7516d537c service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:20.541567 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1098/2216] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:20.571241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1119/2217] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:20 2022] PUT /identity/v3/projects/78c47619ef7e4bd4b2563391c015523b/users/1a1c2b8b9ba44e41a5b94931d49e2f51/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:20.571473 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5731b-5fd6-4d29-b092-479ea54dd9a5 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:20.571728 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5731b-5fd6-4d29-b092-479ea54dd9a5 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:20.572040 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5731b-5fd6-4d29-b092-479ea54dd9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:20.619960 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-99d5731b-5fd6-4d29-b092-479ea54dd9a5 None None] MFA Rules not processed for user `1a1c2b8b9ba44e41a5b94931d49e2f51`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:20.621480 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-99d5731b-5fd6-4d29-b092-479ea54dd9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:20.654984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fc87c-11ec-4fc7-9c49-adb5ef06fec0 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:20.655278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fc87c-11ec-4fc7-9c49-adb5ef06fec0 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:20.655559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fc87c-11ec-4fc7-9c49-adb5ef06fec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:20.692747 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-523fc87c-11ec-4fc7-9c49-adb5ef06fec0 None None] MFA Rules not processed for user `1b03d940626a449dbe904f02f3d70854`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:20.694022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-523fc87c-11ec-4fc7-9c49-adb5ef06fec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:20.725656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1099/2218] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:00:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:20.730103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5731b-5fd6-4d29-b092-479ea54dd9a5 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:20.811079 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1120/2219] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 23 11:00:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:00:20.880470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5731b-5fd6-4d29-b092-479ea54dd9a5 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:20.895968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fc87c-11ec-4fc7-9c49-adb5ef06fec0 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:20.896276 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b04c6-89e6-4bb9-b11c-ba7eef995eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:20.897204 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b04c6-89e6-4bb9-b11c-ba7eef995eef admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:20.899128 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-523fc87c-11ec-4fc7-9c49-adb5ef06fec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:20.899295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b04c6-89e6-4bb9-b11c-ba7eef995eef admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:20.899295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b04c6-89e6-4bb9-b11c-ba7eef995eef admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:20.899295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b04c6-89e6-4bb9-b11c-ba7eef995eef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:20.901980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b04c6-89e6-4bb9-b11c-ba7eef995eef admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:20.980467 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:21.027354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1100/2220] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:00:20 2022] POST /identity/v3/projects => generated 375 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:21.032094 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b04c6-89e6-4bb9-b11c-ba7eef995eef admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:21.078185 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fc87c-11ec-4fc7-9c49-adb5ef06fec0 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:21.170669 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b25e5-3750-4213-acd9-7e87bce7f88d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a54fa1c326f41e88688404a56b75c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:21.171007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b25e5-3750-4213-acd9-7e87bce7f88d service swift] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:21.171181 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b25e5-3750-4213-acd9-7e87bce7f88d service swift] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:21.171600 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b25e5-3750-4213-acd9-7e87bce7f88d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:21.177662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b04c6-89e6-4bb9-b11c-ba7eef995eef admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:21.185212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f3f24-146c-405a-98a0-a662d69f994a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:21.186809 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f3f24-146c-405a-98a0-a662d69f994a admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:21.187413 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f3f24-146c-405a-98a0-a662d69f994a admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:21.187845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f3f24-146c-405a-98a0-a662d69f994a admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:21.189258 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f3f24-146c-405a-98a0-a662d69f994a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:21.191625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f3f24-146c-405a-98a0-a662d69f994a admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:21.201409 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:21.259525 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b25e5-3750-4213-acd9-7e87bce7f88d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:21.261291 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b25e5-3750-4213-acd9-7e87bce7f88d service swift] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:21.285035 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1121/2221] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 23 11:00:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 11:00:21.286642 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13796b7d-ba68-48fa-af4e-80942e222376 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:21.287092 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13796b7d-ba68-48fa-af4e-80942e222376 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:21.287189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13796b7d-ba68-48fa-af4e-80942e222376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:21.346206 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1101/2222] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:00:21 2022] POST /identity/v3/users => generated 294 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:00:21.351762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f3f24-146c-405a-98a0-a662d69f994a admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:21.368600 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-13796b7d-ba68-48fa-af4e-80942e222376 None None] MFA Rules not processed for user `935cd7d4575941148be2d56a9fbdb88a`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:21.368742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-1c1f3f24-146c-405a-98a0-a662d69f994a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:21.368846 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-13796b7d-ba68-48fa-af4e-80942e222376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:21.402379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f3f24-146c-405a-98a0-a662d69f994a admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:21.425845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3e801-24dc-44f9-a983-bb4b28135ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:21.430365 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3e801-24dc-44f9-a983-bb4b28135ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:21.430365 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3e801-24dc-44f9-a983-bb4b28135ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:21.430365 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3e801-24dc-44f9-a983-bb4b28135ad4 admin admin] PATH_INFO: `/v3/projects/aeae7339493c4515baa9104e9a567a81` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:21.430365 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3e801-24dc-44f9-a983-bb4b28135ad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeae7339493c4515baa9104e9a567a81)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:21.434372 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3e801-24dc-44f9-a983-bb4b28135ad4 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:21.477893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1122/2223] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:00:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:21.481002 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13796b7d-ba68-48fa-af4e-80942e222376 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:21.511154 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13796b7d-ba68-48fa-af4e-80942e222376 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:21.521739 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02160ab6-e649-45eb-8c90-56048e3fdf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:21.522579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02160ab6-e649-45eb-8c90-56048e3fdf24 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:21.523596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02160ab6-e649-45eb-8c90-56048e3fdf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:21.523974 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02160ab6-e649-45eb-8c90-56048e3fdf24 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:21.524830 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02160ab6-e649-45eb-8c90-56048e3fdf24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:21.526536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02160ab6-e649-45eb-8c90-56048e3fdf24 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:21.541512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1123/2224] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:21.546202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02160ab6-e649-45eb-8c90-56048e3fdf24 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:21.563236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02160ab6-e649-45eb-8c90-56048e3fdf24 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:21.579916 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed384b-408c-4c79-9def-4fc106fda4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:21.581536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed384b-408c-4c79-9def-4fc106fda4a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:21.582955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed384b-408c-4c79-9def-4fc106fda4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:21.583456 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed384b-408c-4c79-9def-4fc106fda4a9 admin admin] PATH_INFO: `/v3/projects/792bb262df444b96bf732ae8901cfe79/users/39321bc86f244daaa8bbd2cda502ad65/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:21.627386 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-69f3e801-24dc-44f9-a983-bb4b28135ad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeae7339493c4515baa9104e9a567a81', 'request_id': 'req-69f3e801-24dc-44f9-a983-bb4b28135ad4'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:21.642519 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed384b-408c-4c79-9def-4fc106fda4a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=792bb262df444b96bf732ae8901cfe79, user_id=39321bc86f244daaa8bbd2cda502ad65, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:21.651934 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed384b-408c-4c79-9def-4fc106fda4a9 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:21.662401 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:21.730737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-69f3e801-24dc-44f9-a983-bb4b28135ad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeae7339493c4515baa9104e9a567a81', 'request_id': 'req-69f3e801-24dc-44f9-a983-bb4b28135ad4'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:21.741447 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-69f3e801-24dc-44f9-a983-bb4b28135ad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeae7339493c4515baa9104e9a567a81', 'request_id': 'req-69f3e801-24dc-44f9-a983-bb4b28135ad4'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:21.763807 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1124/2225] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:21 2022] PUT /identity/v3/projects/792bb262df444b96bf732ae8901cfe79/users/39321bc86f244daaa8bbd2cda502ad65/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:21.768286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed384b-408c-4c79-9def-4fc106fda4a9 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:21.778658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-69f3e801-24dc-44f9-a983-bb4b28135ad4 admin admin] The token cache is being invalidate because project aeae7339493c4515baa9104e9a567a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:00:21.778981 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-69f3e801-24dc-44f9-a983-bb4b28135ad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:21.779903 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-69f3e801-24dc-44f9-a983-bb4b28135ad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:21.783231 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1102/2226] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:00:21 2022] DELETE /identity/v3/projects/aeae7339493c4515baa9104e9a567a81 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:21.929058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed384b-408c-4c79-9def-4fc106fda4a9 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:21.929058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4575a-6337-475b-a667-311daca2b3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:21.929058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4575a-6337-475b-a667-311daca2b3dd admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:21.929058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4575a-6337-475b-a667-311daca2b3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:21.930216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4575a-6337-475b-a667-311daca2b3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:21.930216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4575a-6337-475b-a667-311daca2b3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:21.930216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4575a-6337-475b-a667-311daca2b3dd admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:21.941211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1125/2227] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:21.947686 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3e801-24dc-44f9-a983-bb4b28135ad4 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:21.949217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-69f3e801-24dc-44f9-a983-bb4b28135ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:22.042083 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3e801-24dc-44f9-a983-bb4b28135ad4 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:22.047506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98921d3-1324-4817-a32d-af435a5e9fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:22.048441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98921d3-1324-4817-a32d-af435a5e9fba admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:22.048824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98921d3-1324-4817-a32d-af435a5e9fba admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:22.049047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98921d3-1324-4817-a32d-af435a5e9fba admin admin] PATH_INFO: `/v3/projects/792bb262df444b96bf732ae8901cfe79/users/39321bc86f244daaa8bbd2cda502ad65/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:22.052169 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98921d3-1324-4817-a32d-af435a5e9fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=792bb262df444b96bf732ae8901cfe79, user_id=39321bc86f244daaa8bbd2cda502ad65, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:22.060471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98921d3-1324-4817-a32d-af435a5e9fba admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:22.084035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1103/2228] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:21 2022] PUT /identity/v3/projects/792bb262df444b96bf732ae8901cfe79/users/39321bc86f244daaa8bbd2cda502ad65/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:22.097885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e5e95-7414-4eb0-820a-1bf334e915e4 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:22.097885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e5e95-7414-4eb0-820a-1bf334e915e4 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:22.097885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e5e95-7414-4eb0-820a-1bf334e915e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:22.131098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-a73e5e95-7414-4eb0-820a-1bf334e915e4 None None] MFA Rules not processed for user `39321bc86f244daaa8bbd2cda502ad65`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:22.134868 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-a73e5e95-7414-4eb0-820a-1bf334e915e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:22.279149 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1126/2229] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:00:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:22.279978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98921d3-1324-4817-a32d-af435a5e9fba admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:22.281801 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-b98921d3-1324-4817-a32d-af435a5e9fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:22.374338 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98921d3-1324-4817-a32d-af435a5e9fba admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:22.378910 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426dd45-fa21-4578-846e-12b6125c7521 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:22.379806 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426dd45-fa21-4578-846e-12b6125c7521 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:22.380265 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426dd45-fa21-4578-846e-12b6125c7521 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:22.380723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426dd45-fa21-4578-846e-12b6125c7521 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:22.384481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-0426dd45-fa21-4578-846e-12b6125c7521 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:22.421558 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:22.493942 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426dd45-fa21-4578-846e-12b6125c7521 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:22.495586 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426dd45-fa21-4578-846e-12b6125c7521 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:22.507005 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1104/2230] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:00:26.099272 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e5e95-7414-4eb0-820a-1bf334e915e4 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:26.217374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e5e95-7414-4eb0-820a-1bf334e915e4 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:26.228102 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880739b4-ba46-4e6f-ba0d-3a9c6aea9ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:26.229965 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880739b4-ba46-4e6f-ba0d-3a9c6aea9ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:26.230466 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880739b4-ba46-4e6f-ba0d-3a9c6aea9ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:26.234248 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880739b4-ba46-4e6f-ba0d-3a9c6aea9ba2 admin admin] PATH_INFO: `/v3/users/1a1c2b8b9ba44e41a5b94931d49e2f51` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:26.234248 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880739b4-ba46-4e6f-ba0d-3a9c6aea9ba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a1c2b8b9ba44e41a5b94931d49e2f51)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:26.235139 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880739b4-ba46-4e6f-ba0d-3a9c6aea9ba2 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:26.259270 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:26.560781 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-880739b4-ba46-4e6f-ba0d-3a9c6aea9ba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a1c2b8b9ba44e41a5b94931d49e2f51'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:26.586805 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-880739b4-ba46-4e6f-ba0d-3a9c6aea9ba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a1c2b8b9ba44e41a5b94931d49e2f51'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:26.691723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-880739b4-ba46-4e6f-ba0d-3a9c6aea9ba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a1c2b8b9ba44e41a5b94931d49e2f51'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:26.692465 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-880739b4-ba46-4e6f-ba0d-3a9c6aea9ba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a1c2b8b9ba44e41a5b94931d49e2f51'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:26.693179 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-880739b4-ba46-4e6f-ba0d-3a9c6aea9ba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a1c2b8b9ba44e41a5b94931d49e2f51'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:26.720189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1127/2231] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:00:26 2022] DELETE /identity/v3/users/1a1c2b8b9ba44e41a5b94931d49e2f51 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:00:26.724581 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a79ad-3687-4060-a402-c50bb473c1f6 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:26.725864 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a79ad-3687-4060-a402-c50bb473c1f6 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:26.727151 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a79ad-3687-4060-a402-c50bb473c1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:26.752966 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-332a79ad-3687-4060-a402-c50bb473c1f6 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:26.752966 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-332a79ad-3687-4060-a402-c50bb473c1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:26.838121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1105/2232] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:26.845469 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880739b4-ba46-4e6f-ba0d-3a9c6aea9ba2 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:26.847017 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-880739b4-ba46-4e6f-ba0d-3a9c6aea9ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:26.931459 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880739b4-ba46-4e6f-ba0d-3a9c6aea9ba2 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:26.935368 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03cdf3-2d4a-4145-b31b-98cf6c27eef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:26.936183 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03cdf3-2d4a-4145-b31b-98cf6c27eef9 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:26.936562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03cdf3-2d4a-4145-b31b-98cf6c27eef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:26.936983 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03cdf3-2d4a-4145-b31b-98cf6c27eef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:26.955235 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c03cdf3-2d4a-4145-b31b-98cf6c27eef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:26.958060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c03cdf3-2d4a-4145-b31b-98cf6c27eef9 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:26.974606 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1128/2233] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:27.612741 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a79ad-3687-4060-a402-c50bb473c1f6 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:27.612741 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-332a79ad-3687-4060-a402-c50bb473c1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:27.645597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a79ad-3687-4060-a402-c50bb473c1f6 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:27.654665 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6578c-8e71-4e22-a311-d3c7404c50c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:27.655569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6578c-8e71-4e22-a311-d3c7404c50c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:27.655856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6578c-8e71-4e22-a311-d3c7404c50c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:27.656136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6578c-8e71-4e22-a311-d3c7404c50c1 admin admin] PATH_INFO: `/v3/projects/78c47619ef7e4bd4b2563391c015523b` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:27.657622 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6578c-8e71-4e22-a311-d3c7404c50c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c47619ef7e4bd4b2563391c015523b)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:27.669257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6578c-8e71-4e22-a311-d3c7404c50c1 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:27.840163 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-09f6578c-8e71-4e22-a311-d3c7404c50c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c47619ef7e4bd4b2563391c015523b', 'request_id': 'req-09f6578c-8e71-4e22-a311-d3c7404c50c1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:27.922313 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-09f6578c-8e71-4e22-a311-d3c7404c50c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c47619ef7e4bd4b2563391c015523b', 'request_id': 'req-09f6578c-8e71-4e22-a311-d3c7404c50c1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:27.930793 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-09f6578c-8e71-4e22-a311-d3c7404c50c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c47619ef7e4bd4b2563391c015523b', 'request_id': 'req-09f6578c-8e71-4e22-a311-d3c7404c50c1'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:27.955215 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-09f6578c-8e71-4e22-a311-d3c7404c50c1 admin admin] The token cache is being invalidate because project 78c47619ef7e4bd4b2563391c015523b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:00:27.955553 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-09f6578c-8e71-4e22-a311-d3c7404c50c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:27.956242 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-09f6578c-8e71-4e22-a311-d3c7404c50c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:27.959564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1106/2234] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:00:27 2022] DELETE /identity/v3/projects/78c47619ef7e4bd4b2563391c015523b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:27.967441 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03cdf3-2d4a-4145-b31b-98cf6c27eef9 service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:27.981082 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03cdf3-2d4a-4145-b31b-98cf6c27eef9 service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:28.079599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b7cdd-0854-4b31-bd12-b98ff4b8c8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:28.080550 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b7cdd-0854-4b31-bd12-b98ff4b8c8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:28.080865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b7cdd-0854-4b31-bd12-b98ff4b8c8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:28.081192 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b7cdd-0854-4b31-bd12-b98ff4b8c8ff admin admin] PATH_INFO: `/v3/users/39321bc86f244daaa8bbd2cda502ad65` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:28.082835 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b7cdd-0854-4b31-bd12-b98ff4b8c8ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=39321bc86f244daaa8bbd2cda502ad65)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:28.086219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b7cdd-0854-4b31-bd12-b98ff4b8c8ff admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:28.281455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:28.296219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-fc3b7cdd-0854-4b31-bd12-b98ff4b8c8ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39321bc86f244daaa8bbd2cda502ad65'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:28.311376 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-fc3b7cdd-0854-4b31-bd12-b98ff4b8c8ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39321bc86f244daaa8bbd2cda502ad65'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:28.385688 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-fc3b7cdd-0854-4b31-bd12-b98ff4b8c8ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39321bc86f244daaa8bbd2cda502ad65'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:28.386374 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-fc3b7cdd-0854-4b31-bd12-b98ff4b8c8ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39321bc86f244daaa8bbd2cda502ad65'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:28.387076 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-fc3b7cdd-0854-4b31-bd12-b98ff4b8c8ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39321bc86f244daaa8bbd2cda502ad65'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:28.430397 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1129/2235] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:00:27 2022] DELETE /identity/v3/users/39321bc86f244daaa8bbd2cda502ad65 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:30.011491 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6578c-8e71-4e22-a311-d3c7404c50c1 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:30.013306 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-09f6578c-8e71-4e22-a311-d3c7404c50c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:30.029453 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6578c-8e71-4e22-a311-d3c7404c50c1 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:30.107880 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:30.126316 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eb556-fc90-4f49-af7f-278ce60cbd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:30.127211 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eb556-fc90-4f49-af7f-278ce60cbd23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:30.127497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eb556-fc90-4f49-af7f-278ce60cbd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:30.127780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eb556-fc90-4f49-af7f-278ce60cbd23 admin admin] PATH_INFO: `/v3/projects/792bb262df444b96bf732ae8901cfe79` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:30.129047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8eb556-fc90-4f49-af7f-278ce60cbd23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=792bb262df444b96bf732ae8901cfe79)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:30.131036 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8eb556-fc90-4f49-af7f-278ce60cbd23 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:30.313769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6f8eb556-fc90-4f49-af7f-278ce60cbd23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '792bb262df444b96bf732ae8901cfe79', 'request_id': 'req-6f8eb556-fc90-4f49-af7f-278ce60cbd23'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:30.407799 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6f8eb556-fc90-4f49-af7f-278ce60cbd23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '792bb262df444b96bf732ae8901cfe79', 'request_id': 'req-6f8eb556-fc90-4f49-af7f-278ce60cbd23'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:30.414699 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6f8eb556-fc90-4f49-af7f-278ce60cbd23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '792bb262df444b96bf732ae8901cfe79', 'request_id': 'req-6f8eb556-fc90-4f49-af7f-278ce60cbd23'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:30.439669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6f8eb556-fc90-4f49-af7f-278ce60cbd23 admin admin] The token cache is being invalidate because project 792bb262df444b96bf732ae8901cfe79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:00:30.440224 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6f8eb556-fc90-4f49-af7f-278ce60cbd23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:30.441127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6f8eb556-fc90-4f49-af7f-278ce60cbd23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:30.443373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1107/2236] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:00:30 2022] DELETE /identity/v3/projects/792bb262df444b96bf732ae8901cfe79 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:30.448851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68ced5-78ce-4fa7-b37c-78b3eb56d7e7 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:30.449467 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68ced5-78ce-4fa7-b37c-78b3eb56d7e7 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:30.449776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68ced5-78ce-4fa7-b37c-78b3eb56d7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:30.486440 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-2c68ced5-78ce-4fa7-b37c-78b3eb56d7e7 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:30.488351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-2c68ced5-78ce-4fa7-b37c-78b3eb56d7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:30.623819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1130/2237] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:30.628005 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c864f-3393-4cfe-b8fd-3f6bb1366391 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:30.628503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c864f-3393-4cfe-b8fd-3f6bb1366391 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:30.629030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c864f-3393-4cfe-b8fd-3f6bb1366391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:30.673599 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-d86c864f-3393-4cfe-b8fd-3f6bb1366391 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:30.675279 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-d86c864f-3393-4cfe-b8fd-3f6bb1366391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:30.698280 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1108/2238] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:30.702178 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68ced5-78ce-4fa7-b37c-78b3eb56d7e7 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:30.715674 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68ced5-78ce-4fa7-b37c-78b3eb56d7e7 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:30.725485 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e46c54-f908-4298-a48c-5e48240ef995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:30.740286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e46c54-f908-4298-a48c-5e48240ef995 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:30.740286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e46c54-f908-4298-a48c-5e48240ef995 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:30.740286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e46c54-f908-4298-a48c-5e48240ef995 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:30.740286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e46c54-f908-4298-a48c-5e48240ef995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:00:30.740286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e46c54-f908-4298-a48c-5e48240ef995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:30.740286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e46c54-f908-4298-a48c-5e48240ef995 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:30.764778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c864f-3393-4cfe-b8fd-3f6bb1366391 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:30.782321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1131/2239] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:00:30.783264 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c864f-3393-4cfe-b8fd-3f6bb1366391 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:30.795099 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d4b98-1198-4bea-8fd4-8eb665035652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:30.797001 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d4b98-1198-4bea-8fd4-8eb665035652 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:30.797001 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d4b98-1198-4bea-8fd4-8eb665035652 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:30.797001 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d4b98-1198-4bea-8fd4-8eb665035652 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:30.797880 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d4b98-1198-4bea-8fd4-8eb665035652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:30.799897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d4b98-1198-4bea-8fd4-8eb665035652 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:30.943255 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1109/2240] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:00:30 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:30.947336 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e46c54-f908-4298-a48c-5e48240ef995 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:30.988063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e46c54-f908-4298-a48c-5e48240ef995 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:31.070419 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f934db-54c8-42d7-9528-7e107420112b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:31.072133 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f934db-54c8-42d7-9528-7e107420112b admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:31.072527 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f934db-54c8-42d7-9528-7e107420112b admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:31.073060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f934db-54c8-42d7-9528-7e107420112b admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:31.074217 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f934db-54c8-42d7-9528-7e107420112b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:31.077754 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f934db-54c8-42d7-9528-7e107420112b admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:31.227347 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1132/2241] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:00:30 2022] POST /identity/v3/users => generated 288 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:31.231502 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d4b98-1198-4bea-8fd4-8eb665035652 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:31.245176 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d4b98-1198-4bea-8fd4-8eb665035652 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:31.257919 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34098e4b-1a5d-43f3-bbbc-a81510b267f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:31.257919 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34098e4b-1a5d-43f3-bbbc-a81510b267f0 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:31.257919 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34098e4b-1a5d-43f3-bbbc-a81510b267f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:31.257919 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34098e4b-1a5d-43f3-bbbc-a81510b267f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:31.259331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34098e4b-1a5d-43f3-bbbc-a81510b267f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:31.259331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34098e4b-1a5d-43f3-bbbc-a81510b267f0 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:31.284176 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1110/2242] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:31.285486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f934db-54c8-42d7-9528-7e107420112b admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:31.305398 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f934db-54c8-42d7-9528-7e107420112b admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:31.316254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fee49-8c05-459d-aead-2699b7e7e72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:31.318156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fee49-8c05-459d-aead-2699b7e7e72a admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:31.318156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fee49-8c05-459d-aead-2699b7e7e72a admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:31.318156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fee49-8c05-459d-aead-2699b7e7e72a admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:31.319000 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fee49-8c05-459d-aead-2699b7e7e72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:31.333224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fee49-8c05-459d-aead-2699b7e7e72a admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:31.354389 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1133/2243] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:31.356461 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34098e4b-1a5d-43f3-bbbc-a81510b267f0 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:31.376236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34098e4b-1a5d-43f3-bbbc-a81510b267f0 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:31.383566 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c58bf-5c7a-4a7e-b99a-7cd69808760a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:31.384490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c58bf-5c7a-4a7e-b99a-7cd69808760a admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:31.384850 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c58bf-5c7a-4a7e-b99a-7cd69808760a admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:31.385133 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c58bf-5c7a-4a7e-b99a-7cd69808760a admin admin] PATH_INFO: `/v3/projects/9991c20a9dfa4895b0cad06b4b1dbf46/users/1fbc195a9cfd43a5b205a7f8a67128a0/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:31.403454 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c58bf-5c7a-4a7e-b99a-7cd69808760a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9991c20a9dfa4895b0cad06b4b1dbf46, user_id=1fbc195a9cfd43a5b205a7f8a67128a0, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:31.406236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c58bf-5c7a-4a7e-b99a-7cd69808760a admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:31.502523 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1111/2244] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:31 2022] PUT /identity/v3/projects/9991c20a9dfa4895b0cad06b4b1dbf46/users/1fbc195a9cfd43a5b205a7f8a67128a0/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:31.517181 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd524f2-e347-4c23-a8c3-4aeb9f481342 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:31.517743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd524f2-e347-4c23-a8c3-4aeb9f481342 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:31.517915 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd524f2-e347-4c23-a8c3-4aeb9f481342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:31.565466 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-5dd524f2-e347-4c23-a8c3-4aeb9f481342 None None] MFA Rules not processed for user `1fbc195a9cfd43a5b205a7f8a67128a0`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:31.567533 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-5dd524f2-e347-4c23-a8c3-4aeb9f481342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:31.573496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:31.588172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43a714-f8c1-4578-ab4b-8b0bca5e00e6 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:31.594255 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43a714-f8c1-4578-ab4b-8b0bca5e00e6 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:31.594255 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43a714-f8c1-4578-ab4b-8b0bca5e00e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:31.640684 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-4c43a714-f8c1-4578-ab4b-8b0bca5e00e6 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:31.642306 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4c43a714-f8c1-4578-ab4b-8b0bca5e00e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:31.711431 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1134/2245] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:00:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:31.727842 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd524f2-e347-4c23-a8c3-4aeb9f481342 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:31.731754 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-5dd524f2-e347-4c23-a8c3-4aeb9f481342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:31.768723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1112/2246] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 23 11:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:31.782381 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43a714-f8c1-4578-ab4b-8b0bca5e00e6 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:31.783945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4c43a714-f8c1-4578-ab4b-8b0bca5e00e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:31.814213 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:31.838488 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd524f2-e347-4c23-a8c3-4aeb9f481342 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:31.843298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b72e4-f835-476b-808f-7c7b8a169001 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:31.844068 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b72e4-f835-476b-808f-7c7b8a169001 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:31.844787 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b72e4-f835-476b-808f-7c7b8a169001 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:31.844787 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b72e4-f835-476b-808f-7c7b8a169001 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:31.856855 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b72e4-f835-476b-808f-7c7b8a169001 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:31.864388 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b72e4-f835-476b-808f-7c7b8a169001 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:31.870122 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1135/2247] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:00:31.979075 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43a714-f8c1-4578-ab4b-8b0bca5e00e6 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:31.985999 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06608dec-8a02-48c1-bd1e-d4bec8ee5c6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:31.986945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06608dec-8a02-48c1-bd1e-d4bec8ee5c6d service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:31.987407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06608dec-8a02-48c1-bd1e-d4bec8ee5c6d service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:31.987752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06608dec-8a02-48c1-bd1e-d4bec8ee5c6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:32.008715 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06608dec-8a02-48c1-bd1e-d4bec8ee5c6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:32.010493 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06608dec-8a02-48c1-bd1e-d4bec8ee5c6d service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:32.022658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1113/2248] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:00:37.209493 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b72e4-f835-476b-808f-7c7b8a169001 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:37.221213 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b72e4-f835-476b-808f-7c7b8a169001 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:37.226737 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c00f2d-636a-4645-a542-dbe06654478c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:37.227656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c00f2d-636a-4645-a542-dbe06654478c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:37.227936 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c00f2d-636a-4645-a542-dbe06654478c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:37.228212 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c00f2d-636a-4645-a542-dbe06654478c admin admin] PATH_INFO: `/v3/users/1fbc195a9cfd43a5b205a7f8a67128a0` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:37.229533 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c00f2d-636a-4645-a542-dbe06654478c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbc195a9cfd43a5b205a7f8a67128a0)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:37.231486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c00f2d-636a-4645-a542-dbe06654478c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:37.448607 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b7c00f2d-636a-4645-a542-dbe06654478c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbc195a9cfd43a5b205a7f8a67128a0'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:37.456950 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b7c00f2d-636a-4645-a542-dbe06654478c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbc195a9cfd43a5b205a7f8a67128a0'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:37.527864 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b7c00f2d-636a-4645-a542-dbe06654478c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbc195a9cfd43a5b205a7f8a67128a0'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:37.528630 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b7c00f2d-636a-4645-a542-dbe06654478c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbc195a9cfd43a5b205a7f8a67128a0'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:37.529311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b7c00f2d-636a-4645-a542-dbe06654478c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbc195a9cfd43a5b205a7f8a67128a0'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:37.556335 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1136/2249] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:00:37 2022] DELETE /identity/v3/users/1fbc195a9cfd43a5b205a7f8a67128a0 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:37.560897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173c4f0-a767-46f3-bc7c-c3e40ff415d2 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:37.561397 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173c4f0-a767-46f3-bc7c-c3e40ff415d2 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:37.561498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173c4f0-a767-46f3-bc7c-c3e40ff415d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:37.581213 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-3173c4f0-a767-46f3-bc7c-c3e40ff415d2 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:37.582480 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-3173c4f0-a767-46f3-bc7c-c3e40ff415d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:37.647034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1114/2250] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:37.657490 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c00f2d-636a-4645-a542-dbe06654478c admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:37.659090 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b7c00f2d-636a-4645-a542-dbe06654478c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:37.683249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:37.721256 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c00f2d-636a-4645-a542-dbe06654478c admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:37.725093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf48f5-c860-43e7-a8e4-88a3ff9c5a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:37.726355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf48f5-c860-43e7-a8e4-88a3ff9c5a5b service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:37.726673 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf48f5-c860-43e7-a8e4-88a3ff9c5a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:37.726966 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf48f5-c860-43e7-a8e4-88a3ff9c5a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:37.737001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf48f5-c860-43e7-a8e4-88a3ff9c5a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:37.738576 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf48f5-c860-43e7-a8e4-88a3ff9c5a5b service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:37.749439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1137/2251] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:37.952614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbdf77-c670-4004-be5c-57799fe66eba None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:37.952983 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbdf77-c670-4004-be5c-57799fe66eba None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:37.953331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbdf77-c670-4004-be5c-57799fe66eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:37.975072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-0edbdf77-c670-4004-be5c-57799fe66eba None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:37.977019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-0edbdf77-c670-4004-be5c-57799fe66eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:37.985122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1115/2252] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 23 11:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:00:38.007518 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf48f5-c860-43e7-a8e4-88a3ff9c5a5b service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:38.009351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c6cf48f5-c860-43e7-a8e4-88a3ff9c5a5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:38.092969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf48f5-c860-43e7-a8e4-88a3ff9c5a5b service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:38.098765 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55c79c-aeee-4685-8b2c-706be5661bba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:38.100700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55c79c-aeee-4685-8b2c-706be5661bba service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:38.100700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55c79c-aeee-4685-8b2c-706be5661bba service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:38.100700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55c79c-aeee-4685-8b2c-706be5661bba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:38.110368 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55c79c-aeee-4685-8b2c-706be5661bba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:38.112038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55c79c-aeee-4685-8b2c-706be5661bba service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:38.122615 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1138/2253] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:38.254988 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbdf77-c670-4004-be5c-57799fe66eba None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:38.256546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-0edbdf77-c670-4004-be5c-57799fe66eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:38.271268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbdf77-c670-4004-be5c-57799fe66eba None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:38.277273 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cae04f-8141-45c3-bb0a-cf12240826a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:38.278720 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cae04f-8141-45c3-bb0a-cf12240826a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:38.278720 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cae04f-8141-45c3-bb0a-cf12240826a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:38.279159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cae04f-8141-45c3-bb0a-cf12240826a9 admin admin] PATH_INFO: `/v3/projects/9991c20a9dfa4895b0cad06b4b1dbf46` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:38.280567 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cae04f-8141-45c3-bb0a-cf12240826a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9991c20a9dfa4895b0cad06b4b1dbf46)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:38.283718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cae04f-8141-45c3-bb0a-cf12240826a9 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:38.410768 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-34cae04f-8141-45c3-bb0a-cf12240826a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9991c20a9dfa4895b0cad06b4b1dbf46', 'request_id': 'req-34cae04f-8141-45c3-bb0a-cf12240826a9'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:38.486512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-34cae04f-8141-45c3-bb0a-cf12240826a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9991c20a9dfa4895b0cad06b4b1dbf46', 'request_id': 'req-34cae04f-8141-45c3-bb0a-cf12240826a9'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:38.486512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:38.495011 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-34cae04f-8141-45c3-bb0a-cf12240826a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9991c20a9dfa4895b0cad06b4b1dbf46', 'request_id': 'req-34cae04f-8141-45c3-bb0a-cf12240826a9'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:38.506776 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-34cae04f-8141-45c3-bb0a-cf12240826a9 admin admin] The token cache is being invalidate because project 9991c20a9dfa4895b0cad06b4b1dbf46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:00:38.507580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-34cae04f-8141-45c3-bb0a-cf12240826a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:38.508315 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-34cae04f-8141-45c3-bb0a-cf12240826a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:38.510278 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1116/2254] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:00:38 2022] DELETE /identity/v3/projects/9991c20a9dfa4895b0cad06b4b1dbf46 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:42.466046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b941b-ce10-4ef4-a3bf-31a1930d815f None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.466529 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b941b-ce10-4ef4-a3bf-31a1930d815f None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.466634 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b941b-ce10-4ef4-a3bf-31a1930d815f None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.468011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1139/2255] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jun 23 11:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:00:42.474220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3cd6c-bdf3-4438-b996-1aea1996facc None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.474771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3cd6c-bdf3-4438-b996-1aea1996facc None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.475148 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3cd6c-bdf3-4438-b996-1aea1996facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.518694 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-9ba3cd6c-bdf3-4438-b996-1aea1996facc None None] MFA Rules not processed for user `39840f048d254831bdb963b38520f706`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:42.519989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-9ba3cd6c-bdf3-4438-b996-1aea1996facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:42.556056 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35c810-ac84-4f62-a207-50c36d8c1273 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.556364 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35c810-ac84-4f62-a207-50c36d8c1273 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.556661 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35c810-ac84-4f62-a207-50c36d8c1273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.576838 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-2b35c810-ac84-4f62-a207-50c36d8c1273 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:42.578049 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-2b35c810-ac84-4f62-a207-50c36d8c1273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:42.598567 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1117/2256] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jun 23 11:00:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:42.610987 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3cd6c-bdf3-4438-b996-1aea1996facc None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:42.612333 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-9ba3cd6c-bdf3-4438-b996-1aea1996facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:42.651034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1140/2257] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 23 11:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:42.666835 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35c810-ac84-4f62-a207-50c36d8c1273 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:42.668215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-2b35c810-ac84-4f62-a207-50c36d8c1273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:42.673779 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3cd6c-bdf3-4438-b996-1aea1996facc None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:42.677930 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d8d7f-8212-4118-a6f2-95fead7acd76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06498e12426947908d5217e2c948519d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:42.678583 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d8d7f-8212-4118-a6f2-95fead7acd76 service glance] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.678889 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d8d7f-8212-4118-a6f2-95fead7acd76 service glance] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.679507 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d8d7f-8212-4118-a6f2-95fead7acd76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.685465 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35c810-ac84-4f62-a207-50c36d8c1273 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:42.691258 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d8d7f-8212-4118-a6f2-95fead7acd76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:42.691448 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7a396-643a-4abd-9dae-1ebcf8f641e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:42.692122 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7a396-643a-4abd-9dae-1ebcf8f641e8 service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.692331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7a396-643a-4abd-9dae-1ebcf8f641e8 service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.692604 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7a396-643a-4abd-9dae-1ebcf8f641e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.692821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d8d7f-8212-4118-a6f2-95fead7acd76 service glance] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:42.701989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7a396-643a-4abd-9dae-1ebcf8f641e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:42.703624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7a396-643a-4abd-9dae-1ebcf8f641e8 service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:42.705167 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1118/2258] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:00:42.715961 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1141/2259] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:00:42.953074 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e39a0-46e3-43c8-b126-7f474a97d46b None None] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.953267 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e39a0-46e3-43c8-b126-7f474a97d46b None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.953562 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e39a0-46e3-43c8-b126-7f474a97d46b None None] PATH_INFO: `/` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.954968 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1119/2260] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jun 23 11:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:00:42.959873 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970c8b8-489e-4237-b67e-9156d3ef14c8 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.960209 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970c8b8-489e-4237-b67e-9156d3ef14c8 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.960569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970c8b8-489e-4237-b67e-9156d3ef14c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.999790 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-2970c8b8-489e-4237-b67e-9156d3ef14c8 None None] MFA Rules not processed for user `0348261a78984c62aced60af2768688e`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:43.001034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-2970c8b8-489e-4237-b67e-9156d3ef14c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:43.018785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:43.056594 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1142/2261] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jun 23 11:00:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:43.071153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e39a0-46e3-43c8-b126-7f474a97d46b None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:43.072307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ed4e39a0-46e3-43c8-b126-7f474a97d46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:43.086113 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e39a0-46e3-43c8-b126-7f474a97d46b None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:43.090838 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732a007-4466-4711-ac3d-1a07ac55cb55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:43.091490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732a007-4466-4711-ac3d-1a07ac55cb55 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.091772 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732a007-4466-4711-ac3d-1a07ac55cb55 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.092048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732a007-4466-4711-ac3d-1a07ac55cb55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.101551 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732a007-4466-4711-ac3d-1a07ac55cb55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:43.103130 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732a007-4466-4711-ac3d-1a07ac55cb55 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:43.111624 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1120/2262] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:43.195978 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988cbdc-6896-4703-8030-f41a5af71837 None None] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.196268 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988cbdc-6896-4703-8030-f41a5af71837 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.196575 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988cbdc-6896-4703-8030-f41a5af71837 None None] PATH_INFO: `/` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.197984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1143/2263] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jun 23 11:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:00:43.203574 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2798e2-5747-4654-9c1d-eb53b3ed6b8c None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.204093 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2798e2-5747-4654-9c1d-eb53b3ed6b8c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.204442 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2798e2-5747-4654-9c1d-eb53b3ed6b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.224177 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-cc2798e2-5747-4654-9c1d-eb53b3ed6b8c None None] MFA Rules not processed for user `39840f048d254831bdb963b38520f706`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:43.226344 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-cc2798e2-5747-4654-9c1d-eb53b3ed6b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:43.236338 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1121/2264] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jun 23 11:00:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:43.249076 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988cbdc-6896-4703-8030-f41a5af71837 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:43.260953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988cbdc-6896-4703-8030-f41a5af71837 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:43.264699 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0308fa-6d88-46d9-bc01-da4aa92c026e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:43.265364 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0308fa-6d88-46d9-bc01-da4aa92c026e service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.265654 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0308fa-6d88-46d9-bc01-da4aa92c026e service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.265935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0308fa-6d88-46d9-bc01-da4aa92c026e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.278282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0308fa-6d88-46d9-bc01-da4aa92c026e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:43.279742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0308fa-6d88-46d9-bc01-da4aa92c026e service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:43.292520 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1144/2265] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:46.376869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e52c1-8575-4e74-aeaa-5164c2f568ca None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:46.377484 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e52c1-8575-4e74-aeaa-5164c2f568ca None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:46.377484 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e52c1-8575-4e74-aeaa-5164c2f568ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:46.402124 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-b42e52c1-8575-4e74-aeaa-5164c2f568ca None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:46.403876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-b42e52c1-8575-4e74-aeaa-5164c2f568ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:46.412873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1122/2266] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 23 11:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:46.428624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0308fa-6d88-46d9-bc01-da4aa92c026e service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:46.440489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0308fa-6d88-46d9-bc01-da4aa92c026e service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:46.446876 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b0360-7684-4bc3-8bf7-5d6d1f652673 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:46.447553 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b0360-7684-4bc3-8bf7-5d6d1f652673 service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:46.447835 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b0360-7684-4bc3-8bf7-5d6d1f652673 service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:46.448122 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b0360-7684-4bc3-8bf7-5d6d1f652673 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:46.457935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b0360-7684-4bc3-8bf7-5d6d1f652673 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:46.459632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b0360-7684-4bc3-8bf7-5d6d1f652673 service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:46.472550 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1145/2267] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:49.445385 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a6c92-0dc1-4f84-9eb1-7d0a0fe03bed None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:49.446043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a6c92-0dc1-4f84-9eb1-7d0a0fe03bed None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:49.446348 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a6c92-0dc1-4f84-9eb1-7d0a0fe03bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:49.468281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-224a6c92-0dc1-4f84-9eb1-7d0a0fe03bed None None] MFA Rules not processed for user `1b03d940626a449dbe904f02f3d70854`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:49.468281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-224a6c92-0dc1-4f84-9eb1-7d0a0fe03bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:49.508152 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:49.528695 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1123/2268] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 23 11:00:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:49.539021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b0360-7684-4bc3-8bf7-5d6d1f652673 service nova] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:49.540458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-748b0360-7684-4bc3-8bf7-5d6d1f652673 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:49.615646 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b0360-7684-4bc3-8bf7-5d6d1f652673 service nova] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:49.621098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da5b9b-2b94-466d-9487-cc9e628eddc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a54fa1c326f41e88688404a56b75c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:49.621767 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da5b9b-2b94-466d-9487-cc9e628eddc8 service swift] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:49.627236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da5b9b-2b94-466d-9487-cc9e628eddc8 service swift] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:49.627236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da5b9b-2b94-466d-9487-cc9e628eddc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:49.633389 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da5b9b-2b94-466d-9487-cc9e628eddc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:49.635094 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da5b9b-2b94-466d-9487-cc9e628eddc8 service swift] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:49.643818 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1146/2269] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 23 11:00:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:00:50.710048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cce39-5a1e-44e1-ba8a-0247a45a873f None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:50.711342 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cce39-5a1e-44e1-ba8a-0247a45a873f None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:50.715505 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cce39-5a1e-44e1-ba8a-0247a45a873f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:50.733267 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-5c6cce39-5a1e-44e1-ba8a-0247a45a873f None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:50.734599 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-5c6cce39-5a1e-44e1-ba8a-0247a45a873f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:50.743965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1124/2270] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 23 11:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:50.781161 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da5b9b-2b94-466d-9487-cc9e628eddc8 service swift] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:50.795970 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da5b9b-2b94-466d-9487-cc9e628eddc8 service swift] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:50.801874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a4d74-3c04-4ad8-ac9f-0c1a5c04fb0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:50.802537 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a4d74-3c04-4ad8-ac9f-0c1a5c04fb0e service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:50.802823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a4d74-3c04-4ad8-ac9f-0c1a5c04fb0e service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:50.803104 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a4d74-3c04-4ad8-ac9f-0c1a5c04fb0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:50.812345 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a4d74-3c04-4ad8-ac9f-0c1a5c04fb0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:50.813984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a4d74-3c04-4ad8-ac9f-0c1a5c04fb0e service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:50.824345 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1147/2271] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:01:00.727523 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=9 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:00.819530 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=63 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:07.311822 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2f9b2-9a50-4bb1-8e0b-d504af61450d None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:07.312736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2f9b2-9a50-4bb1-8e0b-d504af61450d None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:07.313344 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2f9b2-9a50-4bb1-8e0b-d504af61450d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:07.334996 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-e3f2f9b2-9a50-4bb1-8e0b-d504af61450d None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:07.337822 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e3f2f9b2-9a50-4bb1-8e0b-d504af61450d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:07.350922 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1125/2272] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 23 11:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:01:07.364233 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a4d74-3c04-4ad8-ac9f-0c1a5c04fb0e service nova] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:07.366947 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-864a4d74-3c04-4ad8-ac9f-0c1a5c04fb0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:07.384589 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a4d74-3c04-4ad8-ac9f-0c1a5c04fb0e service nova] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:07.390730 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4431b84-ccbb-4518-bb36-30a2ffc6a738 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:07.394758 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4431b84-ccbb-4518-bb36-30a2ffc6a738 service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:07.394758 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4431b84-ccbb-4518-bb36-30a2ffc6a738 service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:07.394758 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4431b84-ccbb-4518-bb36-30a2ffc6a738 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:07.405115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4431b84-ccbb-4518-bb36-30a2ffc6a738 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:07.408613 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4431b84-ccbb-4518-bb36-30a2ffc6a738 service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:07.427217 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1148/2273] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:01:08.175583 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2f9b2-9a50-4bb1-8e0b-d504af61450d None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:08.177030 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e3f2f9b2-9a50-4bb1-8e0b-d504af61450d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:08.279988 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2f9b2-9a50-4bb1-8e0b-d504af61450d None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:08.285125 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b552b-073a-4d23-b51c-bb9f80f8aab3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff588aaad264f9cbc5a80e73ef0c09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:08.285826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b552b-073a-4d23-b51c-bb9f80f8aab3 service placement] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:08.286101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b552b-073a-4d23-b51c-bb9f80f8aab3 service placement] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:08.286379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b552b-073a-4d23-b51c-bb9f80f8aab3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:08.288817 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4d9b552b-073a-4d23-b51c-bb9f80f8aab3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:08.301701 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b552b-073a-4d23-b51c-bb9f80f8aab3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:08.303447 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b552b-073a-4d23-b51c-bb9f80f8aab3 service placement] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:08.315158 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1126/2274] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:01:11.988411 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07249ad1-35cc-4881-911f-0e7aa7a4d0a4 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:11.988937 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07249ad1-35cc-4881-911f-0e7aa7a4d0a4 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:11.989042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07249ad1-35cc-4881-911f-0e7aa7a4d0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:12.043106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-07249ad1-35cc-4881-911f-0e7aa7a4d0a4 None None] MFA Rules not processed for user `1b03d940626a449dbe904f02f3d70854`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:12.044400 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-07249ad1-35cc-4881-911f-0e7aa7a4d0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:12.062234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1149/2275] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jun 23 11:01:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:12.075876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b552b-073a-4d23-b51c-bb9f80f8aab3 service placement] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:12.102789 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b552b-073a-4d23-b51c-bb9f80f8aab3 service placement] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:12.107996 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b334881-25be-4a4f-82ee-54ae310a585e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a54fa1c326f41e88688404a56b75c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:12.108676 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b334881-25be-4a4f-82ee-54ae310a585e service swift] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:12.108969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b334881-25be-4a4f-82ee-54ae310a585e service swift] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:12.109250 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b334881-25be-4a4f-82ee-54ae310a585e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:12.118798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b334881-25be-4a4f-82ee-54ae310a585e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:12.120452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b334881-25be-4a4f-82ee-54ae310a585e service swift] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:12.129194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1127/2276] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 23 11:01:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:01:22.059191 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=24 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:22.125638 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=54 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:26.905116 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02221bf-e440-4582-aadc-3ed793c5e7b6 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:26.905639 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02221bf-e440-4582-aadc-3ed793c5e7b6 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:26.905735 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02221bf-e440-4582-aadc-3ed793c5e7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:26.923952 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-e02221bf-e440-4582-aadc-3ed793c5e7b6 None None] MFA Rules not processed for user `84b50be01a034624bb3bf62d0fe481ab`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:26.925196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e02221bf-e440-4582-aadc-3ed793c5e7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:26.984042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1150/2277] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:01:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:34.088008 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506b367-24cc-4d45-86cb-d058eca4ec92 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:34.088604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506b367-24cc-4d45-86cb-d058eca4ec92 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:34.088604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506b367-24cc-4d45-86cb-d058eca4ec92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:34.107115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-3506b367-24cc-4d45-86cb-d058eca4ec92 None None] MFA Rules not processed for user `c3f7f25cf67c40b5a03f4f692a198146`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:34.108373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-3506b367-24cc-4d45-86cb-d058eca4ec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:34.166484 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1128/2278] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:01:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:36.976299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=25 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:44.159214 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=25 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:47.400658 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439b51a-c4d8-47c4-96ae-cb9662895539 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:47.401274 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439b51a-c4d8-47c4-96ae-cb9662895539 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:47.401274 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439b51a-c4d8-47c4-96ae-cb9662895539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:47.420009 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-5439b51a-c4d8-47c4-96ae-cb9662895539 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:47.421250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-5439b51a-c4d8-47c4-96ae-cb9662895539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:47.429959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1151/2279] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 23 11:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:01:47.446228 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506b367-24cc-4d45-86cb-d058eca4ec92 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:47.459557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506b367-24cc-4d45-86cb-d058eca4ec92 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:47.465432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911615cd-e490-4254-8fc3-5c834252fdfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:47.466089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911615cd-e490-4254-8fc3-5c834252fdfe service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:47.466371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911615cd-e490-4254-8fc3-5c834252fdfe service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:47.466644 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911615cd-e490-4254-8fc3-5c834252fdfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:47.475850 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911615cd-e490-4254-8fc3-5c834252fdfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:47.477495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911615cd-e490-4254-8fc3-5c834252fdfe service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:47.487577 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1129/2280] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:01:52.978252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdd0ac-bd2c-434d-a096-379d750bb92e None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:52.978776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdd0ac-bd2c-434d-a096-379d750bb92e None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:52.979069 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdd0ac-bd2c-434d-a096-379d750bb92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:52.998832 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-66fdd0ac-bd2c-434d-a096-379d750bb92e None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:53.000132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-66fdd0ac-bd2c-434d-a096-379d750bb92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:53.008292 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1152/2281] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 23 11:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:53.024217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911615cd-e490-4254-8fc3-5c834252fdfe service nova] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:53.035467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911615cd-e490-4254-8fc3-5c834252fdfe service nova] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:53.041707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66ed14-9fb1-4143-97ac-093a8ce64f84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:53.042568 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66ed14-9fb1-4143-97ac-093a8ce64f84 service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:53.042849 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66ed14-9fb1-4143-97ac-093a8ce64f84 service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:53.043123 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66ed14-9fb1-4143-97ac-093a8ce64f84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:53.052079 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66ed14-9fb1-4143-97ac-093a8ce64f84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:53.054892 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66ed14-9fb1-4143-97ac-093a8ce64f84 service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:53.064592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1130/2282] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:01:53.346736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343769a4-790e-49ca-afdf-f1d88f552b6b None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:53.347206 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343769a4-790e-49ca-afdf-f1d88f552b6b None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:53.347677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343769a4-790e-49ca-afdf-f1d88f552b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:53.369819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-343769a4-790e-49ca-afdf-f1d88f552b6b None None] MFA Rules not processed for user `935cd7d4575941148be2d56a9fbdb88a`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:53.371054 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-343769a4-790e-49ca-afdf-f1d88f552b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:53.436182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1153/2283] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:01:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:55.907488 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f2727-e82b-44c9-b127-9aa5aa6f36c6 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:55.908024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f2727-e82b-44c9-b127-9aa5aa6f36c6 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:55.908024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f2727-e82b-44c9-b127-9aa5aa6f36c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:55.927286 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-c52f2727-e82b-44c9-b127-9aa5aa6f36c6 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:55.928516 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c52f2727-e82b-44c9-b127-9aa5aa6f36c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:55.937090 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1131/2284] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 23 11:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:55.952052 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343769a4-790e-49ca-afdf-f1d88f552b6b None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:55.965943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343769a4-790e-49ca-afdf-f1d88f552b6b None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:55.971378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f015e8-cfca-4f5c-8b6c-e1f312bd10fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:55.972038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f015e8-cfca-4f5c-8b6c-e1f312bd10fb service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:55.972325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f015e8-cfca-4f5c-8b6c-e1f312bd10fb service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:55.972604 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f015e8-cfca-4f5c-8b6c-e1f312bd10fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:55.982475 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f015e8-cfca-4f5c-8b6c-e1f312bd10fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:55.984112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f015e8-cfca-4f5c-8b6c-e1f312bd10fb service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:55.994680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1154/2285] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:03.280465 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d33ff9-8587-4c53-b743-3579a9e4e87f None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:03.281119 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d33ff9-8587-4c53-b743-3579a9e4e87f None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:03.281236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d33ff9-8587-4c53-b743-3579a9e4e87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:03.300820 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-84d33ff9-8587-4c53-b743-3579a9e4e87f None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:03.302041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-84d33ff9-8587-4c53-b743-3579a9e4e87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:03.313214 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1132/2286] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 23 11:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:03.335412 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f015e8-cfca-4f5c-8b6c-e1f312bd10fb service nova] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:03.345377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f015e8-cfca-4f5c-8b6c-e1f312bd10fb service nova] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:03.353274 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1543097-a9ed-473f-9289-0abcf3d4225a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:03.354063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1543097-a9ed-473f-9289-0abcf3d4225a service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:03.354218 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1543097-a9ed-473f-9289-0abcf3d4225a service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:03.354634 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1543097-a9ed-473f-9289-0abcf3d4225a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:03.367986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1543097-a9ed-473f-9289-0abcf3d4225a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:03.370213 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1543097-a9ed-473f-9289-0abcf3d4225a service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:03.380671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1155/2287] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:02:06.523492 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0e26f-7ad8-4aad-b81f-260a25ecdae7 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:06.524093 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0e26f-7ad8-4aad-b81f-260a25ecdae7 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:06.524093 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0e26f-7ad8-4aad-b81f-260a25ecdae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:06.545255 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-6cf0e26f-7ad8-4aad-b81f-260a25ecdae7 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:06.546480 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-6cf0e26f-7ad8-4aad-b81f-260a25ecdae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:06.554946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1133/2288] 10.222.0.48 () {58 vars in 1016 bytes} [Thu Jun 23 11:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:06.571479 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1543097-a9ed-473f-9289-0abcf3d4225a service nova] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:06.584193 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1543097-a9ed-473f-9289-0abcf3d4225a service nova] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:06.590282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5cc24-2914-44b8-a834-a848118101d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:06.590925 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5cc24-2914-44b8-a834-a848118101d5 service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:06.591207 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5cc24-2914-44b8-a834-a848118101d5 service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:06.591484 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5cc24-2914-44b8-a834-a848118101d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:06.600803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5cc24-2914-44b8-a834-a848118101d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:06.602324 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5cc24-2914-44b8-a834-a848118101d5 service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:06.613905 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1156/2289] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:07.043776 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea665c-868c-49e8-b13a-7404e2f85149 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:07.044029 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea665c-868c-49e8-b13a-7404e2f85149 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:07.044309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea665c-868c-49e8-b13a-7404e2f85149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:07.062609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-d5ea665c-868c-49e8-b13a-7404e2f85149 None None] MFA Rules not processed for user `d4ffb26d86d64d81bea84268e10386fc`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:07.063981 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-d5ea665c-868c-49e8-b13a-7404e2f85149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:07.126857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1134/2290] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:02:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:16.608448 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=49 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:17.119609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=46 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:41.361584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5cc24-2914-44b8-a834-a848118101d5 service nova] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:41.361584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-79c5cc24-2914-44b8-a834-a848118101d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:41.375980 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5cc24-2914-44b8-a834-a848118101d5 service nova] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:41.380843 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b71e48-ba18-40b8-ac48-4dd5f08b67eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:41.381725 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b71e48-ba18-40b8-ac48-4dd5f08b67eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:41.382011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b71e48-ba18-40b8-ac48-4dd5f08b67eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:41.382288 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b71e48-ba18-40b8-ac48-4dd5f08b67eb admin admin] PATH_INFO: `/v3/users/84b50be01a034624bb3bf62d0fe481ab` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:41.383755 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b71e48-ba18-40b8-ac48-4dd5f08b67eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=84b50be01a034624bb3bf62d0fe481ab)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:41.385945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b71e48-ba18-40b8-ac48-4dd5f08b67eb admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:41.614989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f6b71e48-ba18-40b8-ac48-4dd5f08b67eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84b50be01a034624bb3bf62d0fe481ab'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:41.624397 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f6b71e48-ba18-40b8-ac48-4dd5f08b67eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84b50be01a034624bb3bf62d0fe481ab'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:41.688217 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f6b71e48-ba18-40b8-ac48-4dd5f08b67eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84b50be01a034624bb3bf62d0fe481ab'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:41.688943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f6b71e48-ba18-40b8-ac48-4dd5f08b67eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84b50be01a034624bb3bf62d0fe481ab'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:41.689602 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f6b71e48-ba18-40b8-ac48-4dd5f08b67eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84b50be01a034624bb3bf62d0fe481ab'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:41.709856 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1157/2291] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:02:41 2022] DELETE /identity/v3/users/84b50be01a034624bb3bf62d0fe481ab => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:41.969617 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea665c-868c-49e8-b13a-7404e2f85149 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:41.983403 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea665c-868c-49e8-b13a-7404e2f85149 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:42.051065 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e2edc-4c77-4a10-91e0-6bbfa49759e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:42.051950 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e2edc-4c77-4a10-91e0-6bbfa49759e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:42.052237 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e2edc-4c77-4a10-91e0-6bbfa49759e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:42.052543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e2edc-4c77-4a10-91e0-6bbfa49759e2 admin admin] PATH_INFO: `/v3/projects/33512f60e9f1431cbad80af8e457fb44` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:42.053818 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e2edc-4c77-4a10-91e0-6bbfa49759e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33512f60e9f1431cbad80af8e457fb44)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:42.055748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e2edc-4c77-4a10-91e0-6bbfa49759e2 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:42.167919 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-cd1e2edc-4c77-4a10-91e0-6bbfa49759e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33512f60e9f1431cbad80af8e457fb44', 'request_id': 'req-cd1e2edc-4c77-4a10-91e0-6bbfa49759e2'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:42.245755 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-cd1e2edc-4c77-4a10-91e0-6bbfa49759e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33512f60e9f1431cbad80af8e457fb44', 'request_id': 'req-cd1e2edc-4c77-4a10-91e0-6bbfa49759e2'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:42.252745 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-cd1e2edc-4c77-4a10-91e0-6bbfa49759e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33512f60e9f1431cbad80af8e457fb44', 'request_id': 'req-cd1e2edc-4c77-4a10-91e0-6bbfa49759e2'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:42.264797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-cd1e2edc-4c77-4a10-91e0-6bbfa49759e2 admin admin] The token cache is being invalidate because project 33512f60e9f1431cbad80af8e457fb44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:02:42.265082 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-cd1e2edc-4c77-4a10-91e0-6bbfa49759e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:42.265784 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-cd1e2edc-4c77-4a10-91e0-6bbfa49759e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:42.267354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1135/2292] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:02:41 2022] DELETE /identity/v3/projects/33512f60e9f1431cbad80af8e457fb44 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:42.272450 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114b1cc-f084-47f4-88e7-248b6c92ed9d None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:42.272809 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114b1cc-f084-47f4-88e7-248b6c92ed9d None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:42.273097 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114b1cc-f084-47f4-88e7-248b6c92ed9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:42.293455 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-f114b1cc-f084-47f4-88e7-248b6c92ed9d None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:42.295392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-f114b1cc-f084-47f4-88e7-248b6c92ed9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:42.364271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1158/2293] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:02:42.366274 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7514668-7fd8-43fe-8636-882acac93da1 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:42.366632 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7514668-7fd8-43fe-8636-882acac93da1 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:42.366975 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7514668-7fd8-43fe-8636-882acac93da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:42.388086 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-f7514668-7fd8-43fe-8636-882acac93da1 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:42.389698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f7514668-7fd8-43fe-8636-882acac93da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:42.398099 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1136/2294] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:42.404653 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114b1cc-f084-47f4-88e7-248b6c92ed9d None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:42.414880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114b1cc-f084-47f4-88e7-248b6c92ed9d None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:42.422742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcfa97-a4d1-4536-bd97-6af3351d5108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:42.422742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcfa97-a4d1-4536-bd97-6af3351d5108 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:42.422742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcfa97-a4d1-4536-bd97-6af3351d5108 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:42.422742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcfa97-a4d1-4536-bd97-6af3351d5108 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:42.423190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcfa97-a4d1-4536-bd97-6af3351d5108 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:02:42.423190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcfa97-a4d1-4536-bd97-6af3351d5108 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:42.424207 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcfa97-a4d1-4536-bd97-6af3351d5108 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:42.438597 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1159/2295] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:02:42.448747 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7514668-7fd8-43fe-8636-882acac93da1 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:42.458838 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7514668-7fd8-43fe-8636-882acac93da1 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:42.463842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c023d5c-ff77-4dc5-9963-e66912f01855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:42.464508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c023d5c-ff77-4dc5-9963-e66912f01855 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:42.464822 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c023d5c-ff77-4dc5-9963-e66912f01855 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:42.465099 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c023d5c-ff77-4dc5-9963-e66912f01855 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:42.465853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c023d5c-ff77-4dc5-9963-e66912f01855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:42.468346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c023d5c-ff77-4dc5-9963-e66912f01855 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:42.575051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1137/2296] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:02:42 2022] POST /identity/v3/projects => generated 399 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:02:42.580073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcfa97-a4d1-4536-bd97-6af3351d5108 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:42.592450 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcfa97-a4d1-4536-bd97-6af3351d5108 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:42.678078 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a8cc5-ed73-4039-a534-281bd4c28305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:42.679042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a8cc5-ed73-4039-a534-281bd4c28305 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:42.679335 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a8cc5-ed73-4039-a534-281bd4c28305 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:42.679622 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a8cc5-ed73-4039-a534-281bd4c28305 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:42.680408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a8cc5-ed73-4039-a534-281bd4c28305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:42.682422 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a8cc5-ed73-4039-a534-281bd4c28305 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:42.689862 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:42.762445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1160/2297] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:02:42 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:02:42.767750 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c023d5c-ff77-4dc5-9963-e66912f01855 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:42.778412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c023d5c-ff77-4dc5-9963-e66912f01855 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:42.783577 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb3903-3909-4695-8045-54c5d291a067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:42.784220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb3903-3909-4695-8045-54c5d291a067 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:42.786299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb3903-3909-4695-8045-54c5d291a067 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:42.786299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb3903-3909-4695-8045-54c5d291a067 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:42.786299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb3903-3909-4695-8045-54c5d291a067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:42.788921 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb3903-3909-4695-8045-54c5d291a067 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:42.801202 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1138/2298] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:02:42.806074 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a8cc5-ed73-4039-a534-281bd4c28305 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:42.818041 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a8cc5-ed73-4039-a534-281bd4c28305 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:42.822793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32998421-58f6-480e-9f87-de8a5fd68aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:42.823493 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32998421-58f6-480e-9f87-de8a5fd68aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:42.823780 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32998421-58f6-480e-9f87-de8a5fd68aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:42.824056 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32998421-58f6-480e-9f87-de8a5fd68aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:42.824823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32998421-58f6-480e-9f87-de8a5fd68aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:42.827284 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32998421-58f6-480e-9f87-de8a5fd68aa8 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:42.837685 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1161/2299] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:02:42.842033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb3903-3909-4695-8045-54c5d291a067 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:42.852538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb3903-3909-4695-8045-54c5d291a067 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:42.857336 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa55374-fdee-45f8-a065-009e9ce3f157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:42.858239 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa55374-fdee-45f8-a065-009e9ce3f157 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:42.858525 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa55374-fdee-45f8-a065-009e9ce3f157 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:42.858804 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa55374-fdee-45f8-a065-009e9ce3f157 admin admin] PATH_INFO: `/v3/projects/cba62407590a4eeaa3187d137190cd39/users/4701b8ee54af4a1ea1da13a2e6ec293a/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:42.874521 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa55374-fdee-45f8-a065-009e9ce3f157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba62407590a4eeaa3187d137190cd39, user_id=4701b8ee54af4a1ea1da13a2e6ec293a, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:42.877243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa55374-fdee-45f8-a065-009e9ce3f157 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:42.945770 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1139/2300] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:02:42 2022] PUT /identity/v3/projects/cba62407590a4eeaa3187d137190cd39/users/4701b8ee54af4a1ea1da13a2e6ec293a/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:42.956808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011c465-2ecc-4b42-9867-4075ebfc34dc None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:42.957105 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011c465-2ecc-4b42-9867-4075ebfc34dc None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:42.957395 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011c465-2ecc-4b42-9867-4075ebfc34dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:42.986519 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-d011c465-2ecc-4b42-9867-4075ebfc34dc None None] MFA Rules not processed for user `4701b8ee54af4a1ea1da13a2e6ec293a`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:42.987761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d011c465-2ecc-4b42-9867-4075ebfc34dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:43.055985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1162/2301] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:02:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:43.068232 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa55374-fdee-45f8-a065-009e9ce3f157 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:43.070064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-2fa55374-fdee-45f8-a065-009e9ce3f157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:43.102177 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:43.154287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa55374-fdee-45f8-a065-009e9ce3f157 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:43.158409 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224023db-f2bf-4eb5-97c6-dd260d43f6e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:43.159102 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224023db-f2bf-4eb5-97c6-dd260d43f6e0 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:43.159387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224023db-f2bf-4eb5-97c6-dd260d43f6e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:43.159665 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224023db-f2bf-4eb5-97c6-dd260d43f6e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:43.168707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224023db-f2bf-4eb5-97c6-dd260d43f6e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:43.170698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224023db-f2bf-4eb5-97c6-dd260d43f6e0 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:43.181409 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1140/2302] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:49.033581 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011c465-2ecc-4b42-9867-4075ebfc34dc None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:49.125674 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011c465-2ecc-4b42-9867-4075ebfc34dc None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:49.131454 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716886c3-0d43-431b-9384-a1440a93d0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:49.132384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716886c3-0d43-431b-9384-a1440a93d0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:49.132702 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716886c3-0d43-431b-9384-a1440a93d0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:49.133011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716886c3-0d43-431b-9384-a1440a93d0c1 admin admin] PATH_INFO: `/v3/users/4701b8ee54af4a1ea1da13a2e6ec293a` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:49.134385 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716886c3-0d43-431b-9384-a1440a93d0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4701b8ee54af4a1ea1da13a2e6ec293a)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:49.136452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716886c3-0d43-431b-9384-a1440a93d0c1 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:49.390150 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-716886c3-0d43-431b-9384-a1440a93d0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4701b8ee54af4a1ea1da13a2e6ec293a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:49.400536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-716886c3-0d43-431b-9384-a1440a93d0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4701b8ee54af4a1ea1da13a2e6ec293a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:49.481787 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-716886c3-0d43-431b-9384-a1440a93d0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4701b8ee54af4a1ea1da13a2e6ec293a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:49.482762 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-716886c3-0d43-431b-9384-a1440a93d0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4701b8ee54af4a1ea1da13a2e6ec293a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:49.483401 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-716886c3-0d43-431b-9384-a1440a93d0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4701b8ee54af4a1ea1da13a2e6ec293a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:49.490262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:49.506556 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1163/2303] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:02:49 2022] DELETE /identity/v3/users/4701b8ee54af4a1ea1da13a2e6ec293a => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:49.509702 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355bc8c-a596-4a05-989b-9ee9fe179ff5 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:49.510223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355bc8c-a596-4a05-989b-9ee9fe179ff5 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:49.510397 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355bc8c-a596-4a05-989b-9ee9fe179ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:49.529854 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-f355bc8c-a596-4a05-989b-9ee9fe179ff5 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:49.530994 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f355bc8c-a596-4a05-989b-9ee9fe179ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:49.597707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1141/2304] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:49.607919 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716886c3-0d43-431b-9384-a1440a93d0c1 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:49.609471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-716886c3-0d43-431b-9384-a1440a93d0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:49.679237 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716886c3-0d43-431b-9384-a1440a93d0c1 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:49.683353 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb227c-0f1d-42ba-8a47-d555faa0f86f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:49.684130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb227c-0f1d-42ba-8a47-d555faa0f86f service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:49.684442 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb227c-0f1d-42ba-8a47-d555faa0f86f service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:49.684768 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb227c-0f1d-42ba-8a47-d555faa0f86f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:49.697041 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb227c-0f1d-42ba-8a47-d555faa0f86f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:49.698514 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb227c-0f1d-42ba-8a47-d555faa0f86f service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:49.711369 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1164/2305] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:50.371646 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355bc8c-a596-4a05-989b-9ee9fe179ff5 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:50.373363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f355bc8c-a596-4a05-989b-9ee9fe179ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:50.391603 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355bc8c-a596-4a05-989b-9ee9fe179ff5 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:50.400344 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db360f7-f5bc-46f4-bfae-0df49f5d6e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:50.402084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db360f7-f5bc-46f4-bfae-0df49f5d6e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:50.402084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db360f7-f5bc-46f4-bfae-0df49f5d6e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:50.403220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db360f7-f5bc-46f4-bfae-0df49f5d6e96 admin admin] PATH_INFO: `/v3/projects/cba62407590a4eeaa3187d137190cd39` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:50.405005 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db360f7-f5bc-46f4-bfae-0df49f5d6e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cba62407590a4eeaa3187d137190cd39)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:50.408195 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db360f7-f5bc-46f4-bfae-0df49f5d6e96 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:50.524106 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6db360f7-f5bc-46f4-bfae-0df49f5d6e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cba62407590a4eeaa3187d137190cd39', 'request_id': 'req-6db360f7-f5bc-46f4-bfae-0df49f5d6e96'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:50.583094 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6db360f7-f5bc-46f4-bfae-0df49f5d6e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cba62407590a4eeaa3187d137190cd39', 'request_id': 'req-6db360f7-f5bc-46f4-bfae-0df49f5d6e96'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:50.598381 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6db360f7-f5bc-46f4-bfae-0df49f5d6e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cba62407590a4eeaa3187d137190cd39', 'request_id': 'req-6db360f7-f5bc-46f4-bfae-0df49f5d6e96'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:50.626858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6db360f7-f5bc-46f4-bfae-0df49f5d6e96 admin admin] The token cache is being invalidate because project cba62407590a4eeaa3187d137190cd39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:02:50.627508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6db360f7-f5bc-46f4-bfae-0df49f5d6e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:50.628306 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6db360f7-f5bc-46f4-bfae-0df49f5d6e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:50.630203 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1142/2306] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:02:50 2022] DELETE /identity/v3/projects/cba62407590a4eeaa3187d137190cd39 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:53.241749 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e56487-d13a-4eed-a139-3da004938a49 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:53.242267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e56487-d13a-4eed-a139-3da004938a49 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:53.242371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e56487-d13a-4eed-a139-3da004938a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:53.260248 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-76e56487-d13a-4eed-a139-3da004938a49 None None] MFA Rules not processed for user `c3f7f25cf67c40b5a03f4f692a198146`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:53.261530 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-76e56487-d13a-4eed-a139-3da004938a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:53.318236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1165/2307] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:02:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:00.622918 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:03.310953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=56,keystone:DELETE=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:06.398573 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db360f7-f5bc-46f4-bfae-0df49f5d6e96 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:06.400119 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-6db360f7-f5bc-46f4-bfae-0df49f5d6e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:06.462829 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db360f7-f5bc-46f4-bfae-0df49f5d6e96 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:06.466411 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7a0f3-b60a-4927-a7db-bfa44d9f2667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:06.467061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7a0f3-b60a-4927-a7db-bfa44d9f2667 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:06.467345 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7a0f3-b60a-4927-a7db-bfa44d9f2667 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:06.467619 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7a0f3-b60a-4927-a7db-bfa44d9f2667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:06.469673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-67a7a0f3-b60a-4927-a7db-bfa44d9f2667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:06.574077 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7a0f3-b60a-4927-a7db-bfa44d9f2667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:06.575524 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7a0f3-b60a-4927-a7db-bfa44d9f2667 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:06.587255 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1143/2308] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:03:06.934589 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e56487-d13a-4eed-a139-3da004938a49 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:06.936741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-76e56487-d13a-4eed-a139-3da004938a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:06.950214 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e56487-d13a-4eed-a139-3da004938a49 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:06.955430 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412795df-8a29-49fa-92ae-8a470598dbad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:06.956197 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412795df-8a29-49fa-92ae-8a470598dbad service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:06.956537 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412795df-8a29-49fa-92ae-8a470598dbad service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:06.956914 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412795df-8a29-49fa-92ae-8a470598dbad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:06.968564 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-412795df-8a29-49fa-92ae-8a470598dbad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:07.044584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412795df-8a29-49fa-92ae-8a470598dbad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:07.047151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412795df-8a29-49fa-92ae-8a470598dbad service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:07.058384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1166/2309] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:03:07.288486 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7a0f3-b60a-4927-a7db-bfa44d9f2667 service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:07.304329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7a0f3-b60a-4927-a7db-bfa44d9f2667 service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:07.313643 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39d174-7a10-4a35-b23f-d1090016f2d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:07.313643 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39d174-7a10-4a35-b23f-d1090016f2d3 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:07.313643 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39d174-7a10-4a35-b23f-d1090016f2d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:07.313643 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39d174-7a10-4a35-b23f-d1090016f2d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:07.314460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4f39d174-7a10-4a35-b23f-d1090016f2d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:07.330228 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39d174-7a10-4a35-b23f-d1090016f2d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:07.331717 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39d174-7a10-4a35-b23f-d1090016f2d3 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:07.344977 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1144/2310] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:11.668512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e7229-63a5-485c-8864-5c7e98bc9bea None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:11.669078 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e7229-63a5-485c-8864-5c7e98bc9bea None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:11.669384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e7229-63a5-485c-8864-5c7e98bc9bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:11.692116 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-ef1e7229-63a5-485c-8864-5c7e98bc9bea None None] MFA Rules not processed for user `9c2faaf082a34c2eb654012695d91bda`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:11.692116 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ef1e7229-63a5-485c-8864-5c7e98bc9bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:11.776683 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1167/2311] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:03:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:13.049153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39d174-7a10-4a35-b23f-d1090016f2d3 service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:13.052583 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4f39d174-7a10-4a35-b23f-d1090016f2d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:13.068001 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39d174-7a10-4a35-b23f-d1090016f2d3 service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:13.073926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef5d88-aab1-48a7-8a9e-044c3e5a08b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:13.074456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef5d88-aab1-48a7-8a9e-044c3e5a08b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:13.081257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef5d88-aab1-48a7-8a9e-044c3e5a08b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:13.081257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef5d88-aab1-48a7-8a9e-044c3e5a08b9 admin admin] PATH_INFO: `/v3/users/935cd7d4575941148be2d56a9fbdb88a` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:13.081257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef5d88-aab1-48a7-8a9e-044c3e5a08b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=935cd7d4575941148be2d56a9fbdb88a)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:13.081257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef5d88-aab1-48a7-8a9e-044c3e5a08b9 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:13.310931 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-80ef5d88-aab1-48a7-8a9e-044c3e5a08b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935cd7d4575941148be2d56a9fbdb88a'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:13.319839 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-80ef5d88-aab1-48a7-8a9e-044c3e5a08b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935cd7d4575941148be2d56a9fbdb88a'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:13.320682 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-80ef5d88-aab1-48a7-8a9e-044c3e5a08b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935cd7d4575941148be2d56a9fbdb88a'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:13.408127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-80ef5d88-aab1-48a7-8a9e-044c3e5a08b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935cd7d4575941148be2d56a9fbdb88a'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:13.408903 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-80ef5d88-aab1-48a7-8a9e-044c3e5a08b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935cd7d4575941148be2d56a9fbdb88a'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:13.427128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:13.432148 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1145/2312] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:03:13 2022] DELETE /identity/v3/users/935cd7d4575941148be2d56a9fbdb88a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:03:13.707648 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e7229-63a5-485c-8864-5c7e98bc9bea None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:13.718900 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e7229-63a5-485c-8864-5c7e98bc9bea None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:13.781074 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326493ce-a3bc-4407-a595-eca13a43ef5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:13.781827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326493ce-a3bc-4407-a595-eca13a43ef5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:13.782129 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326493ce-a3bc-4407-a595-eca13a43ef5c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:13.782389 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326493ce-a3bc-4407-a595-eca13a43ef5c admin admin] PATH_INFO: `/v3/projects/867aa0f259454aed9d5aa4e67c76476b` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:13.783619 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326493ce-a3bc-4407-a595-eca13a43ef5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=867aa0f259454aed9d5aa4e67c76476b)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:13.785643 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326493ce-a3bc-4407-a595-eca13a43ef5c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:13.906606 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:13.913599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-326493ce-a3bc-4407-a595-eca13a43ef5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '867aa0f259454aed9d5aa4e67c76476b', 'request_id': 'req-326493ce-a3bc-4407-a595-eca13a43ef5c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:13.919135 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-326493ce-a3bc-4407-a595-eca13a43ef5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '867aa0f259454aed9d5aa4e67c76476b', 'request_id': 'req-326493ce-a3bc-4407-a595-eca13a43ef5c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:13.978732 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-326493ce-a3bc-4407-a595-eca13a43ef5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '867aa0f259454aed9d5aa4e67c76476b', 'request_id': 'req-326493ce-a3bc-4407-a595-eca13a43ef5c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:13.996742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-326493ce-a3bc-4407-a595-eca13a43ef5c admin admin] The token cache is being invalidate because project 867aa0f259454aed9d5aa4e67c76476b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:03:13.996742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-326493ce-a3bc-4407-a595-eca13a43ef5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:13.996742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-326493ce-a3bc-4407-a595-eca13a43ef5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:13.996742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1168/2313] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:03:13 2022] DELETE /identity/v3/projects/867aa0f259454aed9d5aa4e67c76476b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:03:14.000217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cee63-a7da-4cf1-b0d7-ebf9e45fdcbe None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:14.000580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cee63-a7da-4cf1-b0d7-ebf9e45fdcbe None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:14.000989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cee63-a7da-4cf1-b0d7-ebf9e45fdcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:14.022993 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-6a7cee63-a7da-4cf1-b0d7-ebf9e45fdcbe None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:14.024304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-6a7cee63-a7da-4cf1-b0d7-ebf9e45fdcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:14.095404 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1146/2314] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:14.104409 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acc11b-7565-40a1-b7a9-6edbe3e8ad35 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:14.104859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acc11b-7565-40a1-b7a9-6edbe3e8ad35 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:14.105032 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acc11b-7565-40a1-b7a9-6edbe3e8ad35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:14.124091 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-53acc11b-7565-40a1-b7a9-6edbe3e8ad35 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:14.125526 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-53acc11b-7565-40a1-b7a9-6edbe3e8ad35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:14.133740 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1169/2315] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:14.139056 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cee63-a7da-4cf1-b0d7-ebf9e45fdcbe None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:14.150523 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cee63-a7da-4cf1-b0d7-ebf9e45fdcbe None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:14.155240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16066735-4f61-4a10-b2b3-000c106ce212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:14.156461 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16066735-4f61-4a10-b2b3-000c106ce212 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:14.157105 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16066735-4f61-4a10-b2b3-000c106ce212 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:14.157105 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16066735-4f61-4a10-b2b3-000c106ce212 admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:14.157782 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16066735-4f61-4a10-b2b3-000c106ce212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:03:14.158091 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16066735-4f61-4a10-b2b3-000c106ce212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:14.159703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16066735-4f61-4a10-b2b3-000c106ce212 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:14.173453 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1147/2316] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:03:14.177904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acc11b-7565-40a1-b7a9-6edbe3e8ad35 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:14.187996 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acc11b-7565-40a1-b7a9-6edbe3e8ad35 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:14.193067 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9deeb7d-4669-41f8-bb0a-9dab2e26bc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:14.193794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deeb7d-4669-41f8-bb0a-9dab2e26bc9c admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:14.194218 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deeb7d-4669-41f8-bb0a-9dab2e26bc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:14.194510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deeb7d-4669-41f8-bb0a-9dab2e26bc9c admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:14.195231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9deeb7d-4669-41f8-bb0a-9dab2e26bc9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:14.197282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9deeb7d-4669-41f8-bb0a-9dab2e26bc9c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:14.293937 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1170/2317] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:03:14 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:03:14.295402 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16066735-4f61-4a10-b2b3-000c106ce212 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:14.309534 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16066735-4f61-4a10-b2b3-000c106ce212 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:14.376902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728d62b-bae1-4de0-9939-c22810cf7854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:14.377912 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728d62b-bae1-4de0-9939-c22810cf7854 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:14.378197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728d62b-bae1-4de0-9939-c22810cf7854 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:14.378486 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728d62b-bae1-4de0-9939-c22810cf7854 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:14.379208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728d62b-bae1-4de0-9939-c22810cf7854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:14.381210 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728d62b-bae1-4de0-9939-c22810cf7854 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:14.488165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1148/2318] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:03:14 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:03:14.492606 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9deeb7d-4669-41f8-bb0a-9dab2e26bc9c admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:14.503782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9deeb7d-4669-41f8-bb0a-9dab2e26bc9c admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:14.508435 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e4254-7184-4c87-805a-929b2f7d908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:14.509125 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e4254-7184-4c87-805a-929b2f7d908e admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:14.509417 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e4254-7184-4c87-805a-929b2f7d908e admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:14.509700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e4254-7184-4c87-805a-929b2f7d908e admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:14.510440 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e4254-7184-4c87-805a-929b2f7d908e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:14.512047 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e4254-7184-4c87-805a-929b2f7d908e admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:14.523824 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1171/2319] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:03:14.534249 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728d62b-bae1-4de0-9939-c22810cf7854 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:14.544460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728d62b-bae1-4de0-9939-c22810cf7854 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:14.550261 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3331a-afbb-4764-97b8-e24d544ddec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:14.551023 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3331a-afbb-4764-97b8-e24d544ddec9 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:14.551297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3331a-afbb-4764-97b8-e24d544ddec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:14.551581 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3331a-afbb-4764-97b8-e24d544ddec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:14.555825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3331a-afbb-4764-97b8-e24d544ddec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:14.555825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3331a-afbb-4764-97b8-e24d544ddec9 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:14.567392 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1149/2320] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:03:14.571606 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e4254-7184-4c87-805a-929b2f7d908e admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:14.582227 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e4254-7184-4c87-805a-929b2f7d908e admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:14.586807 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a36d0-6200-4fe3-a5d2-8d7e0991d409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:14.588721 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a36d0-6200-4fe3-a5d2-8d7e0991d409 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:14.588721 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a36d0-6200-4fe3-a5d2-8d7e0991d409 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:14.588721 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a36d0-6200-4fe3-a5d2-8d7e0991d409 admin admin] PATH_INFO: `/v3/projects/6fc9ad82848c4936bcb0cfce97ee8d44/users/edfe42eb7426491691d9d027839d1d72/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:14.603045 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a36d0-6200-4fe3-a5d2-8d7e0991d409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc9ad82848c4936bcb0cfce97ee8d44, user_id=edfe42eb7426491691d9d027839d1d72, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:14.605726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a36d0-6200-4fe3-a5d2-8d7e0991d409 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:14.694397 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1172/2321] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:03:14 2022] PUT /identity/v3/projects/6fc9ad82848c4936bcb0cfce97ee8d44/users/edfe42eb7426491691d9d027839d1d72/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:03:14.704697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbc5a1-04e5-41b3-b482-dd4c0ca974c1 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:14.704996 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbc5a1-04e5-41b3-b482-dd4c0ca974c1 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:14.705301 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbc5a1-04e5-41b3-b482-dd4c0ca974c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:14.732123 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-35fbc5a1-04e5-41b3-b482-dd4c0ca974c1 None None] MFA Rules not processed for user `edfe42eb7426491691d9d027839d1d72`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:14.733266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-35fbc5a1-04e5-41b3-b482-dd4c0ca974c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:14.789834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:14.799578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1150/2322] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:03:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:14.804060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a36d0-6200-4fe3-a5d2-8d7e0991d409 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:14.867679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a36d0-6200-4fe3-a5d2-8d7e0991d409 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:14.872366 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86c375-2966-4c60-8392-98c07254ac23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:14.873064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86c375-2966-4c60-8392-98c07254ac23 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:14.873352 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86c375-2966-4c60-8392-98c07254ac23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:14.873633 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86c375-2966-4c60-8392-98c07254ac23 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:14.875057 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86c375-2966-4c60-8392-98c07254ac23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:14.877082 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86c375-2966-4c60-8392-98c07254ac23 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:14.974970 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1173/2323] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:03:14 2022] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:03:14.979309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbc5a1-04e5-41b3-b482-dd4c0ca974c1 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:14.990701 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbc5a1-04e5-41b3-b482-dd4c0ca974c1 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:15.051535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727eb87-3ebc-4474-a8fc-2ef584b75c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:15.052234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727eb87-3ebc-4474-a8fc-2ef584b75c6e admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:15.052558 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727eb87-3ebc-4474-a8fc-2ef584b75c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:15.052871 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727eb87-3ebc-4474-a8fc-2ef584b75c6e admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:15.054156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727eb87-3ebc-4474-a8fc-2ef584b75c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:15.055522 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727eb87-3ebc-4474-a8fc-2ef584b75c6e admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:15.157614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1151/2324] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:03:14 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:03:15.161599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86c375-2966-4c60-8392-98c07254ac23 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:15.173392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86c375-2966-4c60-8392-98c07254ac23 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:15.178148 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbcf39-9035-4fb5-a612-cb67a332c91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:15.178906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbcf39-9035-4fb5-a612-cb67a332c91f admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:15.179252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbcf39-9035-4fb5-a612-cb67a332c91f admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:15.179602 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbcf39-9035-4fb5-a612-cb67a332c91f admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:15.180410 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbcf39-9035-4fb5-a612-cb67a332c91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:15.182142 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbcf39-9035-4fb5-a612-cb67a332c91f admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:15.194607 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1174/2325] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:03:15.199512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727eb87-3ebc-4474-a8fc-2ef584b75c6e admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:15.210063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727eb87-3ebc-4474-a8fc-2ef584b75c6e admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:15.214800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689db761-13ac-4c1a-bfb9-432296b6d953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:15.215740 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689db761-13ac-4c1a-bfb9-432296b6d953 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:15.215982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689db761-13ac-4c1a-bfb9-432296b6d953 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:15.216262 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689db761-13ac-4c1a-bfb9-432296b6d953 admin admin] PATH_INFO: `/v3/projects/84378faef11b4145ab55c6311c9fb838/users/d09aa4a0843b4d55bd6c899331e50a05/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:15.232683 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689db761-13ac-4c1a-bfb9-432296b6d953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84378faef11b4145ab55c6311c9fb838, user_id=d09aa4a0843b4d55bd6c899331e50a05, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:15.236153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689db761-13ac-4c1a-bfb9-432296b6d953 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:15.311762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1152/2326] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:03:15 2022] PUT /identity/v3/projects/84378faef11b4145ab55c6311c9fb838/users/d09aa4a0843b4d55bd6c899331e50a05/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:03:15.315917 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbcf39-9035-4fb5-a612-cb67a332c91f admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:15.328146 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbcf39-9035-4fb5-a612-cb67a332c91f admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:15.391018 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:15.410827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59700678-56d2-4506-85ef-3ccfe749ebb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:15.411528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59700678-56d2-4506-85ef-3ccfe749ebb9 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:15.411817 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59700678-56d2-4506-85ef-3ccfe749ebb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:15.412095 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59700678-56d2-4506-85ef-3ccfe749ebb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:15.412858 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59700678-56d2-4506-85ef-3ccfe749ebb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:15.414497 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59700678-56d2-4506-85ef-3ccfe749ebb9 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:15.424957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1175/2327] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:03:15.428901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689db761-13ac-4c1a-bfb9-432296b6d953 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:15.439459 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689db761-13ac-4c1a-bfb9-432296b6d953 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:15.444096 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363f228-7d95-48ce-97c6-7e156433fac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:15.445044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363f228-7d95-48ce-97c6-7e156433fac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:15.445345 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363f228-7d95-48ce-97c6-7e156433fac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:15.445613 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363f228-7d95-48ce-97c6-7e156433fac7 admin admin] PATH_INFO: `/v3/projects/84378faef11b4145ab55c6311c9fb838/users/d09aa4a0843b4d55bd6c899331e50a05/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:15.447672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363f228-7d95-48ce-97c6-7e156433fac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84378faef11b4145ab55c6311c9fb838, user_id=d09aa4a0843b4d55bd6c899331e50a05, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:15.450354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363f228-7d95-48ce-97c6-7e156433fac7 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:15.462061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1153/2328] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:03:15 2022] PUT /identity/v3/projects/84378faef11b4145ab55c6311c9fb838/users/d09aa4a0843b4d55bd6c899331e50a05/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:03:15.474579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3b9e2-ec04-4f33-855b-b4257fcef5f7 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:15.474870 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3b9e2-ec04-4f33-855b-b4257fcef5f7 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:15.475416 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3b9e2-ec04-4f33-855b-b4257fcef5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:15.503305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-70c3b9e2-ec04-4f33-855b-b4257fcef5f7 None None] MFA Rules not processed for user `d09aa4a0843b4d55bd6c899331e50a05`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:15.504527 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-70c3b9e2-ec04-4f33-855b-b4257fcef5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:15.574387 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1176/2329] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:03:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:03:15.586218 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363f228-7d95-48ce-97c6-7e156433fac7 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:15.587926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4363f228-7d95-48ce-97c6-7e156433fac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:15.653804 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363f228-7d95-48ce-97c6-7e156433fac7 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:15.658065 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ad540-296f-488e-b8f3-454da70b4c1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:15.658716 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ad540-296f-488e-b8f3-454da70b4c1b service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:15.659001 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ad540-296f-488e-b8f3-454da70b4c1b service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:15.659278 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ad540-296f-488e-b8f3-454da70b4c1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:15.668450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ad540-296f-488e-b8f3-454da70b4c1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:15.669932 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ad540-296f-488e-b8f3-454da70b4c1b service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:15.680289 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1154/2330] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:15.867776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3b9e2-ec04-4f33-855b-b4257fcef5f7 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:15.877641 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3b9e2-ec04-4f33-855b-b4257fcef5f7 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:15.882760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc748b-2c50-4574-aa64-5eccb6dde612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:15.882760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc748b-2c50-4574-aa64-5eccb6dde612 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:15.882760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc748b-2c50-4574-aa64-5eccb6dde612 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:15.882760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc748b-2c50-4574-aa64-5eccb6dde612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:15.955155 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc748b-2c50-4574-aa64-5eccb6dde612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:15.956680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc748b-2c50-4574-aa64-5eccb6dde612 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:15.966341 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1177/2331] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:18.689216 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ad540-296f-488e-b8f3-454da70b4c1b service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:18.690648 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4f5ad540-296f-488e-b8f3-454da70b4c1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:18.742860 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:18.764033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ad540-296f-488e-b8f3-454da70b4c1b service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:18.770134 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea642e4a-aa53-40a9-9061-606705256060 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:18.770850 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea642e4a-aa53-40a9-9061-606705256060 service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:18.771135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea642e4a-aa53-40a9-9061-606705256060 service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:18.771410 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea642e4a-aa53-40a9-9061-606705256060 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:18.773266 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ea642e4a-aa53-40a9-9061-606705256060 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:18.834314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea642e4a-aa53-40a9-9061-606705256060 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:18.836094 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea642e4a-aa53-40a9-9061-606705256060 service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:18.846689 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1155/2332] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:24.535975 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc748b-2c50-4574-aa64-5eccb6dde612 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:24.606129 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc748b-2c50-4574-aa64-5eccb6dde612 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:24.613003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd634b-84dd-46bc-8af7-07d08185f632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:24.614064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd634b-84dd-46bc-8af7-07d08185f632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:24.614428 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd634b-84dd-46bc-8af7-07d08185f632 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:24.614774 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd634b-84dd-46bc-8af7-07d08185f632 admin admin] PATH_INFO: `/v3/users/edfe42eb7426491691d9d027839d1d72` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:24.616783 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd634b-84dd-46bc-8af7-07d08185f632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edfe42eb7426491691d9d027839d1d72)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:24.618897 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd634b-84dd-46bc-8af7-07d08185f632 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:24.620990 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:24.855184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-71dd634b-84dd-46bc-8af7-07d08185f632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edfe42eb7426491691d9d027839d1d72'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:24.866818 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-71dd634b-84dd-46bc-8af7-07d08185f632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edfe42eb7426491691d9d027839d1d72'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:24.960623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-71dd634b-84dd-46bc-8af7-07d08185f632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edfe42eb7426491691d9d027839d1d72'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:24.961393 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-71dd634b-84dd-46bc-8af7-07d08185f632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edfe42eb7426491691d9d027839d1d72'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:24.962019 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-71dd634b-84dd-46bc-8af7-07d08185f632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edfe42eb7426491691d9d027839d1d72'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:24.988898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1178/2333] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:03:24 2022] DELETE /identity/v3/users/edfe42eb7426491691d9d027839d1d72 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:03:24.993990 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901759f-f4f8-4e98-9d20-2ca9b96272cd None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:24.993990 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901759f-f4f8-4e98-9d20-2ca9b96272cd None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:24.993990 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901759f-f4f8-4e98-9d20-2ca9b96272cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:25.012256 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-1901759f-f4f8-4e98-9d20-2ca9b96272cd None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:25.013503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-1901759f-f4f8-4e98-9d20-2ca9b96272cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:25.077140 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1156/2334] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:25.099138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd634b-84dd-46bc-8af7-07d08185f632 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:25.100957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-71dd634b-84dd-46bc-8af7-07d08185f632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:25.183123 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd634b-84dd-46bc-8af7-07d08185f632 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:25.188060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3da77-ac3a-4aa1-bb4f-d470702d4b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:25.189019 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3da77-ac3a-4aa1-bb4f-d470702d4b9f service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:25.189403 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3da77-ac3a-4aa1-bb4f-d470702d4b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:25.189764 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3da77-ac3a-4aa1-bb4f-d470702d4b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:25.201997 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3da77-ac3a-4aa1-bb4f-d470702d4b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:25.204299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3da77-ac3a-4aa1-bb4f-d470702d4b9f service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:25.216784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1179/2335] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:03:25.879521 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901759f-f4f8-4e98-9d20-2ca9b96272cd None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:25.881401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-1901759f-f4f8-4e98-9d20-2ca9b96272cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:25.902048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901759f-f4f8-4e98-9d20-2ca9b96272cd None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:25.908282 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3e0c6-0de1-48e4-b184-4d5a816d6518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:25.909312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3e0c6-0de1-48e4-b184-4d5a816d6518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:25.909656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3e0c6-0de1-48e4-b184-4d5a816d6518 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:25.910011 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3e0c6-0de1-48e4-b184-4d5a816d6518 admin admin] PATH_INFO: `/v3/projects/6fc9ad82848c4936bcb0cfce97ee8d44` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:25.911229 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3e0c6-0de1-48e4-b184-4d5a816d6518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc9ad82848c4936bcb0cfce97ee8d44)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:25.913949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3e0c6-0de1-48e4-b184-4d5a816d6518 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:26.058908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-41c3e0c6-0de1-48e4-b184-4d5a816d6518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc9ad82848c4936bcb0cfce97ee8d44', 'request_id': 'req-41c3e0c6-0de1-48e4-b184-4d5a816d6518'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:26.151162 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-41c3e0c6-0de1-48e4-b184-4d5a816d6518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc9ad82848c4936bcb0cfce97ee8d44', 'request_id': 'req-41c3e0c6-0de1-48e4-b184-4d5a816d6518'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:26.159629 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-41c3e0c6-0de1-48e4-b184-4d5a816d6518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc9ad82848c4936bcb0cfce97ee8d44', 'request_id': 'req-41c3e0c6-0de1-48e4-b184-4d5a816d6518'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:26.173681 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-41c3e0c6-0de1-48e4-b184-4d5a816d6518 admin admin] The token cache is being invalidate because project 6fc9ad82848c4936bcb0cfce97ee8d44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:03:26.173994 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-41c3e0c6-0de1-48e4-b184-4d5a816d6518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:26.174640 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-41c3e0c6-0de1-48e4-b184-4d5a816d6518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:26.177207 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1157/2336] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:03:25 2022] DELETE /identity/v3/projects/6fc9ad82848c4936bcb0cfce97ee8d44 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:03:26.181656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3da77-ac3a-4aa1-bb4f-d470702d4b9f service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:26.196087 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3da77-ac3a-4aa1-bb4f-d470702d4b9f service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:26.261815 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a5ca5-823c-4c1b-8d84-9bd1a9305272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:26.262918 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a5ca5-823c-4c1b-8d84-9bd1a9305272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:26.263355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a5ca5-823c-4c1b-8d84-9bd1a9305272 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:26.263642 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a5ca5-823c-4c1b-8d84-9bd1a9305272 admin admin] PATH_INFO: `/v3/users/d09aa4a0843b4d55bd6c899331e50a05` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:26.265498 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a5ca5-823c-4c1b-8d84-9bd1a9305272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d09aa4a0843b4d55bd6c899331e50a05)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:26.267508 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a5ca5-823c-4c1b-8d84-9bd1a9305272 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:26.295838 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:26.446080 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-682a5ca5-823c-4c1b-8d84-9bd1a9305272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd09aa4a0843b4d55bd6c899331e50a05'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:26.470941 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-682a5ca5-823c-4c1b-8d84-9bd1a9305272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd09aa4a0843b4d55bd6c899331e50a05'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:26.602874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-682a5ca5-823c-4c1b-8d84-9bd1a9305272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd09aa4a0843b4d55bd6c899331e50a05'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:26.604226 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-682a5ca5-823c-4c1b-8d84-9bd1a9305272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd09aa4a0843b4d55bd6c899331e50a05'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:26.605022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-682a5ca5-823c-4c1b-8d84-9bd1a9305272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd09aa4a0843b4d55bd6c899331e50a05'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:26.638872 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1180/2337] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:03:26 2022] DELETE /identity/v3/users/d09aa4a0843b4d55bd6c899331e50a05 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:03:27.294117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4787bd-5f91-45d2-8098-56d96145225d None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:27.294624 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4787bd-5f91-45d2-8098-56d96145225d None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:27.294825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4787bd-5f91-45d2-8098-56d96145225d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:27.313863 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a5ca5-823c-4c1b-8d84-9bd1a9305272 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:27.317309 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-682a5ca5-823c-4c1b-8d84-9bd1a9305272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:27.319847 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-3d4787bd-5f91-45d2-8098-56d96145225d None None] MFA Rules not processed for user `1b03d940626a449dbe904f02f3d70854`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:27.325665 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-3d4787bd-5f91-45d2-8098-56d96145225d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:27.335247 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:27.416150 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1158/2338] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 23 11:03:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:27.418027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a5ca5-823c-4c1b-8d84-9bd1a9305272 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:27.424603 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020513b-519f-4a2c-ab44-36345ee6878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:27.426341 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020513b-519f-4a2c-ab44-36345ee6878f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:27.429593 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020513b-519f-4a2c-ab44-36345ee6878f admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:27.429593 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020513b-519f-4a2c-ab44-36345ee6878f admin admin] PATH_INFO: `/v3/projects/84378faef11b4145ab55c6311c9fb838` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:27.434111 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020513b-519f-4a2c-ab44-36345ee6878f admin admin] RBAC: Authorizing `identity:delete_project(project_id=84378faef11b4145ab55c6311c9fb838)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:27.437192 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020513b-519f-4a2c-ab44-36345ee6878f admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:27.542555 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-1020513b-519f-4a2c-ab44-36345ee6878f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84378faef11b4145ab55c6311c9fb838', 'request_id': 'req-1020513b-519f-4a2c-ab44-36345ee6878f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:27.549868 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-1020513b-519f-4a2c-ab44-36345ee6878f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84378faef11b4145ab55c6311c9fb838', 'request_id': 'req-1020513b-519f-4a2c-ab44-36345ee6878f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:27.555600 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4787bd-5f91-45d2-8098-56d96145225d None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:27.557265 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-3d4787bd-5f91-45d2-8098-56d96145225d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:27.617810 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-1020513b-519f-4a2c-ab44-36345ee6878f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84378faef11b4145ab55c6311c9fb838', 'request_id': 'req-1020513b-519f-4a2c-ab44-36345ee6878f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:27.632938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-1020513b-519f-4a2c-ab44-36345ee6878f admin admin] The token cache is being invalidate because project 84378faef11b4145ab55c6311c9fb838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:03:27.633148 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-1020513b-519f-4a2c-ab44-36345ee6878f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:27.634030 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-1020513b-519f-4a2c-ab44-36345ee6878f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:27.637005 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1181/2339] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:03:27 2022] DELETE /identity/v3/projects/84378faef11b4145ab55c6311c9fb838 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:03:27.642067 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf627a-46ea-4a63-9628-ebaf0cf73648 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:27.642370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf627a-46ea-4a63-9628-ebaf0cf73648 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:27.642637 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf627a-46ea-4a63-9628-ebaf0cf73648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:27.663094 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-26bf627a-46ea-4a63-9628-ebaf0cf73648 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:27.663391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4787bd-5f91-45d2-8098-56d96145225d None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:27.664368 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-26bf627a-46ea-4a63-9628-ebaf0cf73648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:27.693494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:27.731184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df2691-afe6-4c03-9e94-6367cf643732 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a54fa1c326f41e88688404a56b75c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:27.739024 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1182/2340] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:03:27.739163 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df2691-afe6-4c03-9e94-6367cf643732 service swift] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:27.739163 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df2691-afe6-4c03-9e94-6367cf643732 service swift] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:27.739163 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df2691-afe6-4c03-9e94-6367cf643732 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:27.739163 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-b5df2691-afe6-4c03-9e94-6367cf643732 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:27.740466 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c1047-1238-4e45-8d0e-38d0ed8dfa35 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:27.740779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c1047-1238-4e45-8d0e-38d0ed8dfa35 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:27.741060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c1047-1238-4e45-8d0e-38d0ed8dfa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:27.763072 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-452c1047-1238-4e45-8d0e-38d0ed8dfa35 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:27.764315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-452c1047-1238-4e45-8d0e-38d0ed8dfa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:27.775203 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1183/2341] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:03:27.779118 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c1047-1238-4e45-8d0e-38d0ed8dfa35 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:27.789476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c1047-1238-4e45-8d0e-38d0ed8dfa35 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:27.794830 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145157b-f882-4aa2-8a31-c759562434d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:27.795553 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145157b-f882-4aa2-8a31-c759562434d7 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:27.796142 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145157b-f882-4aa2-8a31-c759562434d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:27.797013 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145157b-f882-4aa2-8a31-c759562434d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:27.797773 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145157b-f882-4aa2-8a31-c759562434d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:03:27.798131 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145157b-f882-4aa2-8a31-c759562434d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:27.798627 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:27.799788 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145157b-f882-4aa2-8a31-c759562434d7 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:27.809875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df2691-afe6-4c03-9e94-6367cf643732 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:27.811905 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df2691-afe6-4c03-9e94-6367cf643732 service swift] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:27.813432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1184/2342] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:03:27.817753 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145157b-f882-4aa2-8a31-c759562434d7 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:27.821318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1159/2343] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 23 11:03:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:03:27.829496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145157b-f882-4aa2-8a31-c759562434d7 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:27.834988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289af1e-e7db-43d4-9520-271bcf57c589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:27.835825 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289af1e-e7db-43d4-9520-271bcf57c589 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:27.836022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289af1e-e7db-43d4-9520-271bcf57c589 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:27.836259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289af1e-e7db-43d4-9520-271bcf57c589 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:27.837003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289af1e-e7db-43d4-9520-271bcf57c589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:27.838943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289af1e-e7db-43d4-9520-271bcf57c589 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:27.990484 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1185/2344] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:03:27 2022] POST /identity/v3/projects => generated 355 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:03:27.991971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df2691-afe6-4c03-9e94-6367cf643732 service swift] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:28.005677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df2691-afe6-4c03-9e94-6367cf643732 service swift] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:28.138425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef4d1f-73af-4b9c-8c76-5e5f03d76dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:28.139111 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef4d1f-73af-4b9c-8c76-5e5f03d76dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:28.139518 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef4d1f-73af-4b9c-8c76-5e5f03d76dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:28.140447 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef4d1f-73af-4b9c-8c76-5e5f03d76dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:28.141211 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef4d1f-73af-4b9c-8c76-5e5f03d76dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:28.147178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef4d1f-73af-4b9c-8c76-5e5f03d76dc2 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:28.258661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1160/2345] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:03:27 2022] POST /identity/v3/users => generated 278 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:03:28.262604 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289af1e-e7db-43d4-9520-271bcf57c589 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:28.281467 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289af1e-e7db-43d4-9520-271bcf57c589 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:28.286608 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762e0b7-d3ad-48c9-9205-0ac881db3c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:28.287690 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762e0b7-d3ad-48c9-9205-0ac881db3c04 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:28.288042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762e0b7-d3ad-48c9-9205-0ac881db3c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:28.288387 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762e0b7-d3ad-48c9-9205-0ac881db3c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:28.289237 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762e0b7-d3ad-48c9-9205-0ac881db3c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:28.290905 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762e0b7-d3ad-48c9-9205-0ac881db3c04 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:28.306730 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1186/2346] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:03:28.311048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef4d1f-73af-4b9c-8c76-5e5f03d76dc2 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:28.324332 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef4d1f-73af-4b9c-8c76-5e5f03d76dc2 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:28.330294 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d03669-5af3-432e-9f03-83c8632ad792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:28.331100 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d03669-5af3-432e-9f03-83c8632ad792 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:28.331635 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d03669-5af3-432e-9f03-83c8632ad792 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:28.332062 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d03669-5af3-432e-9f03-83c8632ad792 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:28.333062 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d03669-5af3-432e-9f03-83c8632ad792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:28.334795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d03669-5af3-432e-9f03-83c8632ad792 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:28.351663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1161/2347] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:03:28.352899 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762e0b7-d3ad-48c9-9205-0ac881db3c04 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:28.365365 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762e0b7-d3ad-48c9-9205-0ac881db3c04 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:28.370089 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236c273-b193-4bec-bbe2-00c56a53526e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:28.370975 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236c273-b193-4bec-bbe2-00c56a53526e admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:28.371257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236c273-b193-4bec-bbe2-00c56a53526e admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:28.371535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236c273-b193-4bec-bbe2-00c56a53526e admin admin] PATH_INFO: `/v3/projects/5d76e1978ee742bf841408def4258237/users/e2a0eb97b9564c06a109317cc95f4582/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:28.389027 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236c273-b193-4bec-bbe2-00c56a53526e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d76e1978ee742bf841408def4258237, user_id=e2a0eb97b9564c06a109317cc95f4582, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:28.392222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236c273-b193-4bec-bbe2-00c56a53526e admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:28.489732 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1187/2348] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:03:28 2022] PUT /identity/v3/projects/5d76e1978ee742bf841408def4258237/users/e2a0eb97b9564c06a109317cc95f4582/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:03:28.504105 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fd6af-dc51-4100-8325-36506be5d2c2 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:28.504396 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fd6af-dc51-4100-8325-36506be5d2c2 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:28.504929 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fd6af-dc51-4100-8325-36506be5d2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:28.566500 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-292fd6af-dc51-4100-8325-36506be5d2c2 None None] MFA Rules not processed for user `e2a0eb97b9564c06a109317cc95f4582`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:28.568346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-292fd6af-dc51-4100-8325-36506be5d2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:28.679811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1162/2349] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:03:28 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:28.684273 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236c273-b193-4bec-bbe2-00c56a53526e admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:28.762150 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236c273-b193-4bec-bbe2-00c56a53526e admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:28.768057 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8c243-6217-4d78-ad60-58e1171fd565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:28.769000 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8c243-6217-4d78-ad60-58e1171fd565 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:28.769495 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8c243-6217-4d78-ad60-58e1171fd565 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:28.769926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8c243-6217-4d78-ad60-58e1171fd565 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:28.770788 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8c243-6217-4d78-ad60-58e1171fd565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:28.772956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8c243-6217-4d78-ad60-58e1171fd565 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:28.870297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1188/2350] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:03:28 2022] POST /identity/v3/projects => generated 357 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:03:28.874379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fd6af-dc51-4100-8325-36506be5d2c2 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:28.887916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fd6af-dc51-4100-8325-36506be5d2c2 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:28.950876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:28.960427 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87e03c-7d1d-4356-a4fe-090e5cae30c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:28.961226 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87e03c-7d1d-4356-a4fe-090e5cae30c2 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:28.961509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87e03c-7d1d-4356-a4fe-090e5cae30c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:28.961786 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87e03c-7d1d-4356-a4fe-090e5cae30c2 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:28.962483 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87e03c-7d1d-4356-a4fe-090e5cae30c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:28.964421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87e03c-7d1d-4356-a4fe-090e5cae30c2 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:29.052761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1163/2351] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:03:28 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:03:29.055521 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8c243-6217-4d78-ad60-58e1171fd565 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:29.067210 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8c243-6217-4d78-ad60-58e1171fd565 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:29.077170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611e580-d33f-4b1c-8f1f-3029d865929d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:29.078370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611e580-d33f-4b1c-8f1f-3029d865929d admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:29.078662 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611e580-d33f-4b1c-8f1f-3029d865929d admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:29.078943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611e580-d33f-4b1c-8f1f-3029d865929d admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:29.079728 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611e580-d33f-4b1c-8f1f-3029d865929d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:29.081797 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611e580-d33f-4b1c-8f1f-3029d865929d admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:29.100777 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1189/2352] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:03:29.101512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87e03c-7d1d-4356-a4fe-090e5cae30c2 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:29.113554 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87e03c-7d1d-4356-a4fe-090e5cae30c2 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:29.122176 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c510264-5355-4dc5-9f40-e9c1ddbd2b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:29.123495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510264-5355-4dc5-9f40-e9c1ddbd2b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:29.123852 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510264-5355-4dc5-9f40-e9c1ddbd2b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:29.128019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510264-5355-4dc5-9f40-e9c1ddbd2b25 admin admin] PATH_INFO: `/v3/projects/fc92785dfe3648578c5b0cea1363a8ff/users/e1cf29ed9d09486ebb64a04ca2913569/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:29.144481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c510264-5355-4dc5-9f40-e9c1ddbd2b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc92785dfe3648578c5b0cea1363a8ff, user_id=e1cf29ed9d09486ebb64a04ca2913569, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:29.148345 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c510264-5355-4dc5-9f40-e9c1ddbd2b25 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:29.230972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1164/2353] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:03:29 2022] PUT /identity/v3/projects/fc92785dfe3648578c5b0cea1363a8ff/users/e1cf29ed9d09486ebb64a04ca2913569/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:03:29.235852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611e580-d33f-4b1c-8f1f-3029d865929d admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:29.247318 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611e580-d33f-4b1c-8f1f-3029d865929d admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:29.277604 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:29.322921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931af64d-96e3-402b-a505-9b2830213c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:29.322921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931af64d-96e3-402b-a505-9b2830213c52 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:29.322921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931af64d-96e3-402b-a505-9b2830213c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:29.322921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931af64d-96e3-402b-a505-9b2830213c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:29.323424 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931af64d-96e3-402b-a505-9b2830213c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:29.323424 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931af64d-96e3-402b-a505-9b2830213c52 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:29.334659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1190/2354] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:03:29.338903 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c510264-5355-4dc5-9f40-e9c1ddbd2b25 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:29.350918 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c510264-5355-4dc5-9f40-e9c1ddbd2b25 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:29.359992 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9909fe-98e5-4c56-86c3-d142424708a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:29.361338 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9909fe-98e5-4c56-86c3-d142424708a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:29.361654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9909fe-98e5-4c56-86c3-d142424708a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:29.361957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9909fe-98e5-4c56-86c3-d142424708a1 admin admin] PATH_INFO: `/v3/projects/fc92785dfe3648578c5b0cea1363a8ff/users/e1cf29ed9d09486ebb64a04ca2913569/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:29.364120 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9909fe-98e5-4c56-86c3-d142424708a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc92785dfe3648578c5b0cea1363a8ff, user_id=e1cf29ed9d09486ebb64a04ca2913569, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:29.366864 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9909fe-98e5-4c56-86c3-d142424708a1 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:29.387116 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1165/2355] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:03:29 2022] PUT /identity/v3/projects/fc92785dfe3648578c5b0cea1363a8ff/users/e1cf29ed9d09486ebb64a04ca2913569/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:03:29.398431 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c5cc9-452e-4b4d-95d2-b557b0136c55 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:29.398980 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c5cc9-452e-4b4d-95d2-b557b0136c55 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:29.398980 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c5cc9-452e-4b4d-95d2-b557b0136c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:29.434918 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-9a0c5cc9-452e-4b4d-95d2-b557b0136c55 None None] MFA Rules not processed for user `e1cf29ed9d09486ebb64a04ca2913569`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:29.436462 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9a0c5cc9-452e-4b4d-95d2-b557b0136c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:29.532759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1191/2356] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:03:29 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:29.549020 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9909fe-98e5-4c56-86c3-d142424708a1 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:29.550871 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-6f9909fe-98e5-4c56-86c3-d142424708a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:29.622350 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9909fe-98e5-4c56-86c3-d142424708a1 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:29.627181 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643a4d2-abbf-407e-984f-e205fbc646c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:29.627950 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643a4d2-abbf-407e-984f-e205fbc646c2 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:29.628384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643a4d2-abbf-407e-984f-e205fbc646c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:29.628744 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643a4d2-abbf-407e-984f-e205fbc646c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:29.640008 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643a4d2-abbf-407e-984f-e205fbc646c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:29.641650 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643a4d2-abbf-407e-984f-e205fbc646c2 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:29.653536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1166/2357] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:29 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:29.895234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c5cc9-452e-4b4d-95d2-b557b0136c55 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:29.915788 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c5cc9-452e-4b4d-95d2-b557b0136c55 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:29.925746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34506c-f7f7-433c-90a8-d302b841193c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:29.926481 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34506c-f7f7-433c-90a8-d302b841193c service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:29.926860 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34506c-f7f7-433c-90a8-d302b841193c service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:29.927270 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34506c-f7f7-433c-90a8-d302b841193c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:30.020213 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34506c-f7f7-433c-90a8-d302b841193c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:30.022106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34506c-f7f7-433c-90a8-d302b841193c service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:30.036928 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1192/2358] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:29 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:39.497025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643a4d2-abbf-407e-984f-e205fbc646c2 service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:39.498520 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a643a4d2-abbf-407e-984f-e205fbc646c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:39.585119 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643a4d2-abbf-407e-984f-e205fbc646c2 service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:39.589728 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c68ff-6f6e-4f12-b358-c278d7647b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:39.590400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c68ff-6f6e-4f12-b358-c278d7647b6d service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:39.590690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c68ff-6f6e-4f12-b358-c278d7647b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:39.590965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c68ff-6f6e-4f12-b358-c278d7647b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:39.594877 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c46c68ff-6f6e-4f12-b358-c278d7647b6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:39.617723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c68ff-6f6e-4f12-b358-c278d7647b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:39.620513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c68ff-6f6e-4f12-b358-c278d7647b6d service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:39.638194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1167/2359] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:40.031521 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=78 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:45.797080 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34506c-f7f7-433c-90a8-d302b841193c service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:45.798523 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-7a34506c-f7f7-433c-90a8-d302b841193c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:45.868728 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34506c-f7f7-433c-90a8-d302b841193c service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:45.873753 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82439cd-6014-47d5-9208-a63cb1d645f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff588aaad264f9cbc5a80e73ef0c09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:45.874974 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82439cd-6014-47d5-9208-a63cb1d645f8 service placement] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:45.875255 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82439cd-6014-47d5-9208-a63cb1d645f8 service placement] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:45.875533 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82439cd-6014-47d5-9208-a63cb1d645f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:45.877338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e82439cd-6014-47d5-9208-a63cb1d645f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:45.888556 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82439cd-6014-47d5-9208-a63cb1d645f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:45.890944 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82439cd-6014-47d5-9208-a63cb1d645f8 service placement] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:45.901255 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1193/2360] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:48.082287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61c56f-f12b-424c-98f0-01022f6643bd None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:48.082786 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61c56f-f12b-424c-98f0-01022f6643bd None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:48.082907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61c56f-f12b-424c-98f0-01022f6643bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:48.102926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-1e61c56f-f12b-424c-98f0-01022f6643bd None None] MFA Rules not processed for user `1b03d940626a449dbe904f02f3d70854`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:48.104156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-1e61c56f-f12b-424c-98f0-01022f6643bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:48.153810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:48.161691 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1168/2361] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 23 11:03:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:48.174646 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82439cd-6014-47d5-9208-a63cb1d645f8 service placement] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:48.180432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e82439cd-6014-47d5-9208-a63cb1d645f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:48.247501 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82439cd-6014-47d5-9208-a63cb1d645f8 service placement] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:48.253411 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4357648-bad2-4e2e-a4f4-503ce7b7e015 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a54fa1c326f41e88688404a56b75c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:48.254066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4357648-bad2-4e2e-a4f4-503ce7b7e015 service swift] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:48.254355 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4357648-bad2-4e2e-a4f4-503ce7b7e015 service swift] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:48.254641 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4357648-bad2-4e2e-a4f4-503ce7b7e015 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:48.263736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4357648-bad2-4e2e-a4f4-503ce7b7e015 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:48.265787 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4357648-bad2-4e2e-a4f4-503ce7b7e015 service swift] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:48.275238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1194/2362] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 23 11:03:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:03:48.392163 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61c56f-f12b-424c-98f0-01022f6643bd None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:48.393815 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-1e61c56f-f12b-424c-98f0-01022f6643bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:48.536181 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61c56f-f12b-424c-98f0-01022f6643bd None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:48.543899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcda9d-92aa-407a-b7ca-b9fa6143b0e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:48.545159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcda9d-92aa-407a-b7ca-b9fa6143b0e0 service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:48.545743 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcda9d-92aa-407a-b7ca-b9fa6143b0e0 service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:48.546160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcda9d-92aa-407a-b7ca-b9fa6143b0e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:48.549261 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-0fbcda9d-92aa-407a-b7ca-b9fa6143b0e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:48.672786 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcda9d-92aa-407a-b7ca-b9fa6143b0e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:48.676430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcda9d-92aa-407a-b7ca-b9fa6143b0e0 service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:48.687666 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1169/2363] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:48.939716 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4357648-bad2-4e2e-a4f4-503ce7b7e015 service swift] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:49.058572 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4357648-bad2-4e2e-a4f4-503ce7b7e015 service swift] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:49.061655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4855b05-0c18-49c2-a517-a7b9f89ef2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:49.063497 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4855b05-0c18-49c2-a517-a7b9f89ef2ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:49.065934 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4855b05-0c18-49c2-a517-a7b9f89ef2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:49.066558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4855b05-0c18-49c2-a517-a7b9f89ef2ae admin admin] PATH_INFO: `/v3/users/e2a0eb97b9564c06a109317cc95f4582` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:49.068376 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4855b05-0c18-49c2-a517-a7b9f89ef2ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a0eb97b9564c06a109317cc95f4582)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:49.071001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4855b05-0c18-49c2-a517-a7b9f89ef2ae admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:49.104516 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:49.348382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b4855b05-0c18-49c2-a517-a7b9f89ef2ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a0eb97b9564c06a109317cc95f4582'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:49.355979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b4855b05-0c18-49c2-a517-a7b9f89ef2ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a0eb97b9564c06a109317cc95f4582'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:49.447763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b4855b05-0c18-49c2-a517-a7b9f89ef2ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a0eb97b9564c06a109317cc95f4582'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:49.448574 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b4855b05-0c18-49c2-a517-a7b9f89ef2ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a0eb97b9564c06a109317cc95f4582'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:49.449389 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b4855b05-0c18-49c2-a517-a7b9f89ef2ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a0eb97b9564c06a109317cc95f4582'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:49.470877 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1195/2364] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:03:48 2022] DELETE /identity/v3/users/e2a0eb97b9564c06a109317cc95f4582 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:03:49.479065 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f87306-603a-4041-b189-82a4218b859c None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:49.479599 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f87306-603a-4041-b189-82a4218b859c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:49.479697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f87306-603a-4041-b189-82a4218b859c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:49.500436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-33f87306-603a-4041-b189-82a4218b859c None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:49.502753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-33f87306-603a-4041-b189-82a4218b859c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:49.575307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1170/2365] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:49.591263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4855b05-0c18-49c2-a517-a7b9f89ef2ae admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:49.593584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b4855b05-0c18-49c2-a517-a7b9f89ef2ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:49.681073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4855b05-0c18-49c2-a517-a7b9f89ef2ae admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:49.685324 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784620f6-7f18-43fb-8ffb-1410bc96a8eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:49.686041 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784620f6-7f18-43fb-8ffb-1410bc96a8eb service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:49.689655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784620f6-7f18-43fb-8ffb-1410bc96a8eb service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:49.689655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784620f6-7f18-43fb-8ffb-1410bc96a8eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:49.703321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784620f6-7f18-43fb-8ffb-1410bc96a8eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:49.705095 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784620f6-7f18-43fb-8ffb-1410bc96a8eb service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:49.716468 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1196/2366] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:50.518901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f87306-603a-4041-b189-82a4218b859c None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:50.520399 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-33f87306-603a-4041-b189-82a4218b859c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:50.544303 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f87306-603a-4041-b189-82a4218b859c None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:50.560497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1c574-c1b8-4554-ab7e-88410b2e1494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:50.567675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1c574-c1b8-4554-ab7e-88410b2e1494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:50.567675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1c574-c1b8-4554-ab7e-88410b2e1494 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:50.567675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1c574-c1b8-4554-ab7e-88410b2e1494 admin admin] PATH_INFO: `/v3/projects/5d76e1978ee742bf841408def4258237` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:50.567675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1c574-c1b8-4554-ab7e-88410b2e1494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d76e1978ee742bf841408def4258237)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:50.567675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1c574-c1b8-4554-ab7e-88410b2e1494 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:50.729419 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:50.742517 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-def1c574-c1b8-4554-ab7e-88410b2e1494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d76e1978ee742bf841408def4258237', 'request_id': 'req-def1c574-c1b8-4554-ab7e-88410b2e1494'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:50.812135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-def1c574-c1b8-4554-ab7e-88410b2e1494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d76e1978ee742bf841408def4258237', 'request_id': 'req-def1c574-c1b8-4554-ab7e-88410b2e1494'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:50.819906 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-def1c574-c1b8-4554-ab7e-88410b2e1494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d76e1978ee742bf841408def4258237', 'request_id': 'req-def1c574-c1b8-4554-ab7e-88410b2e1494'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:50.834426 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-def1c574-c1b8-4554-ab7e-88410b2e1494 admin admin] The token cache is being invalidate because project 5d76e1978ee742bf841408def4258237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:03:50.834782 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-def1c574-c1b8-4554-ab7e-88410b2e1494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:50.835466 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-def1c574-c1b8-4554-ab7e-88410b2e1494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:50.837106 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1171/2367] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:03:50 2022] DELETE /identity/v3/projects/5d76e1978ee742bf841408def4258237 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:03:50.841644 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784620f6-7f18-43fb-8ffb-1410bc96a8eb service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:50.854524 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784620f6-7f18-43fb-8ffb-1410bc96a8eb service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:50.931058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6da3cf-37b3-4ea8-948c-635cfdd2103a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:50.931058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6da3cf-37b3-4ea8-948c-635cfdd2103a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:50.931058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6da3cf-37b3-4ea8-948c-635cfdd2103a admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:50.931058 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6da3cf-37b3-4ea8-948c-635cfdd2103a admin admin] PATH_INFO: `/v3/users/e1cf29ed9d09486ebb64a04ca2913569` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:50.931660 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6da3cf-37b3-4ea8-948c-635cfdd2103a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1cf29ed9d09486ebb64a04ca2913569)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:50.931846 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6da3cf-37b3-4ea8-948c-635cfdd2103a admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:51.097782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:51.100986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ff6da3cf-37b3-4ea8-948c-635cfdd2103a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1cf29ed9d09486ebb64a04ca2913569'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:51.108541 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ff6da3cf-37b3-4ea8-948c-635cfdd2103a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1cf29ed9d09486ebb64a04ca2913569'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:51.208350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ff6da3cf-37b3-4ea8-948c-635cfdd2103a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1cf29ed9d09486ebb64a04ca2913569'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:51.209033 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ff6da3cf-37b3-4ea8-948c-635cfdd2103a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1cf29ed9d09486ebb64a04ca2913569'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:51.209695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ff6da3cf-37b3-4ea8-948c-635cfdd2103a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1cf29ed9d09486ebb64a04ca2913569'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:51.238575 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1197/2368] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:03:50 2022] DELETE /identity/v3/users/e1cf29ed9d09486ebb64a04ca2913569 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:03:51.822989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1c574-c1b8-4554-ab7e-88410b2e1494 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:51.824453 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-def1c574-c1b8-4554-ab7e-88410b2e1494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:51.860620 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1c574-c1b8-4554-ab7e-88410b2e1494 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:51.962847 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55195e9e-5aa4-4c51-924b-6072e74f5393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:51.964063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55195e9e-5aa4-4c51-924b-6072e74f5393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:51.964450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55195e9e-5aa4-4c51-924b-6072e74f5393 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:51.964926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55195e9e-5aa4-4c51-924b-6072e74f5393 admin admin] PATH_INFO: `/v3/projects/fc92785dfe3648578c5b0cea1363a8ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:51.966457 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55195e9e-5aa4-4c51-924b-6072e74f5393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc92785dfe3648578c5b0cea1363a8ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:51.968666 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55195e9e-5aa4-4c51-924b-6072e74f5393 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:52.072705 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-55195e9e-5aa4-4c51-924b-6072e74f5393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc92785dfe3648578c5b0cea1363a8ff', 'request_id': 'req-55195e9e-5aa4-4c51-924b-6072e74f5393'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:52.191005 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-55195e9e-5aa4-4c51-924b-6072e74f5393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc92785dfe3648578c5b0cea1363a8ff', 'request_id': 'req-55195e9e-5aa4-4c51-924b-6072e74f5393'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:52.201873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-55195e9e-5aa4-4c51-924b-6072e74f5393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc92785dfe3648578c5b0cea1363a8ff', 'request_id': 'req-55195e9e-5aa4-4c51-924b-6072e74f5393'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:52.217796 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-55195e9e-5aa4-4c51-924b-6072e74f5393 admin admin] The token cache is being invalidate because project fc92785dfe3648578c5b0cea1363a8ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:03:52.218381 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-55195e9e-5aa4-4c51-924b-6072e74f5393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:52.219052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-55195e9e-5aa4-4c51-924b-6072e74f5393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:52.221474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1172/2369] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:03:51 2022] DELETE /identity/v3/projects/fc92785dfe3648578c5b0cea1363a8ff => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:03:52.226713 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f4124-d631-474c-b7c9-3af884927c50 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:52.227232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f4124-d631-474c-b7c9-3af884927c50 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:52.232827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f4124-d631-474c-b7c9-3af884927c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:52.268556 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-186f4124-d631-474c-b7c9-3af884927c50 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:52.269862 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-186f4124-d631-474c-b7c9-3af884927c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:52.345002 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1198/2370] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:52.354887 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ea8a2-ef44-4220-984a-cbd1d0d95c37 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:52.355173 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ea8a2-ef44-4220-984a-cbd1d0d95c37 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:52.355452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ea8a2-ef44-4220-984a-cbd1d0d95c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:52.382009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-859ea8a2-ef44-4220-984a-cbd1d0d95c37 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:52.383426 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-859ea8a2-ef44-4220-984a-cbd1d0d95c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:52.394281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1173/2371] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:52.398821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f4124-d631-474c-b7c9-3af884927c50 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:52.410886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f4124-d631-474c-b7c9-3af884927c50 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:52.416016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d72abd-a87d-4365-9b09-d92e000f6be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:52.416839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d72abd-a87d-4365-9b09-d92e000f6be1 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:52.417444 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d72abd-a87d-4365-9b09-d92e000f6be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:52.417793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d72abd-a87d-4365-9b09-d92e000f6be1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:52.418600 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d72abd-a87d-4365-9b09-d92e000f6be1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:03:52.418977 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d72abd-a87d-4365-9b09-d92e000f6be1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:52.420666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d72abd-a87d-4365-9b09-d92e000f6be1 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:52.434629 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1199/2372] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:03:52.439762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ea8a2-ef44-4220-984a-cbd1d0d95c37 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:52.450719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ea8a2-ef44-4220-984a-cbd1d0d95c37 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:52.455838 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26e7fc-37c4-4565-bab2-1a7952682f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:52.456581 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26e7fc-37c4-4565-bab2-1a7952682f46 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:52.456894 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26e7fc-37c4-4565-bab2-1a7952682f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:52.457169 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26e7fc-37c4-4565-bab2-1a7952682f46 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:52.460487 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26e7fc-37c4-4565-bab2-1a7952682f46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:52.462511 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26e7fc-37c4-4565-bab2-1a7952682f46 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:52.553169 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1174/2373] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:03:52 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:03:52.557470 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d72abd-a87d-4365-9b09-d92e000f6be1 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:52.568004 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d72abd-a87d-4365-9b09-d92e000f6be1 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:52.646336 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44edbf-4606-41dd-bbb7-e2f6e6a2075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:52.649229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44edbf-4606-41dd-bbb7-e2f6e6a2075c admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:52.649517 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44edbf-4606-41dd-bbb7-e2f6e6a2075c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:52.649802 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44edbf-4606-41dd-bbb7-e2f6e6a2075c admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:52.650535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44edbf-4606-41dd-bbb7-e2f6e6a2075c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:52.652487 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44edbf-4606-41dd-bbb7-e2f6e6a2075c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:52.717158 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1200/2374] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:03:52 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:03:52.722409 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26e7fc-37c4-4565-bab2-1a7952682f46 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:52.734396 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26e7fc-37c4-4565-bab2-1a7952682f46 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:52.739586 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29682c4-8943-4830-80b2-465c3af10211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:52.740332 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29682c4-8943-4830-80b2-465c3af10211 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:52.740719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29682c4-8943-4830-80b2-465c3af10211 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:52.741064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29682c4-8943-4830-80b2-465c3af10211 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:52.741899 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29682c4-8943-4830-80b2-465c3af10211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:52.743643 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29682c4-8943-4830-80b2-465c3af10211 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:52.755243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1175/2375] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:03:52.759054 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44edbf-4606-41dd-bbb7-e2f6e6a2075c admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:52.771534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44edbf-4606-41dd-bbb7-e2f6e6a2075c admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:52.776523 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e40fd-893e-452f-a0f1-13f69a2c7a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:52.777897 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e40fd-893e-452f-a0f1-13f69a2c7a2d admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:52.778183 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e40fd-893e-452f-a0f1-13f69a2c7a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:52.778474 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e40fd-893e-452f-a0f1-13f69a2c7a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:52.779209 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e40fd-893e-452f-a0f1-13f69a2c7a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:52.780890 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e40fd-893e-452f-a0f1-13f69a2c7a2d admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:52.793853 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1201/2376] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:03:52.804353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29682c4-8943-4830-80b2-465c3af10211 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:52.826585 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29682c4-8943-4830-80b2-465c3af10211 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:52.848302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf856d6-7281-4d70-b689-0fd2bcdafbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:52.849387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf856d6-7281-4d70-b689-0fd2bcdafbd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:52.849673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf856d6-7281-4d70-b689-0fd2bcdafbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:52.849965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf856d6-7281-4d70-b689-0fd2bcdafbd3 admin admin] PATH_INFO: `/v3/projects/ee3362eb60e54c11b796ded5ff67b9ad/users/a77f0ac19cd74f41a2c6b13349d3f10c/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:52.862236 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:52.875515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf856d6-7281-4d70-b689-0fd2bcdafbd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3362eb60e54c11b796ded5ff67b9ad, user_id=a77f0ac19cd74f41a2c6b13349d3f10c, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:52.883067 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf856d6-7281-4d70-b689-0fd2bcdafbd3 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:52.987034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1176/2377] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:03:52 2022] PUT /identity/v3/projects/ee3362eb60e54c11b796ded5ff67b9ad/users/a77f0ac19cd74f41a2c6b13349d3f10c/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:03:53.005685 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c46ce-1850-4330-97ee-fe8423d7b4aa None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:53.005971 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c46ce-1850-4330-97ee-fe8423d7b4aa None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:53.006331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c46ce-1850-4330-97ee-fe8423d7b4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:53.041266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-016c46ce-1850-4330-97ee-fe8423d7b4aa None None] MFA Rules not processed for user `a77f0ac19cd74f41a2c6b13349d3f10c`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:53.042518 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-016c46ce-1850-4330-97ee-fe8423d7b4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:53.056569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:53.131080 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1202/2378] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:03:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:53.136404 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf856d6-7281-4d70-b689-0fd2bcdafbd3 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:53.208104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf856d6-7281-4d70-b689-0fd2bcdafbd3 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:53.213360 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bfa3f-f2e2-4ca7-a495-4f166d3f4eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:53.214263 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bfa3f-f2e2-4ca7-a495-4f166d3f4eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:53.214638 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bfa3f-f2e2-4ca7-a495-4f166d3f4eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:53.215082 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bfa3f-f2e2-4ca7-a495-4f166d3f4eb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:53.215900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bfa3f-f2e2-4ca7-a495-4f166d3f4eb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:53.218153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bfa3f-f2e2-4ca7-a495-4f166d3f4eb4 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:53.311187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1177/2379] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:03:53 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:03:53.312660 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c46ce-1850-4330-97ee-fe8423d7b4aa None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:53.325638 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c46ce-1850-4330-97ee-fe8423d7b4aa None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:53.399060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05017834-2703-4081-9dd5-7537736c1fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:53.400033 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05017834-2703-4081-9dd5-7537736c1fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:53.400531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05017834-2703-4081-9dd5-7537736c1fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:53.401020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05017834-2703-4081-9dd5-7537736c1fa1 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:53.401730 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05017834-2703-4081-9dd5-7537736c1fa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:53.403707 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05017834-2703-4081-9dd5-7537736c1fa1 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:53.501299 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1203/2380] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:03:53 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:03:53.506458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bfa3f-f2e2-4ca7-a495-4f166d3f4eb4 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:53.520009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bfa3f-f2e2-4ca7-a495-4f166d3f4eb4 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:53.524756 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208d90c-5404-44cf-bd4f-5358fd6a573d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:53.529580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208d90c-5404-44cf-bd4f-5358fd6a573d admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:53.530048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208d90c-5404-44cf-bd4f-5358fd6a573d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:53.530540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208d90c-5404-44cf-bd4f-5358fd6a573d admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:53.531747 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208d90c-5404-44cf-bd4f-5358fd6a573d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:53.542089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208d90c-5404-44cf-bd4f-5358fd6a573d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:53.556783 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1178/2381] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:03:53.561080 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05017834-2703-4081-9dd5-7537736c1fa1 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:53.580705 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05017834-2703-4081-9dd5-7537736c1fa1 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:53.587256 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4223a-bfbe-425a-ace8-c9da571129f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:53.588166 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4223a-bfbe-425a-ace8-c9da571129f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:53.588453 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4223a-bfbe-425a-ace8-c9da571129f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:53.588764 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4223a-bfbe-425a-ace8-c9da571129f3 admin admin] PATH_INFO: `/v3/projects/7a4267cd9c714f1f8c87e672b186fd56/users/d1ededed40e34d708c7a7d06f476f274/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:53.606569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4223a-bfbe-425a-ace8-c9da571129f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a4267cd9c714f1f8c87e672b186fd56, user_id=d1ededed40e34d708c7a7d06f476f274, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:53.613959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4223a-bfbe-425a-ace8-c9da571129f3 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:53.774288 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1204/2382] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:03:53 2022] PUT /identity/v3/projects/7a4267cd9c714f1f8c87e672b186fd56/users/d1ededed40e34d708c7a7d06f476f274/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:03:53.781211 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208d90c-5404-44cf-bd4f-5358fd6a573d admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:53.794283 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208d90c-5404-44cf-bd4f-5358fd6a573d admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:53.870203 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcfead-f53b-43a5-90df-b387d888d659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:53.870905 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcfead-f53b-43a5-90df-b387d888d659 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:53.871187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcfead-f53b-43a5-90df-b387d888d659 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:53.871476 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcfead-f53b-43a5-90df-b387d888d659 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:53.872211 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcfead-f53b-43a5-90df-b387d888d659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:53.873862 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcfead-f53b-43a5-90df-b387d888d659 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:53.890976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1179/2383] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:03:53.896795 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4223a-bfbe-425a-ace8-c9da571129f3 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:53.911694 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4223a-bfbe-425a-ace8-c9da571129f3 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:53.920533 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34050ea1-6318-4139-8dac-000aa9a31619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:53.921819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34050ea1-6318-4139-8dac-000aa9a31619 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:53.922276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34050ea1-6318-4139-8dac-000aa9a31619 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:53.922700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34050ea1-6318-4139-8dac-000aa9a31619 admin admin] PATH_INFO: `/v3/projects/7a4267cd9c714f1f8c87e672b186fd56/users/d1ededed40e34d708c7a7d06f476f274/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:53.926209 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34050ea1-6318-4139-8dac-000aa9a31619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a4267cd9c714f1f8c87e672b186fd56, user_id=d1ededed40e34d708c7a7d06f476f274, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:53.930479 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34050ea1-6318-4139-8dac-000aa9a31619 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:53.946178 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1205/2384] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:03:53 2022] PUT /identity/v3/projects/7a4267cd9c714f1f8c87e672b186fd56/users/d1ededed40e34d708c7a7d06f476f274/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:03:53.959732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8baa41-6f0d-45e1-b9df-b0866f55b936 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:53.960075 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8baa41-6f0d-45e1-b9df-b0866f55b936 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:53.960349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8baa41-6f0d-45e1-b9df-b0866f55b936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:54.002278 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-4a8baa41-6f0d-45e1-b9df-b0866f55b936 None None] MFA Rules not processed for user `d1ededed40e34d708c7a7d06f476f274`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:54.002278 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4a8baa41-6f0d-45e1-b9df-b0866f55b936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:54.079394 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:54.125481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1180/2385] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:03:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:54.138159 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34050ea1-6318-4139-8dac-000aa9a31619 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:54.139986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-34050ea1-6318-4139-8dac-000aa9a31619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:54.259060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34050ea1-6318-4139-8dac-000aa9a31619 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:54.259060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6273b80-17e4-41b1-830d-00a5dac6f0d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:54.259060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6273b80-17e4-41b1-830d-00a5dac6f0d3 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:54.259060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6273b80-17e4-41b1-830d-00a5dac6f0d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:54.259459 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6273b80-17e4-41b1-830d-00a5dac6f0d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:54.265836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6273b80-17e4-41b1-830d-00a5dac6f0d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:54.267393 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6273b80-17e4-41b1-830d-00a5dac6f0d3 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:54.278989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1206/2386] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:54.439739 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8baa41-6f0d-45e1-b9df-b0866f55b936 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:54.450377 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8baa41-6f0d-45e1-b9df-b0866f55b936 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:54.463726 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5070b2e-74c2-4529-8085-23354dd01d9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:54.464379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5070b2e-74c2-4529-8085-23354dd01d9a service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:54.464702 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5070b2e-74c2-4529-8085-23354dd01d9a service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:54.464987 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5070b2e-74c2-4529-8085-23354dd01d9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:54.534214 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5070b2e-74c2-4529-8085-23354dd01d9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:54.535860 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5070b2e-74c2-4529-8085-23354dd01d9a service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:54.546560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1181/2387] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:57.868477 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6273b80-17e4-41b1-830d-00a5dac6f0d3 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:57.881874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:57.949715 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6273b80-17e4-41b1-830d-00a5dac6f0d3 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:57.956768 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a7c40-dbd5-47f1-88e3-bf2d5435ced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:57.957654 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a7c40-dbd5-47f1-88e3-bf2d5435ced3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:57.957947 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a7c40-dbd5-47f1-88e3-bf2d5435ced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:57.958217 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a7c40-dbd5-47f1-88e3-bf2d5435ced3 admin admin] PATH_INFO: `/v3/users/a77f0ac19cd74f41a2c6b13349d3f10c` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:57.959446 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a7c40-dbd5-47f1-88e3-bf2d5435ced3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a77f0ac19cd74f41a2c6b13349d3f10c)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:57.961816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a7c40-dbd5-47f1-88e3-bf2d5435ced3 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:58.189905 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-706a7c40-dbd5-47f1-88e3-bf2d5435ced3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a77f0ac19cd74f41a2c6b13349d3f10c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:58.198700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-706a7c40-dbd5-47f1-88e3-bf2d5435ced3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a77f0ac19cd74f41a2c6b13349d3f10c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:58.320895 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-706a7c40-dbd5-47f1-88e3-bf2d5435ced3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a77f0ac19cd74f41a2c6b13349d3f10c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:58.321564 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-706a7c40-dbd5-47f1-88e3-bf2d5435ced3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a77f0ac19cd74f41a2c6b13349d3f10c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:58.322201 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-706a7c40-dbd5-47f1-88e3-bf2d5435ced3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a77f0ac19cd74f41a2c6b13349d3f10c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:58.341496 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1207/2388] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:03:57 2022] DELETE /identity/v3/users/a77f0ac19cd74f41a2c6b13349d3f10c => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:03:58.346415 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3d79a-6249-4be9-a2e2-61cbeef81e4d None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:58.346942 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3d79a-6249-4be9-a2e2-61cbeef81e4d None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:58.346942 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3d79a-6249-4be9-a2e2-61cbeef81e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:58.365180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-f4c3d79a-6249-4be9-a2e2-61cbeef81e4d None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:58.370914 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f4c3d79a-6249-4be9-a2e2-61cbeef81e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:58.432554 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1182/2389] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:58.443521 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a7c40-dbd5-47f1-88e3-bf2d5435ced3 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:58.444990 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-706a7c40-dbd5-47f1-88e3-bf2d5435ced3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:58.506841 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a7c40-dbd5-47f1-88e3-bf2d5435ced3 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:58.511044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7bd9f-a305-4acf-b21f-910d8826d143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:58.511706 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7bd9f-a305-4acf-b21f-910d8826d143 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:58.511992 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7bd9f-a305-4acf-b21f-910d8826d143 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:58.512270 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7bd9f-a305-4acf-b21f-910d8826d143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:58.523985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7bd9f-a305-4acf-b21f-910d8826d143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:58.525567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7bd9f-a305-4acf-b21f-910d8826d143 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:58.535327 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1208/2390] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:58.975884 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3d79a-6249-4be9-a2e2-61cbeef81e4d None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:58.978444 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f4c3d79a-6249-4be9-a2e2-61cbeef81e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:58.990014 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3d79a-6249-4be9-a2e2-61cbeef81e4d None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:58.994826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11bc4c-86ab-4f56-af15-a7e7a93ddc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:58.995546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11bc4c-86ab-4f56-af15-a7e7a93ddc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:58.995831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11bc4c-86ab-4f56-af15-a7e7a93ddc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:58.996114 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11bc4c-86ab-4f56-af15-a7e7a93ddc7c admin admin] PATH_INFO: `/v3/projects/ee3362eb60e54c11b796ded5ff67b9ad` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:58.997359 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11bc4c-86ab-4f56-af15-a7e7a93ddc7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee3362eb60e54c11b796ded5ff67b9ad)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:58.999432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11bc4c-86ab-4f56-af15-a7e7a93ddc7c admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:59.133930 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7b11bc4c-86ab-4f56-af15-a7e7a93ddc7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee3362eb60e54c11b796ded5ff67b9ad', 'request_id': 'req-7b11bc4c-86ab-4f56-af15-a7e7a93ddc7c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:59.270805 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7b11bc4c-86ab-4f56-af15-a7e7a93ddc7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee3362eb60e54c11b796ded5ff67b9ad', 'request_id': 'req-7b11bc4c-86ab-4f56-af15-a7e7a93ddc7c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:59.278858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7b11bc4c-86ab-4f56-af15-a7e7a93ddc7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee3362eb60e54c11b796ded5ff67b9ad', 'request_id': 'req-7b11bc4c-86ab-4f56-af15-a7e7a93ddc7c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:59.290833 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7b11bc4c-86ab-4f56-af15-a7e7a93ddc7c admin admin] The token cache is being invalidate because project ee3362eb60e54c11b796ded5ff67b9ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:03:59.291121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7b11bc4c-86ab-4f56-af15-a7e7a93ddc7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:59.293353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7b11bc4c-86ab-4f56-af15-a7e7a93ddc7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:59.294358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1183/2391] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:03:58 2022] DELETE /identity/v3/projects/ee3362eb60e54c11b796ded5ff67b9ad => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:03:59.298540 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7bd9f-a305-4acf-b21f-910d8826d143 service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:59.308380 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7bd9f-a305-4acf-b21f-910d8826d143 service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:59.347323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:59.373585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc207136-5a18-462d-b513-12794694f234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:59.374459 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc207136-5a18-462d-b513-12794694f234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:59.374741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc207136-5a18-462d-b513-12794694f234 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:59.375014 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc207136-5a18-462d-b513-12794694f234 admin admin] PATH_INFO: `/v3/users/d1ededed40e34d708c7a7d06f476f274` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:59.376206 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc207136-5a18-462d-b513-12794694f234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ededed40e34d708c7a7d06f476f274)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:59.378754 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc207136-5a18-462d-b513-12794694f234 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:59.614169 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-fc207136-5a18-462d-b513-12794694f234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ededed40e34d708c7a7d06f476f274'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:59.621251 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-fc207136-5a18-462d-b513-12794694f234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ededed40e34d708c7a7d06f476f274'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:59.698731 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-fc207136-5a18-462d-b513-12794694f234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ededed40e34d708c7a7d06f476f274'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:59.699378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-fc207136-5a18-462d-b513-12794694f234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ededed40e34d708c7a7d06f476f274'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:59.699997 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-fc207136-5a18-462d-b513-12794694f234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ededed40e34d708c7a7d06f476f274'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:59.718769 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1209/2392] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:03:59 2022] DELETE /identity/v3/users/d1ededed40e34d708c7a7d06f476f274 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:00.184493 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11bc4c-86ab-4f56-af15-a7e7a93ddc7c admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:00.186171 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-7b11bc4c-86ab-4f56-af15-a7e7a93ddc7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:00.189297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc207136-5a18-462d-b513-12794694f234 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:00.191631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-fc207136-5a18-462d-b513-12794694f234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:00.198721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:00.301706 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc207136-5a18-462d-b513-12794694f234 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:00.304690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11bc4c-86ab-4f56-af15-a7e7a93ddc7c admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:00.308601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28cdaa-dd4d-4d7a-a0be-be0ea582f9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:00.318142 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28cdaa-dd4d-4d7a-a0be-be0ea582f9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:00.322086 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28cdaa-dd4d-4d7a-a0be-be0ea582f9da admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:00.322460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28cdaa-dd4d-4d7a-a0be-be0ea582f9da admin admin] PATH_INFO: `/v3/projects/7a4267cd9c714f1f8c87e672b186fd56` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:00.330190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28cdaa-dd4d-4d7a-a0be-be0ea582f9da admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a4267cd9c714f1f8c87e672b186fd56)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:00.332490 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28cdaa-dd4d-4d7a-a0be-be0ea582f9da admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:00.384170 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e9207-8dc7-4c13-9e6c-8cf7a5fcdf7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:00.384890 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e9207-8dc7-4c13-9e6c-8cf7a5fcdf7a service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:00.385179 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e9207-8dc7-4c13-9e6c-8cf7a5fcdf7a service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:00.385465 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e9207-8dc7-4c13-9e6c-8cf7a5fcdf7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:00.387421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ae4e9207-8dc7-4c13-9e6c-8cf7a5fcdf7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:00.401104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e9207-8dc7-4c13-9e6c-8cf7a5fcdf7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:00.411023 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e9207-8dc7-4c13-9e6c-8cf7a5fcdf7a service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:00.415086 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1184/2393] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:00.501084 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-3c28cdaa-dd4d-4d7a-a0be-be0ea582f9da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a4267cd9c714f1f8c87e672b186fd56', 'request_id': 'req-3c28cdaa-dd4d-4d7a-a0be-be0ea582f9da'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:00.505994 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:00.509802 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-3c28cdaa-dd4d-4d7a-a0be-be0ea582f9da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a4267cd9c714f1f8c87e672b186fd56', 'request_id': 'req-3c28cdaa-dd4d-4d7a-a0be-be0ea582f9da'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:00.601067 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-3c28cdaa-dd4d-4d7a-a0be-be0ea582f9da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a4267cd9c714f1f8c87e672b186fd56', 'request_id': 'req-3c28cdaa-dd4d-4d7a-a0be-be0ea582f9da'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:00.615657 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-3c28cdaa-dd4d-4d7a-a0be-be0ea582f9da admin admin] The token cache is being invalidate because project 7a4267cd9c714f1f8c87e672b186fd56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:04:00.615949 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-3c28cdaa-dd4d-4d7a-a0be-be0ea582f9da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:00.617256 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-3c28cdaa-dd4d-4d7a-a0be-be0ea582f9da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:00.618600 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1210/2394] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:04:00 2022] DELETE /identity/v3/projects/7a4267cd9c714f1f8c87e672b186fd56 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:04:00.623449 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754e733-8139-4cc4-b4d5-5444f7c5e3c3 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:00.623715 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754e733-8139-4cc4-b4d5-5444f7c5e3c3 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:00.624022 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754e733-8139-4cc4-b4d5-5444f7c5e3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:00.642200 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-e754e733-8139-4cc4-b4d5-5444f7c5e3c3 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:00.643505 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e754e733-8139-4cc4-b4d5-5444f7c5e3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:00.710154 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1185/2395] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:00.717931 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b319e2-c66d-4703-9186-b68fa23aa836 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:00.724064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b319e2-c66d-4703-9186-b68fa23aa836 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:00.724064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b319e2-c66d-4703-9186-b68fa23aa836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:00.739089 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-e9b319e2-c66d-4703-9186-b68fa23aa836 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:00.740309 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e9b319e2-c66d-4703-9186-b68fa23aa836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:00.750861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1211/2396] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:00.757163 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754e733-8139-4cc4-b4d5-5444f7c5e3c3 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:00.767538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754e733-8139-4cc4-b4d5-5444f7c5e3c3 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:00.773164 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7477bfa-e680-42e8-9811-245bf1faed7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:00.774107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7477bfa-e680-42e8-9811-245bf1faed7f admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:00.774379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7477bfa-e680-42e8-9811-245bf1faed7f admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:00.774662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7477bfa-e680-42e8-9811-245bf1faed7f admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:00.775406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7477bfa-e680-42e8-9811-245bf1faed7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:04:00.775738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7477bfa-e680-42e8-9811-245bf1faed7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:00.777499 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7477bfa-e680-42e8-9811-245bf1faed7f admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:00.795534 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1186/2397] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:04:00.797129 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b319e2-c66d-4703-9186-b68fa23aa836 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:00.808851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b319e2-c66d-4703-9186-b68fa23aa836 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:00.820505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e559a8-3932-4b2e-bf9f-430b2aab9a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:00.822043 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e559a8-3932-4b2e-bf9f-430b2aab9a99 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:00.822395 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e559a8-3932-4b2e-bf9f-430b2aab9a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:00.822703 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e559a8-3932-4b2e-bf9f-430b2aab9a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:00.823463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e559a8-3932-4b2e-bf9f-430b2aab9a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:00.826032 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e559a8-3932-4b2e-bf9f-430b2aab9a99 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:00.970671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1212/2398] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:00 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:00.975903 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7477bfa-e680-42e8-9811-245bf1faed7f admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:00.986587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7477bfa-e680-42e8-9811-245bf1faed7f admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:00.998530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:01.047333 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f52d60-cdd2-4f43-b822-86836d638844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:01.048020 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f52d60-cdd2-4f43-b822-86836d638844 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:01.048312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f52d60-cdd2-4f43-b822-86836d638844 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:01.048597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f52d60-cdd2-4f43-b822-86836d638844 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:01.049422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f52d60-cdd2-4f43-b822-86836d638844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:01.051356 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f52d60-cdd2-4f43-b822-86836d638844 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:01.134820 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1187/2399] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:00 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:01.139573 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e559a8-3932-4b2e-bf9f-430b2aab9a99 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:01.158874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e559a8-3932-4b2e-bf9f-430b2aab9a99 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:01.163685 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d20d52-f4c5-4f14-824c-42d140fe2c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:01.164351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d20d52-f4c5-4f14-824c-42d140fe2c8b admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:01.164664 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d20d52-f4c5-4f14-824c-42d140fe2c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:01.164938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d20d52-f4c5-4f14-824c-42d140fe2c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:01.165667 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d20d52-f4c5-4f14-824c-42d140fe2c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:01.167260 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d20d52-f4c5-4f14-824c-42d140fe2c8b admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:01.177908 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1213/2400] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:01.182652 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f52d60-cdd2-4f43-b822-86836d638844 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:01.193626 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f52d60-cdd2-4f43-b822-86836d638844 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:01.198245 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0724d11-aa0b-4e1d-b8ca-4a288eda18f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:01.198908 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0724d11-aa0b-4e1d-b8ca-4a288eda18f1 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:01.199190 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0724d11-aa0b-4e1d-b8ca-4a288eda18f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:01.199464 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0724d11-aa0b-4e1d-b8ca-4a288eda18f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:01.200194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0724d11-aa0b-4e1d-b8ca-4a288eda18f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:01.201819 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0724d11-aa0b-4e1d-b8ca-4a288eda18f1 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:01.212724 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1188/2401] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:01.217053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d20d52-f4c5-4f14-824c-42d140fe2c8b admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:01.227549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d20d52-f4c5-4f14-824c-42d140fe2c8b admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:01.232385 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebcbf0-9857-483c-89ab-55f5d529abc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:01.233304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebcbf0-9857-483c-89ab-55f5d529abc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:01.233588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebcbf0-9857-483c-89ab-55f5d529abc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:01.233866 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebcbf0-9857-483c-89ab-55f5d529abc8 admin admin] PATH_INFO: `/v3/projects/0fb1594b2c8548d8b8436974a7de92f8/users/a1c38530b01a43f7ba12d1e3b1823750/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:01.249815 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebcbf0-9857-483c-89ab-55f5d529abc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb1594b2c8548d8b8436974a7de92f8, user_id=a1c38530b01a43f7ba12d1e3b1823750, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:01.253456 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebcbf0-9857-483c-89ab-55f5d529abc8 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:01.313172 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1214/2402] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:01 2022] PUT /identity/v3/projects/0fb1594b2c8548d8b8436974a7de92f8/users/a1c38530b01a43f7ba12d1e3b1823750/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:01.325258 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa6af7-83b9-433e-b475-e17d2d127181 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:01.325653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa6af7-83b9-433e-b475-e17d2d127181 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:01.326035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa6af7-83b9-433e-b475-e17d2d127181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:01.357368 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-c4aa6af7-83b9-433e-b475-e17d2d127181 None None] MFA Rules not processed for user `a1c38530b01a43f7ba12d1e3b1823750`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:01.358588 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c4aa6af7-83b9-433e-b475-e17d2d127181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:01.430386 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1189/2403] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:01.434974 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebcbf0-9857-483c-89ab-55f5d529abc8 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:01.503923 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebcbf0-9857-483c-89ab-55f5d529abc8 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:01.508714 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069de4b-d889-4269-8996-fe65f8c74a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:01.509377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069de4b-d889-4269-8996-fe65f8c74a23 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:01.509656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069de4b-d889-4269-8996-fe65f8c74a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:01.509928 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069de4b-d889-4269-8996-fe65f8c74a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:01.510618 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069de4b-d889-4269-8996-fe65f8c74a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:01.512515 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069de4b-d889-4269-8996-fe65f8c74a23 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:01.592159 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1215/2404] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:01 2022] POST /identity/v3/projects => generated 389 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:04:01.597166 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa6af7-83b9-433e-b475-e17d2d127181 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:01.608440 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa6af7-83b9-433e-b475-e17d2d127181 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:01.666533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430def1-aa73-4c00-ae3a-37ed3b82433b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:01.667254 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430def1-aa73-4c00-ae3a-37ed3b82433b admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:01.667541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430def1-aa73-4c00-ae3a-37ed3b82433b admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:01.667959 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430def1-aa73-4c00-ae3a-37ed3b82433b admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:01.668743 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430def1-aa73-4c00-ae3a-37ed3b82433b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:01.670667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430def1-aa73-4c00-ae3a-37ed3b82433b admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:01.762831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1190/2405] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:01 2022] POST /identity/v3/users => generated 301 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:01.767512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069de4b-d889-4269-8996-fe65f8c74a23 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:01.780690 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069de4b-d889-4269-8996-fe65f8c74a23 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:01.786661 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d08fc1-3c4f-4945-995e-5f1ad69512d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:01.790038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d08fc1-3c4f-4945-995e-5f1ad69512d8 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:01.790038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d08fc1-3c4f-4945-995e-5f1ad69512d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:01.790038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d08fc1-3c4f-4945-995e-5f1ad69512d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:01.790038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d08fc1-3c4f-4945-995e-5f1ad69512d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:01.790404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d08fc1-3c4f-4945-995e-5f1ad69512d8 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:01.803872 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1216/2406] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:04:01.810502 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430def1-aa73-4c00-ae3a-37ed3b82433b admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:01.821233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430def1-aa73-4c00-ae3a-37ed3b82433b admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:01.826196 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533d54d-f7a0-4c8b-9591-bc1b75bf26b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:01.830973 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533d54d-f7a0-4c8b-9591-bc1b75bf26b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:01.830973 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533d54d-f7a0-4c8b-9591-bc1b75bf26b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:01.830973 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533d54d-f7a0-4c8b-9591-bc1b75bf26b6 admin admin] PATH_INFO: `/v3/projects/e8cb290e744a48b2886d6343740d63c4/users/66b088f95e8f4fcdb15c011830dd721c/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:01.840465 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:01.844531 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533d54d-f7a0-4c8b-9591-bc1b75bf26b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8cb290e744a48b2886d6343740d63c4, user_id=66b088f95e8f4fcdb15c011830dd721c, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:01.847947 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533d54d-f7a0-4c8b-9591-bc1b75bf26b6 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:02.002959 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1191/2407] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:01 2022] PUT /identity/v3/projects/e8cb290e744a48b2886d6343740d63c4/users/66b088f95e8f4fcdb15c011830dd721c/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:02.006926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d08fc1-3c4f-4945-995e-5f1ad69512d8 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:02.017154 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d08fc1-3c4f-4945-995e-5f1ad69512d8 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:02.068507 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:02.077489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45ea3c-29d5-4687-a623-af2a7300f7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:02.078176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45ea3c-29d5-4687-a623-af2a7300f7df admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:02.083286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45ea3c-29d5-4687-a623-af2a7300f7df admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:02.083286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45ea3c-29d5-4687-a623-af2a7300f7df admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:02.083286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45ea3c-29d5-4687-a623-af2a7300f7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:02.083286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45ea3c-29d5-4687-a623-af2a7300f7df admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:02.092844 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1217/2408] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:02.097277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533d54d-f7a0-4c8b-9591-bc1b75bf26b6 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:02.108490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533d54d-f7a0-4c8b-9591-bc1b75bf26b6 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:02.115515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c58b82-94df-49c3-ab76-586000fbe58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:02.115515 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c58b82-94df-49c3-ab76-586000fbe58c admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:02.115726 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c58b82-94df-49c3-ab76-586000fbe58c admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:02.116118 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c58b82-94df-49c3-ab76-586000fbe58c admin admin] PATH_INFO: `/v3/projects/e8cb290e744a48b2886d6343740d63c4/users/66b088f95e8f4fcdb15c011830dd721c/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:02.118336 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c58b82-94df-49c3-ab76-586000fbe58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8cb290e744a48b2886d6343740d63c4, user_id=66b088f95e8f4fcdb15c011830dd721c, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:02.120554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb547918-ae63-478d-8f48-5ce0c989c36d None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:02.120894 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb547918-ae63-478d-8f48-5ce0c989c36d None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:02.121200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb547918-ae63-478d-8f48-5ce0c989c36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:02.121757 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c58b82-94df-49c3-ab76-586000fbe58c admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:02.134639 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1192/2409] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:02 2022] PUT /identity/v3/projects/e8cb290e744a48b2886d6343740d63c4/users/66b088f95e8f4fcdb15c011830dd721c/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:02.140744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-cb547918-ae63-478d-8f48-5ce0c989c36d None None] MFA Rules not processed for user `1b03d940626a449dbe904f02f3d70854`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:02.143885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-cb547918-ae63-478d-8f48-5ce0c989c36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:02.145870 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc223f-eb68-4007-938f-54f2d3bfa129 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:02.146279 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc223f-eb68-4007-938f-54f2d3bfa129 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:02.146623 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc223f-eb68-4007-938f-54f2d3bfa129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:02.174019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-7dcc223f-eb68-4007-938f-54f2d3bfa129 None None] MFA Rules not processed for user `66b088f95e8f4fcdb15c011830dd721c`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:02.184029 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-7dcc223f-eb68-4007-938f-54f2d3bfa129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:02.203357 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1218/2410] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jun 23 11:04:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:02.217293 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb547918-ae63-478d-8f48-5ce0c989c36d None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:02.218743 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-cb547918-ae63-478d-8f48-5ce0c989c36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:02.255438 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1193/2411] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:04:02.266361 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc223f-eb68-4007-938f-54f2d3bfa129 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:02.267748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-7dcc223f-eb68-4007-938f-54f2d3bfa129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:02.294960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb547918-ae63-478d-8f48-5ce0c989c36d None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:02.300249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dc5df-009d-42df-9789-d9f1b1fc096b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a54fa1c326f41e88688404a56b75c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:02.300945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dc5df-009d-42df-9789-d9f1b1fc096b service swift] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:02.301231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dc5df-009d-42df-9789-d9f1b1fc096b service swift] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:02.301510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dc5df-009d-42df-9789-d9f1b1fc096b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:02.309943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797dc5df-009d-42df-9789-d9f1b1fc096b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:02.311590 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797dc5df-009d-42df-9789-d9f1b1fc096b service swift] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:02.320619 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1219/2412] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 23 11:04:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 11:04:02.328721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc223f-eb68-4007-938f-54f2d3bfa129 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:02.333352 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60acd52-6cec-42f9-a81a-3a40ba53a82c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:02.334034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60acd52-6cec-42f9-a81a-3a40ba53a82c service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:02.334344 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60acd52-6cec-42f9-a81a-3a40ba53a82c service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:02.334625 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60acd52-6cec-42f9-a81a-3a40ba53a82c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:02.344512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60acd52-6cec-42f9-a81a-3a40ba53a82c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:02.346021 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60acd52-6cec-42f9-a81a-3a40ba53a82c service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:02.357005 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1194/2413] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:02 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:04:02.514700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dc5df-009d-42df-9789-d9f1b1fc096b service swift] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:02.583133 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dc5df-009d-42df-9789-d9f1b1fc096b service swift] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:02.587812 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc54ca8-c09b-45d6-9f3d-aa8fee3ce8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:02.588725 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc54ca8-c09b-45d6-9f3d-aa8fee3ce8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:02.589013 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc54ca8-c09b-45d6-9f3d-aa8fee3ce8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:02.589294 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc54ca8-c09b-45d6-9f3d-aa8fee3ce8ce admin admin] PATH_INFO: `/v3/users/a1c38530b01a43f7ba12d1e3b1823750` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:02.590641 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc54ca8-c09b-45d6-9f3d-aa8fee3ce8ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c38530b01a43f7ba12d1e3b1823750)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:02.592652 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc54ca8-c09b-45d6-9f3d-aa8fee3ce8ce admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:02.706613 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:02.871957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-bfc54ca8-c09b-45d6-9f3d-aa8fee3ce8ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c38530b01a43f7ba12d1e3b1823750'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:02.887603 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-bfc54ca8-c09b-45d6-9f3d-aa8fee3ce8ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c38530b01a43f7ba12d1e3b1823750'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:02.946304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-bfc54ca8-c09b-45d6-9f3d-aa8fee3ce8ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c38530b01a43f7ba12d1e3b1823750'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:02.948819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-bfc54ca8-c09b-45d6-9f3d-aa8fee3ce8ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c38530b01a43f7ba12d1e3b1823750'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:02.950549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-bfc54ca8-c09b-45d6-9f3d-aa8fee3ce8ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c38530b01a43f7ba12d1e3b1823750'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:02.974493 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1220/2414] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:04:02 2022] DELETE /identity/v3/users/a1c38530b01a43f7ba12d1e3b1823750 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:02.979935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f13174-87b5-4619-bea7-377e18c55cf9 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:02.980227 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f13174-87b5-4619-bea7-377e18c55cf9 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:02.980523 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f13174-87b5-4619-bea7-377e18c55cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:02.999329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-c8f13174-87b5-4619-bea7-377e18c55cf9 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:03.000607 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c8f13174-87b5-4619-bea7-377e18c55cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:03.077395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1195/2415] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:03.087673 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc54ca8-c09b-45d6-9f3d-aa8fee3ce8ce admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:03.089138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-bfc54ca8-c09b-45d6-9f3d-aa8fee3ce8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:03.158134 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc54ca8-c09b-45d6-9f3d-aa8fee3ce8ce admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:03.161912 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f151e01-8d91-44cf-b0d2-dbb57f929793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:03.162585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f151e01-8d91-44cf-b0d2-dbb57f929793 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:03.162868 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f151e01-8d91-44cf-b0d2-dbb57f929793 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:03.163144 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f151e01-8d91-44cf-b0d2-dbb57f929793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:03.173665 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f151e01-8d91-44cf-b0d2-dbb57f929793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:03.175682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f151e01-8d91-44cf-b0d2-dbb57f929793 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:03.200386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1221/2416] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:03.762863 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f13174-87b5-4619-bea7-377e18c55cf9 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:03.764352 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c8f13174-87b5-4619-bea7-377e18c55cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:03.773540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:03.778046 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f13174-87b5-4619-bea7-377e18c55cf9 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:03.782912 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e15177-a85a-46dd-a8ae-fc84a76609e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:03.784623 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e15177-a85a-46dd-a8ae-fc84a76609e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:03.784937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e15177-a85a-46dd-a8ae-fc84a76609e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:03.785210 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e15177-a85a-46dd-a8ae-fc84a76609e2 admin admin] PATH_INFO: `/v3/projects/0fb1594b2c8548d8b8436974a7de92f8` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:03.786554 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e15177-a85a-46dd-a8ae-fc84a76609e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fb1594b2c8548d8b8436974a7de92f8)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:03.788487 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e15177-a85a-46dd-a8ae-fc84a76609e2 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:03.910972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-83e15177-a85a-46dd-a8ae-fc84a76609e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fb1594b2c8548d8b8436974a7de92f8', 'request_id': 'req-83e15177-a85a-46dd-a8ae-fc84a76609e2'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:03.977736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-83e15177-a85a-46dd-a8ae-fc84a76609e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fb1594b2c8548d8b8436974a7de92f8', 'request_id': 'req-83e15177-a85a-46dd-a8ae-fc84a76609e2'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:03.984220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-83e15177-a85a-46dd-a8ae-fc84a76609e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fb1594b2c8548d8b8436974a7de92f8', 'request_id': 'req-83e15177-a85a-46dd-a8ae-fc84a76609e2'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:03.995951 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-83e15177-a85a-46dd-a8ae-fc84a76609e2 admin admin] The token cache is being invalidate because project 0fb1594b2c8548d8b8436974a7de92f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:04:03.996243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-83e15177-a85a-46dd-a8ae-fc84a76609e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:03.996955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-83e15177-a85a-46dd-a8ae-fc84a76609e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:03.998591 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1196/2417] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:04:03 2022] DELETE /identity/v3/projects/0fb1594b2c8548d8b8436974a7de92f8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:04.002723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f151e01-8d91-44cf-b0d2-dbb57f929793 service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:04.012738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f151e01-8d91-44cf-b0d2-dbb57f929793 service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:04.070598 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632dfe2-5ebb-40b9-9849-2199929c9cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:04.071476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632dfe2-5ebb-40b9-9849-2199929c9cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:04.071760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632dfe2-5ebb-40b9-9849-2199929c9cef admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:04.072062 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632dfe2-5ebb-40b9-9849-2199929c9cef admin admin] PATH_INFO: `/v3/users/66b088f95e8f4fcdb15c011830dd721c` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:04.073280 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632dfe2-5ebb-40b9-9849-2199929c9cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b088f95e8f4fcdb15c011830dd721c)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:04.075205 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632dfe2-5ebb-40b9-9849-2199929c9cef admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:04.288671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6632dfe2-5ebb-40b9-9849-2199929c9cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b088f95e8f4fcdb15c011830dd721c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:04.289814 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:04.295957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6632dfe2-5ebb-40b9-9849-2199929c9cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b088f95e8f4fcdb15c011830dd721c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:04.389211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6632dfe2-5ebb-40b9-9849-2199929c9cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b088f95e8f4fcdb15c011830dd721c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:04.389850 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6632dfe2-5ebb-40b9-9849-2199929c9cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b088f95e8f4fcdb15c011830dd721c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:04.390458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6632dfe2-5ebb-40b9-9849-2199929c9cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b088f95e8f4fcdb15c011830dd721c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:04.409558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1222/2418] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:04:04 2022] DELETE /identity/v3/users/66b088f95e8f4fcdb15c011830dd721c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:04.804452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e15177-a85a-46dd-a8ae-fc84a76609e2 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:04.806081 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-83e15177-a85a-46dd-a8ae-fc84a76609e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:04.819649 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e15177-a85a-46dd-a8ae-fc84a76609e2 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:04.898641 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e8c0e-b913-491d-921d-a4013cd70062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:04.899568 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e8c0e-b913-491d-921d-a4013cd70062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:04.899874 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e8c0e-b913-491d-921d-a4013cd70062 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:04.900120 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e8c0e-b913-491d-921d-a4013cd70062 admin admin] PATH_INFO: `/v3/projects/e8cb290e744a48b2886d6343740d63c4` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:04.902160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e8c0e-b913-491d-921d-a4013cd70062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8cb290e744a48b2886d6343740d63c4)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:04.904137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e8c0e-b913-491d-921d-a4013cd70062 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:05.014048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f47e8c0e-b913-491d-921d-a4013cd70062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8cb290e744a48b2886d6343740d63c4', 'request_id': 'req-f47e8c0e-b913-491d-921d-a4013cd70062'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:05.156517 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f47e8c0e-b913-491d-921d-a4013cd70062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8cb290e744a48b2886d6343740d63c4', 'request_id': 'req-f47e8c0e-b913-491d-921d-a4013cd70062'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:05.169748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f47e8c0e-b913-491d-921d-a4013cd70062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8cb290e744a48b2886d6343740d63c4', 'request_id': 'req-f47e8c0e-b913-491d-921d-a4013cd70062'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:05.182938 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f47e8c0e-b913-491d-921d-a4013cd70062 admin admin] The token cache is being invalidate because project e8cb290e744a48b2886d6343740d63c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:04:05.183311 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f47e8c0e-b913-491d-921d-a4013cd70062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:05.184045 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f47e8c0e-b913-491d-921d-a4013cd70062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:05.189010 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1197/2419] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:04:04 2022] DELETE /identity/v3/projects/e8cb290e744a48b2886d6343740d63c4 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:05.191065 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd92dd1-d074-4039-af10-b575c289a5ce None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:05.192316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd92dd1-d074-4039-af10-b575c289a5ce None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:05.192826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd92dd1-d074-4039-af10-b575c289a5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:05.215138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-3bd92dd1-d074-4039-af10-b575c289a5ce None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:05.216466 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-3bd92dd1-d074-4039-af10-b575c289a5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:05.281043 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1223/2420] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:05.289733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472b14d-5b5f-4c83-bdfb-8d445745f1f5 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:05.290306 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472b14d-5b5f-4c83-bdfb-8d445745f1f5 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:05.290548 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472b14d-5b5f-4c83-bdfb-8d445745f1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:05.311592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-c472b14d-5b5f-4c83-bdfb-8d445745f1f5 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:05.312977 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c472b14d-5b5f-4c83-bdfb-8d445745f1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:05.321653 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1198/2421] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:05.326928 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd92dd1-d074-4039-af10-b575c289a5ce None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:05.338557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd92dd1-d074-4039-af10-b575c289a5ce None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:05.343535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8981797-5743-4b02-a1b5-deb74f2c4dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:05.344267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8981797-5743-4b02-a1b5-deb74f2c4dfa admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:05.344559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8981797-5743-4b02-a1b5-deb74f2c4dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:05.344924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8981797-5743-4b02-a1b5-deb74f2c4dfa admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:05.345636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8981797-5743-4b02-a1b5-deb74f2c4dfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:04:05.345970 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8981797-5743-4b02-a1b5-deb74f2c4dfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:05.348424 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8981797-5743-4b02-a1b5-deb74f2c4dfa admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:05.365016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1224/2422] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:04:05.366119 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472b14d-5b5f-4c83-bdfb-8d445745f1f5 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:05.376055 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472b14d-5b5f-4c83-bdfb-8d445745f1f5 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:05.381373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446177d-640f-452e-9909-b84dd281f7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:05.385680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446177d-640f-452e-9909-b84dd281f7ae admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:05.385680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446177d-640f-452e-9909-b84dd281f7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:05.385680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446177d-640f-452e-9909-b84dd281f7ae admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:05.385680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446177d-640f-452e-9909-b84dd281f7ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:05.385680 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446177d-640f-452e-9909-b84dd281f7ae admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:05.395629 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:05.504930 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1199/2423] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:05 2022] POST /identity/v3/projects => generated 361 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:04:05.505847 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8981797-5743-4b02-a1b5-deb74f2c4dfa admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:05.516356 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8981797-5743-4b02-a1b5-deb74f2c4dfa admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:05.580698 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ab531-04b6-4fb7-9fc6-65d9701eb71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:05.581382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ab531-04b6-4fb7-9fc6-65d9701eb71a admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:05.581670 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ab531-04b6-4fb7-9fc6-65d9701eb71a admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:05.581949 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ab531-04b6-4fb7-9fc6-65d9701eb71a admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:05.582710 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ab531-04b6-4fb7-9fc6-65d9701eb71a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:05.584723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ab531-04b6-4fb7-9fc6-65d9701eb71a admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:05.669042 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1225/2424] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:05 2022] POST /identity/v3/users => generated 281 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:04:05.670255 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446177d-640f-452e-9909-b84dd281f7ae admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:05.681275 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446177d-640f-452e-9909-b84dd281f7ae admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:05.690735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a11b36-cbbe-4c14-8634-5b309794d408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:05.691465 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a11b36-cbbe-4c14-8634-5b309794d408 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:05.691835 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a11b36-cbbe-4c14-8634-5b309794d408 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:05.692060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a11b36-cbbe-4c14-8634-5b309794d408 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:05.693947 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a11b36-cbbe-4c14-8634-5b309794d408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:05.695557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a11b36-cbbe-4c14-8634-5b309794d408 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:05.706508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1200/2425] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:05.710689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ab531-04b6-4fb7-9fc6-65d9701eb71a admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:05.720798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ab531-04b6-4fb7-9fc6-65d9701eb71a admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:05.726753 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce797c-4827-496c-b1f0-5866410096c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:05.727424 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce797c-4827-496c-b1f0-5866410096c9 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:05.727712 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce797c-4827-496c-b1f0-5866410096c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:05.728029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce797c-4827-496c-b1f0-5866410096c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:05.728785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce797c-4827-496c-b1f0-5866410096c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:05.730407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce797c-4827-496c-b1f0-5866410096c9 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:05.741197 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1226/2426] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:05.745512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a11b36-cbbe-4c14-8634-5b309794d408 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:05.756289 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a11b36-cbbe-4c14-8634-5b309794d408 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:05.761994 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfb8b8-ee19-4e57-825e-5a606d7bd21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:05.768046 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfb8b8-ee19-4e57-825e-5a606d7bd21e admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:05.768046 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfb8b8-ee19-4e57-825e-5a606d7bd21e admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:05.768046 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfb8b8-ee19-4e57-825e-5a606d7bd21e admin admin] PATH_INFO: `/v3/projects/32c6ad64d7e94fe9add60d8fb5a7ac3c/users/597acf6f86fa46f0ba94c274055f70b3/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:05.780393 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfb8b8-ee19-4e57-825e-5a606d7bd21e admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c6ad64d7e94fe9add60d8fb5a7ac3c, user_id=597acf6f86fa46f0ba94c274055f70b3, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:05.784065 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfb8b8-ee19-4e57-825e-5a606d7bd21e admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:05.848225 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1201/2427] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:05 2022] PUT /identity/v3/projects/32c6ad64d7e94fe9add60d8fb5a7ac3c/users/597acf6f86fa46f0ba94c274055f70b3/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:04:05.859659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536210fa-56fd-4a32-a10f-d3be445ec024 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:05.859954 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536210fa-56fd-4a32-a10f-d3be445ec024 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:05.860235 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536210fa-56fd-4a32-a10f-d3be445ec024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:05.930240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-536210fa-56fd-4a32-a10f-d3be445ec024 None None] MFA Rules not processed for user `597acf6f86fa46f0ba94c274055f70b3`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:05.931834 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-536210fa-56fd-4a32-a10f-d3be445ec024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:05.953687 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:06.009755 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1227/2428] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:06.043944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfb8b8-ee19-4e57-825e-5a606d7bd21e admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:06.046576 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8bdfb8b8-ee19-4e57-825e-5a606d7bd21e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:06.104892 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536210fa-56fd-4a32-a10f-d3be445ec024 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:06.117438 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-536210fa-56fd-4a32-a10f-d3be445ec024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:06.132696 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfb8b8-ee19-4e57-825e-5a606d7bd21e admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:06.147879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff322a8-7924-4b11-af7c-f82978487c71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:06.149446 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff322a8-7924-4b11-af7c-f82978487c71 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:06.150151 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff322a8-7924-4b11-af7c-f82978487c71 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:06.150696 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff322a8-7924-4b11-af7c-f82978487c71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:06.163860 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff322a8-7924-4b11-af7c-f82978487c71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:06.166514 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff322a8-7924-4b11-af7c-f82978487c71 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:06.183186 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1202/2429] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:06.199555 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff322a8-7924-4b11-af7c-f82978487c71 service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:06.290475 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536210fa-56fd-4a32-a10f-d3be445ec024 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:06.300929 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e937b-1d65-458a-8313-0dc0ed4c6722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:06.303761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e937b-1d65-458a-8313-0dc0ed4c6722 service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:06.305191 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e937b-1d65-458a-8313-0dc0ed4c6722 service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:06.305640 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e937b-1d65-458a-8313-0dc0ed4c6722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:06.307770 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-5c1e937b-1d65-458a-8313-0dc0ed4c6722 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:06.319823 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff322a8-7924-4b11-af7c-f82978487c71 service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:06.325005 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e937b-1d65-458a-8313-0dc0ed4c6722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:06.326481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe8f35-9562-42c3-8089-c240f4d67e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:06.327567 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe8f35-9562-42c3-8089-c240f4d67e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:06.328027 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe8f35-9562-42c3-8089-c240f4d67e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:06.328286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e937b-1d65-458a-8313-0dc0ed4c6722 service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:06.328426 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe8f35-9562-42c3-8089-c240f4d67e77 admin admin] PATH_INFO: `/v3/users/597acf6f86fa46f0ba94c274055f70b3` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:06.329805 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe8f35-9562-42c3-8089-c240f4d67e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=597acf6f86fa46f0ba94c274055f70b3)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:06.332004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe8f35-9562-42c3-8089-c240f4d67e77 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:06.343273 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1228/2430] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:04:06.535798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-72fe8f35-9562-42c3-8089-c240f4d67e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '597acf6f86fa46f0ba94c274055f70b3'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:06.546838 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-72fe8f35-9562-42c3-8089-c240f4d67e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '597acf6f86fa46f0ba94c274055f70b3'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:06.549957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-72fe8f35-9562-42c3-8089-c240f4d67e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '597acf6f86fa46f0ba94c274055f70b3'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:06.551766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:06.671671 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-72fe8f35-9562-42c3-8089-c240f4d67e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '597acf6f86fa46f0ba94c274055f70b3'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:06.672652 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-72fe8f35-9562-42c3-8089-c240f4d67e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '597acf6f86fa46f0ba94c274055f70b3'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:06.693811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1203/2431] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:04:06 2022] DELETE /identity/v3/users/597acf6f86fa46f0ba94c274055f70b3 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:06.699789 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb817-96df-45e4-96ab-26c4774299b0 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:06.699789 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb817-96df-45e4-96ab-26c4774299b0 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:06.700023 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb817-96df-45e4-96ab-26c4774299b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:06.719561 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-ceebb817-96df-45e4-96ab-26c4774299b0 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:06.720889 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ceebb817-96df-45e4-96ab-26c4774299b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:06.799696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1229/2432] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:06.809879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe8f35-9562-42c3-8089-c240f4d67e77 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:06.811486 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-72fe8f35-9562-42c3-8089-c240f4d67e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:06.871376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe8f35-9562-42c3-8089-c240f4d67e77 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:06.875093 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcf1cd-9793-4fc9-b34b-15ae77cc95f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:06.875950 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcf1cd-9793-4fc9-b34b-15ae77cc95f2 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:06.876335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcf1cd-9793-4fc9-b34b-15ae77cc95f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:06.876619 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcf1cd-9793-4fc9-b34b-15ae77cc95f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:06.886729 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcf1cd-9793-4fc9-b34b-15ae77cc95f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:06.888208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcf1cd-9793-4fc9-b34b-15ae77cc95f2 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:06.899552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1204/2433] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:07.329247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebb817-96df-45e4-96ab-26c4774299b0 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:07.330770 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ceebb817-96df-45e4-96ab-26c4774299b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:07.344775 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebb817-96df-45e4-96ab-26c4774299b0 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:07.360208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2f0e2-66fb-4ca8-b704-da4ef23c12d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:07.361662 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2f0e2-66fb-4ca8-b704-da4ef23c12d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:07.362644 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2f0e2-66fb-4ca8-b704-da4ef23c12d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:07.363289 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2f0e2-66fb-4ca8-b704-da4ef23c12d4 admin admin] PATH_INFO: `/v3/projects/32c6ad64d7e94fe9add60d8fb5a7ac3c` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:07.365640 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2f0e2-66fb-4ca8-b704-da4ef23c12d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c6ad64d7e94fe9add60d8fb5a7ac3c)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:07.367788 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2f0e2-66fb-4ca8-b704-da4ef23c12d4 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:07.485778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:07.491931 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a7a2f0e2-66fb-4ca8-b704-da4ef23c12d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c6ad64d7e94fe9add60d8fb5a7ac3c', 'request_id': 'req-a7a2f0e2-66fb-4ca8-b704-da4ef23c12d4'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:07.497304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a7a2f0e2-66fb-4ca8-b704-da4ef23c12d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c6ad64d7e94fe9add60d8fb5a7ac3c', 'request_id': 'req-a7a2f0e2-66fb-4ca8-b704-da4ef23c12d4'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:07.550901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a7a2f0e2-66fb-4ca8-b704-da4ef23c12d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c6ad64d7e94fe9add60d8fb5a7ac3c', 'request_id': 'req-a7a2f0e2-66fb-4ca8-b704-da4ef23c12d4'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:07.563515 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a7a2f0e2-66fb-4ca8-b704-da4ef23c12d4 admin admin] The token cache is being invalidate because project 32c6ad64d7e94fe9add60d8fb5a7ac3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:04:07.563809 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a7a2f0e2-66fb-4ca8-b704-da4ef23c12d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:07.564499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a7a2f0e2-66fb-4ca8-b704-da4ef23c12d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:07.566649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1230/2434] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:04:07 2022] DELETE /identity/v3/projects/32c6ad64d7e94fe9add60d8fb5a7ac3c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:07.571456 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb5ea9-988d-4e90-80d0-fc1e07bc159d None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:07.571825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb5ea9-988d-4e90-80d0-fc1e07bc159d None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:07.572066 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb5ea9-988d-4e90-80d0-fc1e07bc159d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:07.590585 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-c2eb5ea9-988d-4e90-80d0-fc1e07bc159d None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:07.591815 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c2eb5ea9-988d-4e90-80d0-fc1e07bc159d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:07.653125 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1205/2435] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:07.661670 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60a578-a4aa-444a-8c8e-f4d88f66e8c2 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:07.662024 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60a578-a4aa-444a-8c8e-f4d88f66e8c2 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:07.662351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60a578-a4aa-444a-8c8e-f4d88f66e8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:07.680507 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-9b60a578-a4aa-444a-8c8e-f4d88f66e8c2 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:07.681716 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9b60a578-a4aa-444a-8c8e-f4d88f66e8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:07.689481 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1231/2436] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:07.693960 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb5ea9-988d-4e90-80d0-fc1e07bc159d None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:07.703541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb5ea9-988d-4e90-80d0-fc1e07bc159d None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:07.708865 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b3b67-71f0-4f19-8dec-af5f034fefea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:07.709529 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b3b67-71f0-4f19-8dec-af5f034fefea admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:07.709927 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b3b67-71f0-4f19-8dec-af5f034fefea admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:07.710213 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b3b67-71f0-4f19-8dec-af5f034fefea admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:07.710941 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b3b67-71f0-4f19-8dec-af5f034fefea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:04:07.711250 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b3b67-71f0-4f19-8dec-af5f034fefea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:07.712918 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b3b67-71f0-4f19-8dec-af5f034fefea admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:07.725703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1206/2437] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:04:07.730020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60a578-a4aa-444a-8c8e-f4d88f66e8c2 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:07.739218 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60a578-a4aa-444a-8c8e-f4d88f66e8c2 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:07.743792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a24fa4-d4ee-4aa0-9535-87dd12f4f021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:07.744433 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a24fa4-d4ee-4aa0-9535-87dd12f4f021 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:07.744746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a24fa4-d4ee-4aa0-9535-87dd12f4f021 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:07.745026 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a24fa4-d4ee-4aa0-9535-87dd12f4f021 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:07.745718 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a24fa4-d4ee-4aa0-9535-87dd12f4f021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:07.747602 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a24fa4-d4ee-4aa0-9535-87dd12f4f021 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:07.866279 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1232/2438] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:07 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:07.870596 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b3b67-71f0-4f19-8dec-af5f034fefea admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:07.881268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b3b67-71f0-4f19-8dec-af5f034fefea admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:07.945048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562c382-07dd-4024-a0ff-3db55156325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:07.945729 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562c382-07dd-4024-a0ff-3db55156325d admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:07.946012 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562c382-07dd-4024-a0ff-3db55156325d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:07.946348 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562c382-07dd-4024-a0ff-3db55156325d admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:07.947054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562c382-07dd-4024-a0ff-3db55156325d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:07.949573 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562c382-07dd-4024-a0ff-3db55156325d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:07.961478 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:08.072678 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1207/2439] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:07 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:04:08.076347 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a24fa4-d4ee-4aa0-9535-87dd12f4f021 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:08.100001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a24fa4-d4ee-4aa0-9535-87dd12f4f021 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:08.106409 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd9e10-64d0-410a-960f-3f76b3e438a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:08.107177 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd9e10-64d0-410a-960f-3f76b3e438a9 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:08.107530 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd9e10-64d0-410a-960f-3f76b3e438a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:08.107881 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd9e10-64d0-410a-960f-3f76b3e438a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:08.108749 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd9e10-64d0-410a-960f-3f76b3e438a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:08.110427 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd9e10-64d0-410a-960f-3f76b3e438a9 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:08.137532 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1233/2440] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:08.139618 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562c382-07dd-4024-a0ff-3db55156325d admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:08.152147 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562c382-07dd-4024-a0ff-3db55156325d admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:08.164468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bfc3f-bad2-4590-9fc7-f25fa1577963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:08.164468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bfc3f-bad2-4590-9fc7-f25fa1577963 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:08.164468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bfc3f-bad2-4590-9fc7-f25fa1577963 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:08.164468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bfc3f-bad2-4590-9fc7-f25fa1577963 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:08.165936 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bfc3f-bad2-4590-9fc7-f25fa1577963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:08.167554 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bfc3f-bad2-4590-9fc7-f25fa1577963 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:08.183681 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1208/2441] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:08.185157 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd9e10-64d0-410a-960f-3f76b3e438a9 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:08.196671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd9e10-64d0-410a-960f-3f76b3e438a9 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:08.202789 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44348c7-97f8-423a-8645-4973f09fb58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:08.203689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44348c7-97f8-423a-8645-4973f09fb58e admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:08.203977 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44348c7-97f8-423a-8645-4973f09fb58e admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:08.204257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44348c7-97f8-423a-8645-4973f09fb58e admin admin] PATH_INFO: `/v3/projects/6a761286c8f3489e9ae70badda98cb16/users/f7e63509db9145baa02f889cea3bc7bf/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:08.220620 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44348c7-97f8-423a-8645-4973f09fb58e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a761286c8f3489e9ae70badda98cb16, user_id=f7e63509db9145baa02f889cea3bc7bf, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:08.223557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44348c7-97f8-423a-8645-4973f09fb58e admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:08.359092 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1234/2442] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:08 2022] PUT /identity/v3/projects/6a761286c8f3489e9ae70badda98cb16/users/f7e63509db9145baa02f889cea3bc7bf/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:08.370217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d9658-2224-41c3-a997-75b89e70a60d None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:08.370803 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d9658-2224-41c3-a997-75b89e70a60d None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:08.371083 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d9658-2224-41c3-a997-75b89e70a60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:08.402698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-c33d9658-2224-41c3-a997-75b89e70a60d None None] MFA Rules not processed for user `f7e63509db9145baa02f889cea3bc7bf`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:08.403922 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c33d9658-2224-41c3-a997-75b89e70a60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:08.474388 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1209/2443] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:08.485573 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44348c7-97f8-423a-8645-4973f09fb58e admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:08.488211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b44348c7-97f8-423a-8645-4973f09fb58e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:08.578492 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44348c7-97f8-423a-8645-4973f09fb58e admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:08.583287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff8244-44c7-4973-97c6-0bcce0b353c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:08.583950 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff8244-44c7-4973-97c6-0bcce0b353c6 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:08.584236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff8244-44c7-4973-97c6-0bcce0b353c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:08.584513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff8244-44c7-4973-97c6-0bcce0b353c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:08.598913 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff8244-44c7-4973-97c6-0bcce0b353c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:08.598913 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff8244-44c7-4973-97c6-0bcce0b353c6 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:08.607766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1235/2444] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:10.566302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5acfb-f763-4703-a3b1-37c4a3107897 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:10.566762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5acfb-f763-4703-a3b1-37c4a3107897 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:10.566956 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5acfb-f763-4703-a3b1-37c4a3107897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:10.586507 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-11e5acfb-f763-4703-a3b1-37c4a3107897 None None] MFA Rules not processed for user `f7e63509db9145baa02f889cea3bc7bf`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:10.587868 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-11e5acfb-f763-4703-a3b1-37c4a3107897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:10.595233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1210/2445] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:04:13.464738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff8244-44c7-4973-97c6-0bcce0b353c6 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:13.466264 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-31ff8244-44c7-4973-97c6-0bcce0b353c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:13.529499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff8244-44c7-4973-97c6-0bcce0b353c6 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:13.533491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7da216-b683-44cf-8cc5-cdccf14a0ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:13.535293 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7da216-b683-44cf-8cc5-cdccf14a0ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:13.535607 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7da216-b683-44cf-8cc5-cdccf14a0ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:13.535972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7da216-b683-44cf-8cc5-cdccf14a0ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:13.538025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-3c7da216-b683-44cf-8cc5-cdccf14a0ac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:13.560261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:13.609607 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7da216-b683-44cf-8cc5-cdccf14a0ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:13.611055 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7da216-b683-44cf-8cc5-cdccf14a0ac8 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:13.623994 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1236/2446] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:19.070296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5acfb-f763-4703-a3b1-37c4a3107897 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:19.076422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-11e5acfb-f763-4703-a3b1-37c4a3107897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:19.164956 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5acfb-f763-4703-a3b1-37c4a3107897 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:19.170978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b02709-76c2-43a0-91ca-35547c0d5185 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff588aaad264f9cbc5a80e73ef0c09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:19.171695 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b02709-76c2-43a0-91ca-35547c0d5185 service placement] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:19.172208 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b02709-76c2-43a0-91ca-35547c0d5185 service placement] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:19.172684 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b02709-76c2-43a0-91ca-35547c0d5185 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:19.174869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-75b02709-76c2-43a0-91ca-35547c0d5185 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:19.189231 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b02709-76c2-43a0-91ca-35547c0d5185 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:19.190832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b02709-76c2-43a0-91ca-35547c0d5185 service placement] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:19.202814 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1211/2447] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:19.301404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7da216-b683-44cf-8cc5-cdccf14a0ac8 service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:19.304302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-3c7da216-b683-44cf-8cc5-cdccf14a0ac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:19.318028 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7da216-b683-44cf-8cc5-cdccf14a0ac8 service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:19.323025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baeeca-799b-48ba-a5af-176553017496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:19.324007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baeeca-799b-48ba-a5af-176553017496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:19.324336 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baeeca-799b-48ba-a5af-176553017496 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:19.324613 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baeeca-799b-48ba-a5af-176553017496 admin admin] PATH_INFO: `/v3/users/c3f7f25cf67c40b5a03f4f692a198146` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:19.326003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7baeeca-799b-48ba-a5af-176553017496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3f7f25cf67c40b5a03f4f692a198146)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:19.327999 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7baeeca-799b-48ba-a5af-176553017496 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:19.538940 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f7baeeca-799b-48ba-a5af-176553017496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3f7f25cf67c40b5a03f4f692a198146'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:19.546154 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f7baeeca-799b-48ba-a5af-176553017496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3f7f25cf67c40b5a03f4f692a198146'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:19.641715 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f7baeeca-799b-48ba-a5af-176553017496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3f7f25cf67c40b5a03f4f692a198146'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:19.645734 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f7baeeca-799b-48ba-a5af-176553017496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3f7f25cf67c40b5a03f4f692a198146'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:19.645734 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f7baeeca-799b-48ba-a5af-176553017496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3f7f25cf67c40b5a03f4f692a198146'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:19.663077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1237/2448] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:04:19 2022] DELETE /identity/v3/users/c3f7f25cf67c40b5a03f4f692a198146 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:19.914034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b02709-76c2-43a0-91ca-35547c0d5185 service placement] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:19.929578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b02709-76c2-43a0-91ca-35547c0d5185 service placement] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:20.041749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:20.050748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedd8f4-d1e2-466d-8c87-bb895af79789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:20.051933 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedd8f4-d1e2-466d-8c87-bb895af79789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:20.052220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedd8f4-d1e2-466d-8c87-bb895af79789 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:20.052497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedd8f4-d1e2-466d-8c87-bb895af79789 admin admin] PATH_INFO: `/v3/projects/8fb81215065b41dba1db019ec89fa8b2` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:20.053943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedd8f4-d1e2-466d-8c87-bb895af79789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fb81215065b41dba1db019ec89fa8b2)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:20.055882 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedd8f4-d1e2-466d-8c87-bb895af79789 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:20.194104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-aaedd8f4-d1e2-466d-8c87-bb895af79789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fb81215065b41dba1db019ec89fa8b2', 'request_id': 'req-aaedd8f4-d1e2-466d-8c87-bb895af79789'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:20.378299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-aaedd8f4-d1e2-466d-8c87-bb895af79789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fb81215065b41dba1db019ec89fa8b2', 'request_id': 'req-aaedd8f4-d1e2-466d-8c87-bb895af79789'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:20.386963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-aaedd8f4-d1e2-466d-8c87-bb895af79789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fb81215065b41dba1db019ec89fa8b2', 'request_id': 'req-aaedd8f4-d1e2-466d-8c87-bb895af79789'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:20.399820 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-aaedd8f4-d1e2-466d-8c87-bb895af79789 admin admin] The token cache is being invalidate because project 8fb81215065b41dba1db019ec89fa8b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:04:20.400109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-aaedd8f4-d1e2-466d-8c87-bb895af79789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:20.400791 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-aaedd8f4-d1e2-466d-8c87-bb895af79789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:20.402429 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1212/2449] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:04:19 2022] DELETE /identity/v3/projects/8fb81215065b41dba1db019ec89fa8b2 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:20.407648 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44086f9a-4b00-45a7-882a-944c5ddf02e5 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:20.408130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44086f9a-4b00-45a7-882a-944c5ddf02e5 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:20.408228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44086f9a-4b00-45a7-882a-944c5ddf02e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:20.427222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-44086f9a-4b00-45a7-882a-944c5ddf02e5 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:20.428422 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-44086f9a-4b00-45a7-882a-944c5ddf02e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:20.494135 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1238/2450] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:04:20.502253 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a3823-7e3f-4840-bcfb-abb2b71dc62e None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:20.502544 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a3823-7e3f-4840-bcfb-abb2b71dc62e None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:20.502849 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a3823-7e3f-4840-bcfb-abb2b71dc62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:20.521897 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-a32a3823-7e3f-4840-bcfb-abb2b71dc62e None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:20.523107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a32a3823-7e3f-4840-bcfb-abb2b71dc62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:20.531460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1213/2451] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:20.536945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44086f9a-4b00-45a7-882a-944c5ddf02e5 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:20.546961 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44086f9a-4b00-45a7-882a-944c5ddf02e5 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:20.551912 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bf602-7a3e-409f-8c78-bc1a1946ab0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:20.552671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bf602-7a3e-409f-8c78-bc1a1946ab0d admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:20.553045 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bf602-7a3e-409f-8c78-bc1a1946ab0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:20.553422 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bf602-7a3e-409f-8c78-bc1a1946ab0d admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:20.554222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7bf602-7a3e-409f-8c78-bc1a1946ab0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:04:20.554630 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7bf602-7a3e-409f-8c78-bc1a1946ab0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:20.556379 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7bf602-7a3e-409f-8c78-bc1a1946ab0d admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:20.569923 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1239/2452] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:04:20.573437 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a3823-7e3f-4840-bcfb-abb2b71dc62e None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:20.583389 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a3823-7e3f-4840-bcfb-abb2b71dc62e None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:20.588360 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e43196-9a51-45f8-9115-17e8f9318f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:20.589054 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e43196-9a51-45f8-9115-17e8f9318f6f admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:20.589339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e43196-9a51-45f8-9115-17e8f9318f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:20.589614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e43196-9a51-45f8-9115-17e8f9318f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:20.590310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e43196-9a51-45f8-9115-17e8f9318f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:20.592226 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e43196-9a51-45f8-9115-17e8f9318f6f admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:20.674938 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1214/2453] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:20 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:20.676323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bf602-7a3e-409f-8c78-bc1a1946ab0d admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:20.686450 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bf602-7a3e-409f-8c78-bc1a1946ab0d admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:20.699396 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:20.748616 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c37be-64fb-4b8f-9160-2d4854e2c771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:20.749332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c37be-64fb-4b8f-9160-2d4854e2c771 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:20.749617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c37be-64fb-4b8f-9160-2d4854e2c771 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:20.749896 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c37be-64fb-4b8f-9160-2d4854e2c771 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:20.750607 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c37be-64fb-4b8f-9160-2d4854e2c771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:20.752550 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c37be-64fb-4b8f-9160-2d4854e2c771 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:20.820693 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1240/2454] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:20 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:20.825022 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e43196-9a51-45f8-9115-17e8f9318f6f admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:20.837308 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e43196-9a51-45f8-9115-17e8f9318f6f admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:20.842211 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813b55c-1745-4f22-941c-fcf29d0baa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:20.842952 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b55c-1745-4f22-941c-fcf29d0baa45 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:20.843170 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b55c-1745-4f22-941c-fcf29d0baa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:20.843449 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b55c-1745-4f22-941c-fcf29d0baa45 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:20.844190 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813b55c-1745-4f22-941c-fcf29d0baa45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:20.845875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813b55c-1745-4f22-941c-fcf29d0baa45 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:20.861039 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1215/2455] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:20.864277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c37be-64fb-4b8f-9160-2d4854e2c771 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:20.873852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c37be-64fb-4b8f-9160-2d4854e2c771 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:20.879240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137203b9-b287-40d9-9655-fcc7a4354123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:20.879920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137203b9-b287-40d9-9655-fcc7a4354123 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:20.880205 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137203b9-b287-40d9-9655-fcc7a4354123 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:20.880478 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137203b9-b287-40d9-9655-fcc7a4354123 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:20.881244 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137203b9-b287-40d9-9655-fcc7a4354123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:20.882840 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137203b9-b287-40d9-9655-fcc7a4354123 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:20.895312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1241/2456] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:20.899305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813b55c-1745-4f22-941c-fcf29d0baa45 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:20.909690 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813b55c-1745-4f22-941c-fcf29d0baa45 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:20.915174 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682b0a5-dc7a-4d9b-a7fa-acf8c209c780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:20.916071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682b0a5-dc7a-4d9b-a7fa-acf8c209c780 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:20.916354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682b0a5-dc7a-4d9b-a7fa-acf8c209c780 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:20.916630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682b0a5-dc7a-4d9b-a7fa-acf8c209c780 admin admin] PATH_INFO: `/v3/projects/52fc5aa3f05642c199a2371063ee2461/users/5bc06122cc9a4e46ae903eb28f72c025/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:20.934248 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682b0a5-dc7a-4d9b-a7fa-acf8c209c780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52fc5aa3f05642c199a2371063ee2461, user_id=5bc06122cc9a4e46ae903eb28f72c025, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:20.936144 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682b0a5-dc7a-4d9b-a7fa-acf8c209c780 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:20.984996 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1216/2457] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:20 2022] PUT /identity/v3/projects/52fc5aa3f05642c199a2371063ee2461/users/5bc06122cc9a4e46ae903eb28f72c025/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:20.996332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca339024-875e-49d1-868d-40173a84d87f None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:20.996703 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca339024-875e-49d1-868d-40173a84d87f None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:20.996995 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca339024-875e-49d1-868d-40173a84d87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:21.027887 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-ca339024-875e-49d1-868d-40173a84d87f None None] MFA Rules not processed for user `5bc06122cc9a4e46ae903eb28f72c025`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:21.029247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ca339024-875e-49d1-868d-40173a84d87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:21.095806 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1242/2458] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:21.108989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682b0a5-dc7a-4d9b-a7fa-acf8c209c780 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:21.110669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-1682b0a5-dc7a-4d9b-a7fa-acf8c209c780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:21.203424 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682b0a5-dc7a-4d9b-a7fa-acf8c209c780 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:21.210572 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fed5df-c01b-4670-bca5-5a66f44c559a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:21.211384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fed5df-c01b-4670-bca5-5a66f44c559a service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:21.212137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fed5df-c01b-4670-bca5-5a66f44c559a service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:21.212137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fed5df-c01b-4670-bca5-5a66f44c559a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:21.220488 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fed5df-c01b-4670-bca5-5a66f44c559a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:21.222140 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fed5df-c01b-4670-bca5-5a66f44c559a service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:21.227552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:21.234638 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1217/2459] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:21.493291 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca339024-875e-49d1-868d-40173a84d87f None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:21.557827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca339024-875e-49d1-868d-40173a84d87f None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:21.562419 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec179243-77fc-485e-960a-a2f07dd90354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:21.563335 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec179243-77fc-485e-960a-a2f07dd90354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:21.563674 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec179243-77fc-485e-960a-a2f07dd90354 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:21.563959 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec179243-77fc-485e-960a-a2f07dd90354 admin admin] PATH_INFO: `/v3/users/5bc06122cc9a4e46ae903eb28f72c025` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:21.565173 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec179243-77fc-485e-960a-a2f07dd90354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bc06122cc9a4e46ae903eb28f72c025)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:21.567348 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec179243-77fc-485e-960a-a2f07dd90354 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:21.650831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:21.747326 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ec179243-77fc-485e-960a-a2f07dd90354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bc06122cc9a4e46ae903eb28f72c025'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:21.754878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ec179243-77fc-485e-960a-a2f07dd90354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bc06122cc9a4e46ae903eb28f72c025'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:21.857774 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ec179243-77fc-485e-960a-a2f07dd90354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bc06122cc9a4e46ae903eb28f72c025'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:21.858403 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ec179243-77fc-485e-960a-a2f07dd90354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bc06122cc9a4e46ae903eb28f72c025'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:21.859018 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-ec179243-77fc-485e-960a-a2f07dd90354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bc06122cc9a4e46ae903eb28f72c025'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:21.877842 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1243/2460] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:04:21 2022] DELETE /identity/v3/users/5bc06122cc9a4e46ae903eb28f72c025 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:21.882742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fcf9e-acc8-43af-b348-dbb8f122e58c None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:21.883081 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fcf9e-acc8-43af-b348-dbb8f122e58c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:21.883378 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fcf9e-acc8-43af-b348-dbb8f122e58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:21.901872 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-705fcf9e-acc8-43af-b348-dbb8f122e58c None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:21.903301 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-705fcf9e-acc8-43af-b348-dbb8f122e58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:21.973253 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1218/2461] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:21.980444 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec179243-77fc-485e-960a-a2f07dd90354 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:21.981924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ec179243-77fc-485e-960a-a2f07dd90354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:22.040854 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec179243-77fc-485e-960a-a2f07dd90354 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:22.044583 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f898f9-cb5b-4eac-a967-5c2ecb1615f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:22.048206 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f898f9-cb5b-4eac-a967-5c2ecb1615f3 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:22.048206 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f898f9-cb5b-4eac-a967-5c2ecb1615f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:22.048206 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f898f9-cb5b-4eac-a967-5c2ecb1615f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:22.056949 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f898f9-cb5b-4eac-a967-5c2ecb1615f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:22.058451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f898f9-cb5b-4eac-a967-5c2ecb1615f3 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:22.071852 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1244/2462] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:22.554009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fcf9e-acc8-43af-b348-dbb8f122e58c None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:22.555553 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-705fcf9e-acc8-43af-b348-dbb8f122e58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:22.570730 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fcf9e-acc8-43af-b348-dbb8f122e58c None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:22.575657 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f0b74-be5a-4129-8465-303d3a4b1df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:22.577276 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f0b74-be5a-4129-8465-303d3a4b1df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:22.577563 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f0b74-be5a-4129-8465-303d3a4b1df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:22.577841 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f0b74-be5a-4129-8465-303d3a4b1df6 admin admin] PATH_INFO: `/v3/projects/52fc5aa3f05642c199a2371063ee2461` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:22.579057 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f0b74-be5a-4129-8465-303d3a4b1df6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52fc5aa3f05642c199a2371063ee2461)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:22.581164 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f0b74-be5a-4129-8465-303d3a4b1df6 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:22.702582 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c32f0b74-be5a-4129-8465-303d3a4b1df6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52fc5aa3f05642c199a2371063ee2461', 'request_id': 'req-c32f0b74-be5a-4129-8465-303d3a4b1df6'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:22.789539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c32f0b74-be5a-4129-8465-303d3a4b1df6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52fc5aa3f05642c199a2371063ee2461', 'request_id': 'req-c32f0b74-be5a-4129-8465-303d3a4b1df6'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:22.795650 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c32f0b74-be5a-4129-8465-303d3a4b1df6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52fc5aa3f05642c199a2371063ee2461', 'request_id': 'req-c32f0b74-be5a-4129-8465-303d3a4b1df6'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:22.807522 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c32f0b74-be5a-4129-8465-303d3a4b1df6 admin admin] The token cache is being invalidate because project 52fc5aa3f05642c199a2371063ee2461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:04:22.807812 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c32f0b74-be5a-4129-8465-303d3a4b1df6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:22.810539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c32f0b74-be5a-4129-8465-303d3a4b1df6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:22.810539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1219/2463] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:04:22 2022] DELETE /identity/v3/projects/52fc5aa3f05642c199a2371063ee2461 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:22.815007 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11264bfa-f49e-415b-ac9e-a7f087d83752 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:22.815513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11264bfa-f49e-415b-ac9e-a7f087d83752 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:22.815619 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11264bfa-f49e-415b-ac9e-a7f087d83752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:22.833619 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-11264bfa-f49e-415b-ac9e-a7f087d83752 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:22.839303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-11264bfa-f49e-415b-ac9e-a7f087d83752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:22.896363 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1245/2464] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:22.904806 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe3e6d-09b1-4c50-bfa9-d8007534f6cb None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:22.905258 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe3e6d-09b1-4c50-bfa9-d8007534f6cb None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:22.905609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe3e6d-09b1-4c50-bfa9-d8007534f6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:22.926156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-fefe3e6d-09b1-4c50-bfa9-d8007534f6cb None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:22.927373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-fefe3e6d-09b1-4c50-bfa9-d8007534f6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:22.935986 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1220/2465] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:22.942511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11264bfa-f49e-415b-ac9e-a7f087d83752 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:22.950728 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11264bfa-f49e-415b-ac9e-a7f087d83752 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:22.955388 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc851d0-837f-43ea-91ad-15547801760d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:22.956038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc851d0-837f-43ea-91ad-15547801760d admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:22.956350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc851d0-837f-43ea-91ad-15547801760d admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:22.956659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc851d0-837f-43ea-91ad-15547801760d admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:22.957444 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc851d0-837f-43ea-91ad-15547801760d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:04:22.957753 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc851d0-837f-43ea-91ad-15547801760d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:22.959345 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc851d0-837f-43ea-91ad-15547801760d admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:22.970895 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1246/2466] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:04:22.976099 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe3e6d-09b1-4c50-bfa9-d8007534f6cb None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:22.985301 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe3e6d-09b1-4c50-bfa9-d8007534f6cb None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:22.990621 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28093a36-94bf-4f1a-8208-a160ef22261d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:22.991272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28093a36-94bf-4f1a-8208-a160ef22261d admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:22.991556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28093a36-94bf-4f1a-8208-a160ef22261d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:22.991833 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28093a36-94bf-4f1a-8208-a160ef22261d admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:22.992512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28093a36-94bf-4f1a-8208-a160ef22261d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:22.994435 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28093a36-94bf-4f1a-8208-a160ef22261d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:23.101135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1221/2467] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:22 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:23.105388 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc851d0-837f-43ea-91ad-15547801760d admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:23.116278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc851d0-837f-43ea-91ad-15547801760d admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:23.150267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:23.175044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb4d27-0115-45b9-a6e3-4e93194367a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:23.176454 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb4d27-0115-45b9-a6e3-4e93194367a5 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:23.176780 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb4d27-0115-45b9-a6e3-4e93194367a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:23.177061 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb4d27-0115-45b9-a6e3-4e93194367a5 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:23.177898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb4d27-0115-45b9-a6e3-4e93194367a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:23.179824 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb4d27-0115-45b9-a6e3-4e93194367a5 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:23.264850 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1247/2468] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:23 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:23.269024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28093a36-94bf-4f1a-8208-a160ef22261d admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:23.280345 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28093a36-94bf-4f1a-8208-a160ef22261d admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:23.285734 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae4a17-f364-487c-b553-ed4713bcbd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:23.286513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae4a17-f364-487c-b553-ed4713bcbd90 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:23.286790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae4a17-f364-487c-b553-ed4713bcbd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:23.287063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae4a17-f364-487c-b553-ed4713bcbd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:23.287786 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae4a17-f364-487c-b553-ed4713bcbd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:23.289408 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae4a17-f364-487c-b553-ed4713bcbd90 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:23.299789 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1222/2469] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:23.304000 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb4d27-0115-45b9-a6e3-4e93194367a5 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:23.314129 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb4d27-0115-45b9-a6e3-4e93194367a5 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:23.318754 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10994150-4ff4-43dd-81ee-f54bcf43fcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:23.319415 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10994150-4ff4-43dd-81ee-f54bcf43fcca admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:23.319703 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10994150-4ff4-43dd-81ee-f54bcf43fcca admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:23.319984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10994150-4ff4-43dd-81ee-f54bcf43fcca admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:23.320753 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10994150-4ff4-43dd-81ee-f54bcf43fcca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:23.322351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10994150-4ff4-43dd-81ee-f54bcf43fcca admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:23.333016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1248/2470] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:23.337143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae4a17-f364-487c-b553-ed4713bcbd90 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:23.346976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae4a17-f364-487c-b553-ed4713bcbd90 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:23.352530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742357f-f043-4c0e-b0a5-98915323b577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:23.353405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742357f-f043-4c0e-b0a5-98915323b577 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:23.353693 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742357f-f043-4c0e-b0a5-98915323b577 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:23.353971 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742357f-f043-4c0e-b0a5-98915323b577 admin admin] PATH_INFO: `/v3/projects/2fc40f62563544ef814fa9440888c260/users/d7876bd9e42245709c823e9f17f4e527/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:23.368534 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742357f-f043-4c0e-b0a5-98915323b577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc40f62563544ef814fa9440888c260, user_id=d7876bd9e42245709c823e9f17f4e527, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:23.371206 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742357f-f043-4c0e-b0a5-98915323b577 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:23.454037 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1223/2471] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:23 2022] PUT /identity/v3/projects/2fc40f62563544ef814fa9440888c260/users/d7876bd9e42245709c823e9f17f4e527/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:23.465948 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98803ac-3f6d-4ceb-869e-bb878f8a45a2 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:23.466241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98803ac-3f6d-4ceb-869e-bb878f8a45a2 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:23.466512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98803ac-3f6d-4ceb-869e-bb878f8a45a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:23.494360 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-a98803ac-3f6d-4ceb-869e-bb878f8a45a2 None None] MFA Rules not processed for user `d7876bd9e42245709c823e9f17f4e527`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:23.495579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-a98803ac-3f6d-4ceb-869e-bb878f8a45a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:23.561953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1249/2472] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:23.567146 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742357f-f043-4c0e-b0a5-98915323b577 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:23.589143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:23.639592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742357f-f043-4c0e-b0a5-98915323b577 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:23.645381 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5963be-12e9-49fe-95c7-271d0c52d37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:23.646317 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5963be-12e9-49fe-95c7-271d0c52d37a admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:23.646604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5963be-12e9-49fe-95c7-271d0c52d37a admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:23.646882 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5963be-12e9-49fe-95c7-271d0c52d37a admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:23.647578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5963be-12e9-49fe-95c7-271d0c52d37a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:23.649802 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5963be-12e9-49fe-95c7-271d0c52d37a admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:23.746646 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1224/2473] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:23 2022] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:23.750534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98803ac-3f6d-4ceb-869e-bb878f8a45a2 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:23.761822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98803ac-3f6d-4ceb-869e-bb878f8a45a2 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:23.820474 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2291f-0390-486a-9c91-57f40d146e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:23.821240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2291f-0390-486a-9c91-57f40d146e52 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:23.821548 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2291f-0390-486a-9c91-57f40d146e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:23.821809 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2291f-0390-486a-9c91-57f40d146e52 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:23.822513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2291f-0390-486a-9c91-57f40d146e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:23.824567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2291f-0390-486a-9c91-57f40d146e52 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:23.916331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1250/2474] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:23 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:23.920368 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5963be-12e9-49fe-95c7-271d0c52d37a admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:23.931480 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5963be-12e9-49fe-95c7-271d0c52d37a admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:23.936051 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51538e9d-eb05-4e53-8bbe-34cd3683668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:23.936746 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51538e9d-eb05-4e53-8bbe-34cd3683668b admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:23.937032 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51538e9d-eb05-4e53-8bbe-34cd3683668b admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:23.937309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51538e9d-eb05-4e53-8bbe-34cd3683668b admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:23.938084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51538e9d-eb05-4e53-8bbe-34cd3683668b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:23.939805 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51538e9d-eb05-4e53-8bbe-34cd3683668b admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:23.950435 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1225/2475] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:23.954580 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2291f-0390-486a-9c91-57f40d146e52 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:23.964608 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2291f-0390-486a-9c91-57f40d146e52 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:23.969346 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fde82e-6a4e-43cd-bdc6-37ee07663a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:23.970237 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fde82e-6a4e-43cd-bdc6-37ee07663a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:23.970524 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fde82e-6a4e-43cd-bdc6-37ee07663a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:23.970803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fde82e-6a4e-43cd-bdc6-37ee07663a67 admin admin] PATH_INFO: `/v3/projects/6d3ab568b54e40a2bd3013c2f5f35966/users/5ac213ab3a9d4910b389f685b173491c/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:23.987460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fde82e-6a4e-43cd-bdc6-37ee07663a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3ab568b54e40a2bd3013c2f5f35966, user_id=5ac213ab3a9d4910b389f685b173491c, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:23.990708 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fde82e-6a4e-43cd-bdc6-37ee07663a67 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:24.065001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1251/2476] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:23 2022] PUT /identity/v3/projects/6d3ab568b54e40a2bd3013c2f5f35966/users/5ac213ab3a9d4910b389f685b173491c/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:24.069893 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51538e9d-eb05-4e53-8bbe-34cd3683668b admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:24.080867 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51538e9d-eb05-4e53-8bbe-34cd3683668b admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:24.137640 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9e3f7-c42c-450c-9cc5-f0c21f3e11f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:24.138323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9e3f7-c42c-450c-9cc5-f0c21f3e11f9 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:24.138611 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9e3f7-c42c-450c-9cc5-f0c21f3e11f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:24.138889 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9e3f7-c42c-450c-9cc5-f0c21f3e11f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:24.139627 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9e3f7-c42c-450c-9cc5-f0c21f3e11f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:24.141321 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9e3f7-c42c-450c-9cc5-f0c21f3e11f9 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:24.151996 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1226/2477] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:24.156246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fde82e-6a4e-43cd-bdc6-37ee07663a67 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:24.167490 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fde82e-6a4e-43cd-bdc6-37ee07663a67 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:24.172207 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd4b1c-fad2-49dd-a450-301443b48b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:24.173244 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd4b1c-fad2-49dd-a450-301443b48b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:24.173518 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd4b1c-fad2-49dd-a450-301443b48b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:24.173808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd4b1c-fad2-49dd-a450-301443b48b6a admin admin] PATH_INFO: `/v3/projects/6d3ab568b54e40a2bd3013c2f5f35966/users/5ac213ab3a9d4910b389f685b173491c/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:24.176309 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd4b1c-fad2-49dd-a450-301443b48b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3ab568b54e40a2bd3013c2f5f35966, user_id=5ac213ab3a9d4910b389f685b173491c, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:24.179035 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd4b1c-fad2-49dd-a450-301443b48b6a admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:24.182619 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:24.190834 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1252/2478] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:24 2022] PUT /identity/v3/projects/6d3ab568b54e40a2bd3013c2f5f35966/users/5ac213ab3a9d4910b389f685b173491c/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:24.202084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75c0de-8b64-4792-a463-ee0482e1bcf6 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:24.202375 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75c0de-8b64-4792-a463-ee0482e1bcf6 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:24.202656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75c0de-8b64-4792-a463-ee0482e1bcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:24.229223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-8e75c0de-8b64-4792-a463-ee0482e1bcf6 None None] MFA Rules not processed for user `5ac213ab3a9d4910b389f685b173491c`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:24.230425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8e75c0de-8b64-4792-a463-ee0482e1bcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:24.307153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1227/2479] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:04:24.318512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd4b1c-fad2-49dd-a450-301443b48b6a admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:24.320324 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-99bd4b1c-fad2-49dd-a450-301443b48b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:24.383248 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd4b1c-fad2-49dd-a450-301443b48b6a admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:24.387613 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe23e27-0d65-4fb3-86d9-7b6fd4159773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:24.388278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe23e27-0d65-4fb3-86d9-7b6fd4159773 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:24.388562 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe23e27-0d65-4fb3-86d9-7b6fd4159773 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:24.388872 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe23e27-0d65-4fb3-86d9-7b6fd4159773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:24.399569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe23e27-0d65-4fb3-86d9-7b6fd4159773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:24.401114 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe23e27-0d65-4fb3-86d9-7b6fd4159773 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:24.412632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1253/2480] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:24 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:25.509619 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75c0de-8b64-4792-a463-ee0482e1bcf6 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:25.527883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:25.573608 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75c0de-8b64-4792-a463-ee0482e1bcf6 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:25.578306 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed342b-b978-4942-90c8-79eb8d591158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:25.579176 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed342b-b978-4942-90c8-79eb8d591158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:25.579467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed342b-b978-4942-90c8-79eb8d591158 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:25.579744 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed342b-b978-4942-90c8-79eb8d591158 admin admin] PATH_INFO: `/v3/users/d7876bd9e42245709c823e9f17f4e527` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:25.580969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed342b-b978-4942-90c8-79eb8d591158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7876bd9e42245709c823e9f17f4e527)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:25.583748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed342b-b978-4942-90c8-79eb8d591158 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:25.758093 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-25ed342b-b978-4942-90c8-79eb8d591158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7876bd9e42245709c823e9f17f4e527'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:25.765145 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-25ed342b-b978-4942-90c8-79eb8d591158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7876bd9e42245709c823e9f17f4e527'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:25.765893 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-25ed342b-b978-4942-90c8-79eb8d591158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7876bd9e42245709c823e9f17f4e527'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:25.818783 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-25ed342b-b978-4942-90c8-79eb8d591158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7876bd9e42245709c823e9f17f4e527'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:25.819412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-25ed342b-b978-4942-90c8-79eb8d591158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7876bd9e42245709c823e9f17f4e527'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:25.837889 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1228/2481] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:04:25 2022] DELETE /identity/v3/users/d7876bd9e42245709c823e9f17f4e527 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:25.842808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f96d9d-4008-4994-8419-277e0c71ba33 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:25.843490 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f96d9d-4008-4994-8419-277e0c71ba33 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:25.843490 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f96d9d-4008-4994-8419-277e0c71ba33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:25.862184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-60f96d9d-4008-4994-8419-277e0c71ba33 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:25.863493 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-60f96d9d-4008-4994-8419-277e0c71ba33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:25.922383 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1254/2482] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:25.932132 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed342b-b978-4942-90c8-79eb8d591158 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:25.933603 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-25ed342b-b978-4942-90c8-79eb8d591158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:25.996205 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed342b-b978-4942-90c8-79eb8d591158 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:26.000068 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87d110-d900-44d9-95d4-aa8c9e7ae01d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:26.000924 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87d110-d900-44d9-95d4-aa8c9e7ae01d service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:26.001345 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87d110-d900-44d9-95d4-aa8c9e7ae01d service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:26.001721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87d110-d900-44d9-95d4-aa8c9e7ae01d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:26.012425 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87d110-d900-44d9-95d4-aa8c9e7ae01d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:26.014104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87d110-d900-44d9-95d4-aa8c9e7ae01d service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:26.024576 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1229/2483] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:26.697739 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f96d9d-4008-4994-8419-277e0c71ba33 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:26.699264 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-60f96d9d-4008-4994-8419-277e0c71ba33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:26.711186 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f96d9d-4008-4994-8419-277e0c71ba33 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:26.721605 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ad66e-780e-4915-868b-a4d93380e6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:26.721605 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ad66e-780e-4915-868b-a4d93380e6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:26.721605 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ad66e-780e-4915-868b-a4d93380e6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:26.721605 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ad66e-780e-4915-868b-a4d93380e6eb admin admin] PATH_INFO: `/v3/projects/2fc40f62563544ef814fa9440888c260` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:26.722015 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ad66e-780e-4915-868b-a4d93380e6eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fc40f62563544ef814fa9440888c260)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:26.722015 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ad66e-780e-4915-868b-a4d93380e6eb admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:26.838244 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b80ad66e-780e-4915-868b-a4d93380e6eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fc40f62563544ef814fa9440888c260', 'request_id': 'req-b80ad66e-780e-4915-868b-a4d93380e6eb'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:26.846010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b80ad66e-780e-4915-868b-a4d93380e6eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fc40f62563544ef814fa9440888c260', 'request_id': 'req-b80ad66e-780e-4915-868b-a4d93380e6eb'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:26.910297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b80ad66e-780e-4915-868b-a4d93380e6eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fc40f62563544ef814fa9440888c260', 'request_id': 'req-b80ad66e-780e-4915-868b-a4d93380e6eb'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:26.922237 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b80ad66e-780e-4915-868b-a4d93380e6eb admin admin] The token cache is being invalidate because project 2fc40f62563544ef814fa9440888c260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:04:26.922525 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b80ad66e-780e-4915-868b-a4d93380e6eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:26.923162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b80ad66e-780e-4915-868b-a4d93380e6eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:26.924742 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1255/2484] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:04:26 2022] DELETE /identity/v3/projects/2fc40f62563544ef814fa9440888c260 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:26.929350 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87d110-d900-44d9-95d4-aa8c9e7ae01d service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:26.939498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87d110-d900-44d9-95d4-aa8c9e7ae01d service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:26.974789 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:27.001402 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca15a0-e318-40b4-bbc9-647d033b2c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:27.002284 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca15a0-e318-40b4-bbc9-647d033b2c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:27.002572 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca15a0-e318-40b4-bbc9-647d033b2c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:27.002850 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca15a0-e318-40b4-bbc9-647d033b2c6d admin admin] PATH_INFO: `/v3/users/5ac213ab3a9d4910b389f685b173491c` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:27.005062 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca15a0-e318-40b4-bbc9-647d033b2c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ac213ab3a9d4910b389f685b173491c)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:27.007005 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca15a0-e318-40b4-bbc9-647d033b2c6d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:27.199126 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7fca15a0-e318-40b4-bbc9-647d033b2c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ac213ab3a9d4910b389f685b173491c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:27.206396 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7fca15a0-e318-40b4-bbc9-647d033b2c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ac213ab3a9d4910b389f685b173491c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:27.207319 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7fca15a0-e318-40b4-bbc9-647d033b2c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ac213ab3a9d4910b389f685b173491c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:27.265034 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7fca15a0-e318-40b4-bbc9-647d033b2c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ac213ab3a9d4910b389f685b173491c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:27.265672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7fca15a0-e318-40b4-bbc9-647d033b2c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ac213ab3a9d4910b389f685b173491c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:27.290002 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1230/2485] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:04:26 2022] DELETE /identity/v3/users/5ac213ab3a9d4910b389f685b173491c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:27.771167 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ad66e-780e-4915-868b-a4d93380e6eb admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:27.771353 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca15a0-e318-40b4-bbc9-647d033b2c6d admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:27.772880 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-7fca15a0-e318-40b4-bbc9-647d033b2c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:27.773358 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b80ad66e-780e-4915-868b-a4d93380e6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:27.815163 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:27.864031 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ad66e-780e-4915-868b-a4d93380e6eb admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:27.890504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca15a0-e318-40b4-bbc9-647d033b2c6d admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:27.897854 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6d974-77bb-4a19-b066-ecde2cf1c6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:27.898909 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6d974-77bb-4a19-b066-ecde2cf1c6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:27.899196 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6d974-77bb-4a19-b066-ecde2cf1c6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:27.899471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6d974-77bb-4a19-b066-ecde2cf1c6b0 admin admin] PATH_INFO: `/v3/projects/6d3ab568b54e40a2bd3013c2f5f35966` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:27.901262 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6d974-77bb-4a19-b066-ecde2cf1c6b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d3ab568b54e40a2bd3013c2f5f35966)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:27.905776 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6d974-77bb-4a19-b066-ecde2cf1c6b0 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:27.932669 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48f2df-2e05-4c20-a16f-ab46dc5e4ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:27.933359 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48f2df-2e05-4c20-a16f-ab46dc5e4ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:27.933645 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48f2df-2e05-4c20-a16f-ab46dc5e4ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:27.933921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48f2df-2e05-4c20-a16f-ab46dc5e4ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:27.935973 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9b48f2df-2e05-4c20-a16f-ab46dc5e4ec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:27.949030 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48f2df-2e05-4c20-a16f-ab46dc5e4ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:27.950570 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48f2df-2e05-4c20-a16f-ab46dc5e4ec5 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:27.968860 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1256/2486] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:28.010064 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-2cf6d974-77bb-4a19-b066-ecde2cf1c6b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d3ab568b54e40a2bd3013c2f5f35966', 'request_id': 'req-2cf6d974-77bb-4a19-b066-ecde2cf1c6b0'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:28.070788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-2cf6d974-77bb-4a19-b066-ecde2cf1c6b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d3ab568b54e40a2bd3013c2f5f35966', 'request_id': 'req-2cf6d974-77bb-4a19-b066-ecde2cf1c6b0'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:28.074278 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:28.081088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-2cf6d974-77bb-4a19-b066-ecde2cf1c6b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d3ab568b54e40a2bd3013c2f5f35966', 'request_id': 'req-2cf6d974-77bb-4a19-b066-ecde2cf1c6b0'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:28.094217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-2cf6d974-77bb-4a19-b066-ecde2cf1c6b0 admin admin] The token cache is being invalidate because project 6d3ab568b54e40a2bd3013c2f5f35966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:04:28.094621 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-2cf6d974-77bb-4a19-b066-ecde2cf1c6b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:28.095452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-2cf6d974-77bb-4a19-b066-ecde2cf1c6b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:28.097228 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1231/2487] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:04:27 2022] DELETE /identity/v3/projects/6d3ab568b54e40a2bd3013c2f5f35966 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:28.103053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351e68a-1507-445d-9d19-34b60b9cbc7d None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:28.103536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351e68a-1507-445d-9d19-34b60b9cbc7d None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:28.103817 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351e68a-1507-445d-9d19-34b60b9cbc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:28.123287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-d351e68a-1507-445d-9d19-34b60b9cbc7d None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:28.124816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d351e68a-1507-445d-9d19-34b60b9cbc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:28.192498 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1257/2488] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:28.202878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25d9e4-2bfa-4dc1-850a-aa2f8e6d37f2 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:28.204526 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25d9e4-2bfa-4dc1-850a-aa2f8e6d37f2 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:28.204526 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25d9e4-2bfa-4dc1-850a-aa2f8e6d37f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:28.226010 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-9e25d9e4-2bfa-4dc1-850a-aa2f8e6d37f2 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:28.227432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-9e25d9e4-2bfa-4dc1-850a-aa2f8e6d37f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:28.239679 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1232/2489] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:28.241592 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351e68a-1507-445d-9d19-34b60b9cbc7d None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:28.252444 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351e68a-1507-445d-9d19-34b60b9cbc7d None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:28.258472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa9894-85f4-4890-b768-bd44f9aed3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:28.259159 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa9894-85f4-4890-b768-bd44f9aed3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:28.259445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa9894-85f4-4890-b768-bd44f9aed3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:28.259723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa9894-85f4-4890-b768-bd44f9aed3f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:28.260464 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa9894-85f4-4890-b768-bd44f9aed3f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:04:28.260814 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa9894-85f4-4890-b768-bd44f9aed3f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:28.262573 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa9894-85f4-4890-b768-bd44f9aed3f0 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:28.276946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1258/2490] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:04:28.286398 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25d9e4-2bfa-4dc1-850a-aa2f8e6d37f2 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:28.296556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25d9e4-2bfa-4dc1-850a-aa2f8e6d37f2 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:28.301605 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a44801-946f-4b20-b011-32fa5b847a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:28.302557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a44801-946f-4b20-b011-32fa5b847a55 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:28.302948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a44801-946f-4b20-b011-32fa5b847a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:28.303331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a44801-946f-4b20-b011-32fa5b847a55 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:28.304200 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a44801-946f-4b20-b011-32fa5b847a55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:28.306323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a44801-946f-4b20-b011-32fa5b847a55 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:28.407612 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1233/2491] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:28 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:28.408821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa9894-85f4-4890-b768-bd44f9aed3f0 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:28.419952 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa9894-85f4-4890-b768-bd44f9aed3f0 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:28.481294 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e3458-3d19-4f8f-98a5-8a85d6393cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:28.482002 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e3458-3d19-4f8f-98a5-8a85d6393cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:28.482929 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e3458-3d19-4f8f-98a5-8a85d6393cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:28.482929 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e3458-3d19-4f8f-98a5-8a85d6393cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:28.483251 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e3458-3d19-4f8f-98a5-8a85d6393cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:28.485249 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e3458-3d19-4f8f-98a5-8a85d6393cc7 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:28.578894 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:28.587973 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1259/2492] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:28 2022] POST /identity/v3/users => generated 284 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:04:28.589282 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a44801-946f-4b20-b011-32fa5b847a55 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:28.599532 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a44801-946f-4b20-b011-32fa5b847a55 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:28.604871 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f522ae2-7dfa-4e89-a666-24d5fa16065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:28.605543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f522ae2-7dfa-4e89-a666-24d5fa16065d admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:28.605831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f522ae2-7dfa-4e89-a666-24d5fa16065d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:28.606107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f522ae2-7dfa-4e89-a666-24d5fa16065d admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:28.606901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f522ae2-7dfa-4e89-a666-24d5fa16065d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:28.608522 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f522ae2-7dfa-4e89-a666-24d5fa16065d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:28.626410 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1234/2493] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:28.631214 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e3458-3d19-4f8f-98a5-8a85d6393cc7 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:28.641339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e3458-3d19-4f8f-98a5-8a85d6393cc7 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:28.646382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfd1c1-a667-4383-851e-70e7e440a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:28.647045 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfd1c1-a667-4383-851e-70e7e440a458 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:28.647331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfd1c1-a667-4383-851e-70e7e440a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:28.647609 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfd1c1-a667-4383-851e-70e7e440a458 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:28.648346 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcfd1c1-a667-4383-851e-70e7e440a458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:28.650025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcfd1c1-a667-4383-851e-70e7e440a458 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:28.661904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1260/2494] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:04:28.665949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f522ae2-7dfa-4e89-a666-24d5fa16065d admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:28.676475 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f522ae2-7dfa-4e89-a666-24d5fa16065d admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:28.681560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335846e-c456-4156-8195-c7da19cdcf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:28.682453 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335846e-c456-4156-8195-c7da19cdcf21 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:28.682735 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335846e-c456-4156-8195-c7da19cdcf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:28.683021 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335846e-c456-4156-8195-c7da19cdcf21 admin admin] PATH_INFO: `/v3/projects/8013904717f445268610545e3d97214f/users/0b7bef3e3d4543659486b417306b856e/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:28.698342 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335846e-c456-4156-8195-c7da19cdcf21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8013904717f445268610545e3d97214f, user_id=0b7bef3e3d4543659486b417306b856e, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:28.701087 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335846e-c456-4156-8195-c7da19cdcf21 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:28.761998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1235/2495] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:28 2022] PUT /identity/v3/projects/8013904717f445268610545e3d97214f/users/0b7bef3e3d4543659486b417306b856e/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:04:28.773315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318df2c4-8a8c-47c4-a45e-21b5519feeb8 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:28.773615 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318df2c4-8a8c-47c4-a45e-21b5519feeb8 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:28.773921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318df2c4-8a8c-47c4-a45e-21b5519feeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:28.802693 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-318df2c4-8a8c-47c4-a45e-21b5519feeb8 None None] MFA Rules not processed for user `0b7bef3e3d4543659486b417306b856e`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:28.804501 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-318df2c4-8a8c-47c4-a45e-21b5519feeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:28.874836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1261/2496] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:28.879967 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335846e-c456-4156-8195-c7da19cdcf21 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:28.964085 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335846e-c456-4156-8195-c7da19cdcf21 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:28.973694 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfe497-bb78-49c7-876c-8878e0c0472d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:28.974674 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfe497-bb78-49c7-876c-8878e0c0472d admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:28.974960 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfe497-bb78-49c7-876c-8878e0c0472d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:28.976019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfe497-bb78-49c7-876c-8878e0c0472d admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:28.976764 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfe497-bb78-49c7-876c-8878e0c0472d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:28.980263 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfe497-bb78-49c7-876c-8878e0c0472d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:29.075765 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1236/2497] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:28 2022] POST /identity/v3/projects => generated 367 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:04:29.078114 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318df2c4-8a8c-47c4-a45e-21b5519feeb8 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:29.089821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318df2c4-8a8c-47c4-a45e-21b5519feeb8 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:29.159442 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18976d-0d11-4b8f-8a53-21784229b3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:29.160836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18976d-0d11-4b8f-8a53-21784229b3d1 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:29.161344 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18976d-0d11-4b8f-8a53-21784229b3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:29.161717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18976d-0d11-4b8f-8a53-21784229b3d1 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:29.162514 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18976d-0d11-4b8f-8a53-21784229b3d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:29.164561 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18976d-0d11-4b8f-8a53-21784229b3d1 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:29.266894 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1262/2498] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:29 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:29.268172 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfe497-bb78-49c7-876c-8878e0c0472d admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:29.279853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfe497-bb78-49c7-876c-8878e0c0472d admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:29.284770 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87680392-53f0-439c-bfe9-ada6e50524e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:29.286231 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87680392-53f0-439c-bfe9-ada6e50524e1 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:29.286845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87680392-53f0-439c-bfe9-ada6e50524e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:29.286845 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87680392-53f0-439c-bfe9-ada6e50524e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:29.287511 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87680392-53f0-439c-bfe9-ada6e50524e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:29.289211 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87680392-53f0-439c-bfe9-ada6e50524e1 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:29.300406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1237/2499] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:29.304823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18976d-0d11-4b8f-8a53-21784229b3d1 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:29.320731 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18976d-0d11-4b8f-8a53-21784229b3d1 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:29.330968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fd248-3e8b-4a58-809b-836e23f3cee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:29.333019 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fd248-3e8b-4a58-809b-836e23f3cee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:29.333681 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fd248-3e8b-4a58-809b-836e23f3cee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:29.334205 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fd248-3e8b-4a58-809b-836e23f3cee8 admin admin] PATH_INFO: `/v3/projects/403e3cc9becc4fad883a6d22318bc1c7/users/cea22b2411f94e0099cb04985ceb980f/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:29.353467 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fd248-3e8b-4a58-809b-836e23f3cee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=403e3cc9becc4fad883a6d22318bc1c7, user_id=cea22b2411f94e0099cb04985ceb980f, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:29.357253 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fd248-3e8b-4a58-809b-836e23f3cee8 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:29.428164 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1263/2500] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:29 2022] PUT /identity/v3/projects/403e3cc9becc4fad883a6d22318bc1c7/users/cea22b2411f94e0099cb04985ceb980f/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:04:29.437060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87680392-53f0-439c-bfe9-ada6e50524e1 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:29.452362 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87680392-53f0-439c-bfe9-ada6e50524e1 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:29.533363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:29.539392 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f04203-c06c-4cd3-ae72-be5208f1fb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:29.540670 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f04203-c06c-4cd3-ae72-be5208f1fb6e admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:29.540670 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f04203-c06c-4cd3-ae72-be5208f1fb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:29.540901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f04203-c06c-4cd3-ae72-be5208f1fb6e admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:29.541694 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f04203-c06c-4cd3-ae72-be5208f1fb6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:29.543477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f04203-c06c-4cd3-ae72-be5208f1fb6e admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:29.554759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1238/2501] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:29.558946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fd248-3e8b-4a58-809b-836e23f3cee8 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:29.570163 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fd248-3e8b-4a58-809b-836e23f3cee8 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:29.575535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3ee10-ab1d-4634-8aed-6ce741aa4611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:29.576572 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3ee10-ab1d-4634-8aed-6ce741aa4611 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:29.577019 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3ee10-ab1d-4634-8aed-6ce741aa4611 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:29.577540 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3ee10-ab1d-4634-8aed-6ce741aa4611 admin admin] PATH_INFO: `/v3/projects/403e3cc9becc4fad883a6d22318bc1c7/users/cea22b2411f94e0099cb04985ceb980f/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:29.579849 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3ee10-ab1d-4634-8aed-6ce741aa4611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=403e3cc9becc4fad883a6d22318bc1c7, user_id=cea22b2411f94e0099cb04985ceb980f, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:29.583431 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3ee10-ab1d-4634-8aed-6ce741aa4611 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:29.597120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1264/2502] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:29 2022] PUT /identity/v3/projects/403e3cc9becc4fad883a6d22318bc1c7/users/cea22b2411f94e0099cb04985ceb980f/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:29.608321 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a19eb-fdd0-419b-b099-7689c6163693 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:29.608621 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a19eb-fdd0-419b-b099-7689c6163693 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:29.610044 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a19eb-fdd0-419b-b099-7689c6163693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:29.648710 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-cd1a19eb-fdd0-419b-b099-7689c6163693 None None] MFA Rules not processed for user `cea22b2411f94e0099cb04985ceb980f`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:29.650121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-cd1a19eb-fdd0-419b-b099-7689c6163693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:29.753159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1239/2503] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:29 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:29.766063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3ee10-ab1d-4634-8aed-6ce741aa4611 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:29.768190 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-8ab3ee10-ab1d-4634-8aed-6ce741aa4611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:29.810287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:29.842434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3ee10-ab1d-4634-8aed-6ce741aa4611 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:29.848023 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad23ccd-a0d9-4291-8e4b-a3f7672f63d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:29.848899 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad23ccd-a0d9-4291-8e4b-a3f7672f63d5 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:29.849285 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad23ccd-a0d9-4291-8e4b-a3f7672f63d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:29.849661 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad23ccd-a0d9-4291-8e4b-a3f7672f63d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:29.870287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad23ccd-a0d9-4291-8e4b-a3f7672f63d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:29.872823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad23ccd-a0d9-4291-8e4b-a3f7672f63d5 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:29.895000 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1265/2504] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:29 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:30.169812 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a19eb-fdd0-419b-b099-7689c6163693 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:30.182553 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a19eb-fdd0-419b-b099-7689c6163693 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:30.186950 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfc484-54f0-401b-9631-d568402cbd27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:30.187865 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfc484-54f0-401b-9631-d568402cbd27 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:30.188148 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfc484-54f0-401b-9631-d568402cbd27 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:30.188630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfc484-54f0-401b-9631-d568402cbd27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:30.267650 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfc484-54f0-401b-9631-d568402cbd27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:30.270033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfc484-54f0-401b-9631-d568402cbd27 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:30.282658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1240/2505] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:30.602055 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad23ccd-a0d9-4291-8e4b-a3f7672f63d5 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:30.603585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-aad23ccd-a0d9-4291-8e4b-a3f7672f63d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:30.677429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad23ccd-a0d9-4291-8e4b-a3f7672f63d5 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:30.682353 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2870122-af89-4ca4-a4aa-f6cfa80ef19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:30.683226 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2870122-af89-4ca4-a4aa-f6cfa80ef19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:30.683514 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2870122-af89-4ca4-a4aa-f6cfa80ef19b admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:30.683793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2870122-af89-4ca4-a4aa-f6cfa80ef19b admin admin] PATH_INFO: `/v3/users/9c2faaf082a34c2eb654012695d91bda` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:30.685065 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2870122-af89-4ca4-a4aa-f6cfa80ef19b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c2faaf082a34c2eb654012695d91bda)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:30.686988 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2870122-af89-4ca4-a4aa-f6cfa80ef19b admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:30.861543 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-e2870122-af89-4ca4-a4aa-f6cfa80ef19b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c2faaf082a34c2eb654012695d91bda'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:30.868960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-e2870122-af89-4ca4-a4aa-f6cfa80ef19b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c2faaf082a34c2eb654012695d91bda'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:30.933775 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-e2870122-af89-4ca4-a4aa-f6cfa80ef19b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c2faaf082a34c2eb654012695d91bda'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:30.942535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-e2870122-af89-4ca4-a4aa-f6cfa80ef19b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c2faaf082a34c2eb654012695d91bda'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:30.942535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-e2870122-af89-4ca4-a4aa-f6cfa80ef19b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c2faaf082a34c2eb654012695d91bda'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:30.959718 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1266/2506] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:04:30 2022] DELETE /identity/v3/users/9c2faaf082a34c2eb654012695d91bda => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:31.193081 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfc484-54f0-401b-9631-d568402cbd27 service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:31.206870 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfc484-54f0-401b-9631-d568402cbd27 service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:31.268600 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e9727-d746-4abe-90cc-6a646682c6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:31.269672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e9727-d746-4abe-90cc-6a646682c6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:31.269956 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e9727-d746-4abe-90cc-6a646682c6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:31.270231 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e9727-d746-4abe-90cc-6a646682c6c3 admin admin] PATH_INFO: `/v3/projects/25e666c4a15b4def86ead990aba121f7` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:31.271406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e9727-d746-4abe-90cc-6a646682c6c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25e666c4a15b4def86ead990aba121f7)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:31.273444 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e9727-d746-4abe-90cc-6a646682c6c3 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:31.294765 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:31.373927 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-180e9727-d746-4abe-90cc-6a646682c6c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25e666c4a15b4def86ead990aba121f7', 'request_id': 'req-180e9727-d746-4abe-90cc-6a646682c6c3'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:31.447739 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-180e9727-d746-4abe-90cc-6a646682c6c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25e666c4a15b4def86ead990aba121f7', 'request_id': 'req-180e9727-d746-4abe-90cc-6a646682c6c3'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:31.453810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-180e9727-d746-4abe-90cc-6a646682c6c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25e666c4a15b4def86ead990aba121f7', 'request_id': 'req-180e9727-d746-4abe-90cc-6a646682c6c3'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:31.465739 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-180e9727-d746-4abe-90cc-6a646682c6c3 admin admin] The token cache is being invalidate because project 25e666c4a15b4def86ead990aba121f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:04:31.466024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-180e9727-d746-4abe-90cc-6a646682c6c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:31.466650 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-180e9727-d746-4abe-90cc-6a646682c6c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:31.468192 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1241/2507] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:04:31 2022] DELETE /identity/v3/projects/25e666c4a15b4def86ead990aba121f7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:31.474217 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014cf3-bda1-42e6-91f8-9367ce142468 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:31.474511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014cf3-bda1-42e6-91f8-9367ce142468 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:31.474792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014cf3-bda1-42e6-91f8-9367ce142468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:31.493207 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-b0014cf3-bda1-42e6-91f8-9367ce142468 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:31.494419 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b0014cf3-bda1-42e6-91f8-9367ce142468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:31.541915 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:31.556831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1267/2508] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:31.564530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdefaa9-4762-4645-8a2b-23416a383ffb None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:31.573115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdefaa9-4762-4645-8a2b-23416a383ffb None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:31.573115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdefaa9-4762-4645-8a2b-23416a383ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:31.583724 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-9bdefaa9-4762-4645-8a2b-23416a383ffb None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:31.585088 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-9bdefaa9-4762-4645-8a2b-23416a383ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:31.593035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1242/2509] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:31.598153 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0014cf3-bda1-42e6-91f8-9367ce142468 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:31.608957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0014cf3-bda1-42e6-91f8-9367ce142468 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:31.613940 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb89ff5-9321-491c-865b-f2ace712e63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:31.614614 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb89ff5-9321-491c-865b-f2ace712e63b admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:31.614899 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb89ff5-9321-491c-865b-f2ace712e63b admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:31.615177 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb89ff5-9321-491c-865b-f2ace712e63b admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:31.615907 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb89ff5-9321-491c-865b-f2ace712e63b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:04:31.616219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb89ff5-9321-491c-865b-f2ace712e63b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:31.617888 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb89ff5-9321-491c-865b-f2ace712e63b admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:31.629939 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1268/2510] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:04:31.634182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdefaa9-4762-4645-8a2b-23416a383ffb None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:31.643486 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdefaa9-4762-4645-8a2b-23416a383ffb None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:31.649020 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bed26f-4ff0-4e0b-9a1b-7cb6b8bdbae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:31.649689 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bed26f-4ff0-4e0b-9a1b-7cb6b8bdbae4 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:31.649974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bed26f-4ff0-4e0b-9a1b-7cb6b8bdbae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:31.650252 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bed26f-4ff0-4e0b-9a1b-7cb6b8bdbae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:31.650957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bed26f-4ff0-4e0b-9a1b-7cb6b8bdbae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:31.652883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bed26f-4ff0-4e0b-9a1b-7cb6b8bdbae4 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:31.670438 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734156d8-4394-4654-a601-9ee056d9b9be None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:31.670734 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734156d8-4394-4654-a601-9ee056d9b9be None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:31.671019 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734156d8-4394-4654-a601-9ee056d9b9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:31.689641 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-734156d8-4394-4654-a601-9ee056d9b9be None None] MFA Rules not processed for user `1b03d940626a449dbe904f02f3d70854`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:31.690842 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-734156d8-4394-4654-a601-9ee056d9b9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:31.739014 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1243/2511] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:31 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:31.740710 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bed26f-4ff0-4e0b-9a1b-7cb6b8bdbae4 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:31.747360 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1269/2512] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 23 11:04:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:04:31.771094 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734156d8-4394-4654-a601-9ee056d9b9be None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:31.772630 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-734156d8-4394-4654-a601-9ee056d9b9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:31.813033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bed26f-4ff0-4e0b-9a1b-7cb6b8bdbae4 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:31.818100 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff35241-689f-4365-b812-eebeaf7a6a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:31.818777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff35241-689f-4365-b812-eebeaf7a6a21 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:31.819062 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff35241-689f-4365-b812-eebeaf7a6a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:31.819340 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff35241-689f-4365-b812-eebeaf7a6a21 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:31.820036 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff35241-689f-4365-b812-eebeaf7a6a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:31.822018 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff35241-689f-4365-b812-eebeaf7a6a21 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:31.843300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734156d8-4394-4654-a601-9ee056d9b9be None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:31.905643 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c236b6-bfc9-4d8b-a269-19151fb8e164 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a54fa1c326f41e88688404a56b75c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:31.905850 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c236b6-bfc9-4d8b-a269-19151fb8e164 service swift] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:31.906109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c236b6-bfc9-4d8b-a269-19151fb8e164 service swift] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:31.906387 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c236b6-bfc9-4d8b-a269-19151fb8e164 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:31.928061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1244/2513] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:31 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:31.932108 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff35241-689f-4365-b812-eebeaf7a6a21 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:31.932537 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:31.942790 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff35241-689f-4365-b812-eebeaf7a6a21 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:31.947597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae80901-af32-4f5a-a23f-020901871487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:31.948386 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae80901-af32-4f5a-a23f-020901871487 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:31.948703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae80901-af32-4f5a-a23f-020901871487 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:31.948989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae80901-af32-4f5a-a23f-020901871487 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:31.949722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae80901-af32-4f5a-a23f-020901871487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:31.951412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae80901-af32-4f5a-a23f-020901871487 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:31.965073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1245/2514] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:04:31.965974 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c236b6-bfc9-4d8b-a269-19151fb8e164 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:31.966423 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae80901-af32-4f5a-a23f-020901871487 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:31.967766 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c236b6-bfc9-4d8b-a269-19151fb8e164 service swift] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:31.977082 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae80901-af32-4f5a-a23f-020901871487 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:31.978226 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1270/2515] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 23 11:04:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 11:04:31.982673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626208be-6fd8-45af-821a-57874a1a9fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:31.983344 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626208be-6fd8-45af-821a-57874a1a9fed admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:31.983681 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626208be-6fd8-45af-821a-57874a1a9fed admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:31.983967 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626208be-6fd8-45af-821a-57874a1a9fed admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:31.984831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626208be-6fd8-45af-821a-57874a1a9fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:31.986451 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626208be-6fd8-45af-821a-57874a1a9fed admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:31.999074 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1246/2516] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:04:32.003879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c236b6-bfc9-4d8b-a269-19151fb8e164 service swift] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:32.014745 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c236b6-bfc9-4d8b-a269-19151fb8e164 service swift] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:32.019922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fff89-a44e-4b67-8426-b0f46ae5e5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:32.020836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fff89-a44e-4b67-8426-b0f46ae5e5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:32.021136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fff89-a44e-4b67-8426-b0f46ae5e5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:32.021402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fff89-a44e-4b67-8426-b0f46ae5e5e2 admin admin] PATH_INFO: `/v3/projects/0fc9b7d7c4d24f32ae52fb45cd84e320/users/22e8bb2717dd4633ab3a54dfab3ed956/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:32.035839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fff89-a44e-4b67-8426-b0f46ae5e5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc9b7d7c4d24f32ae52fb45cd84e320, user_id=22e8bb2717dd4633ab3a54dfab3ed956, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:32.038559 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fff89-a44e-4b67-8426-b0f46ae5e5e2 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:32.093993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1271/2517] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:32 2022] PUT /identity/v3/projects/0fc9b7d7c4d24f32ae52fb45cd84e320/users/22e8bb2717dd4633ab3a54dfab3ed956/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:32.105623 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe76f5d-29bd-4d10-8503-a150727509f6 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:32.105917 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe76f5d-29bd-4d10-8503-a150727509f6 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:32.106197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe76f5d-29bd-4d10-8503-a150727509f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:32.141143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-ffe76f5d-29bd-4d10-8503-a150727509f6 None None] MFA Rules not processed for user `22e8bb2717dd4633ab3a54dfab3ed956`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:32.142409 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ffe76f5d-29bd-4d10-8503-a150727509f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:32.185903 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:32.220204 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1247/2518] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:32.225076 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fff89-a44e-4b67-8426-b0f46ae5e5e2 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:32.290723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fff89-a44e-4b67-8426-b0f46ae5e5e2 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:32.295676 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7e32b-367f-4fb4-a4a3-ad0e4e16cc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:32.296341 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7e32b-367f-4fb4-a4a3-ad0e4e16cc03 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:32.296652 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7e32b-367f-4fb4-a4a3-ad0e4e16cc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:32.296946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7e32b-367f-4fb4-a4a3-ad0e4e16cc03 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:32.297659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7e32b-367f-4fb4-a4a3-ad0e4e16cc03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:32.299678 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7e32b-367f-4fb4-a4a3-ad0e4e16cc03 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:32.389558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1272/2519] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:32 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:32.391675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe76f5d-29bd-4d10-8503-a150727509f6 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:32.406021 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe76f5d-29bd-4d10-8503-a150727509f6 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:32.470859 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7f0b9-5ab5-45cc-9c5b-0f6f83930146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:32.471539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7f0b9-5ab5-45cc-9c5b-0f6f83930146 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:32.471821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7f0b9-5ab5-45cc-9c5b-0f6f83930146 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:32.472119 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7f0b9-5ab5-45cc-9c5b-0f6f83930146 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:32.472863 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7f0b9-5ab5-45cc-9c5b-0f6f83930146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:32.474758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7f0b9-5ab5-45cc-9c5b-0f6f83930146 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:32.575811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1248/2520] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:32 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:32.579196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7e32b-367f-4fb4-a4a3-ad0e4e16cc03 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:32.592896 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7e32b-367f-4fb4-a4a3-ad0e4e16cc03 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:32.598796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78312cfe-7945-4346-a82e-4780de55ba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:32.599382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78312cfe-7945-4346-a82e-4780de55ba62 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:32.599671 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78312cfe-7945-4346-a82e-4780de55ba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:32.599954 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78312cfe-7945-4346-a82e-4780de55ba62 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:32.601010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78312cfe-7945-4346-a82e-4780de55ba62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:32.602664 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78312cfe-7945-4346-a82e-4780de55ba62 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:32.628680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1273/2521] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:04:32.632489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7f0b9-5ab5-45cc-9c5b-0f6f83930146 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:32.646717 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7f0b9-5ab5-45cc-9c5b-0f6f83930146 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:32.652021 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ba756-5793-4c8c-b38e-e609d945d7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:32.652982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ba756-5793-4c8c-b38e-e609d945d7b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:32.653337 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ba756-5793-4c8c-b38e-e609d945d7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:32.653817 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ba756-5793-4c8c-b38e-e609d945d7b0 admin admin] PATH_INFO: `/v3/projects/a4d31d14c83f43d3b2f78962a5956c35/users/ac46f8d5f98b488db404fafedec4a824/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:32.676156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ba756-5793-4c8c-b38e-e609d945d7b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d31d14c83f43d3b2f78962a5956c35, user_id=ac46f8d5f98b488db404fafedec4a824, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:32.679009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ba756-5793-4c8c-b38e-e609d945d7b0 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:32.768583 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1249/2522] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:32 2022] PUT /identity/v3/projects/a4d31d14c83f43d3b2f78962a5956c35/users/ac46f8d5f98b488db404fafedec4a824/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:32.772897 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78312cfe-7945-4346-a82e-4780de55ba62 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:32.784324 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78312cfe-7945-4346-a82e-4780de55ba62 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:32.843616 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37766d05-1fdd-4f3c-8343-05dc1663efe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:32.844292 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37766d05-1fdd-4f3c-8343-05dc1663efe2 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:32.844582 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37766d05-1fdd-4f3c-8343-05dc1663efe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:32.844946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37766d05-1fdd-4f3c-8343-05dc1663efe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:32.845679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37766d05-1fdd-4f3c-8343-05dc1663efe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:32.847791 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37766d05-1fdd-4f3c-8343-05dc1663efe2 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:32.859604 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1274/2523] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:32.864630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ba756-5793-4c8c-b38e-e609d945d7b0 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:32.874969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ba756-5793-4c8c-b38e-e609d945d7b0 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:32.880255 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5a4ef-2e3c-44a0-9ca5-38142969ca34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:32.881196 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5a4ef-2e3c-44a0-9ca5-38142969ca34 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:32.881514 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5a4ef-2e3c-44a0-9ca5-38142969ca34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:32.881795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5a4ef-2e3c-44a0-9ca5-38142969ca34 admin admin] PATH_INFO: `/v3/projects/a4d31d14c83f43d3b2f78962a5956c35/users/ac46f8d5f98b488db404fafedec4a824/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:32.883796 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5a4ef-2e3c-44a0-9ca5-38142969ca34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d31d14c83f43d3b2f78962a5956c35, user_id=ac46f8d5f98b488db404fafedec4a824, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:32.886554 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5a4ef-2e3c-44a0-9ca5-38142969ca34 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:32.897738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1250/2524] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:32 2022] PUT /identity/v3/projects/a4d31d14c83f43d3b2f78962a5956c35/users/ac46f8d5f98b488db404fafedec4a824/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:32.907965 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d4999-2132-4aae-87e9-dab8f932ac43 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:32.908261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d4999-2132-4aae-87e9-dab8f932ac43 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:32.908570 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d4999-2132-4aae-87e9-dab8f932ac43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:32.934239 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:32.937338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-549d4999-2132-4aae-87e9-dab8f932ac43 None None] MFA Rules not processed for user `ac46f8d5f98b488db404fafedec4a824`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:32.938571 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-549d4999-2132-4aae-87e9-dab8f932ac43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:32.973808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6989f91-3cb3-48f7-b5bb-f08ad4457fe0 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:32.974307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6989f91-3cb3-48f7-b5bb-f08ad4457fe0 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:32.974591 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6989f91-3cb3-48f7-b5bb-f08ad4457fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:32.993467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-a6989f91-3cb3-48f7-b5bb-f08ad4457fe0 None None] MFA Rules not processed for user `1b03d940626a449dbe904f02f3d70854`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:32.994695 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a6989f91-3cb3-48f7-b5bb-f08ad4457fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:33.016143 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1275/2525] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:04:33.027357 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d4999-2132-4aae-87e9-dab8f932ac43 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:33.028757 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-549d4999-2132-4aae-87e9-dab8f932ac43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:33.052112 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1251/2526] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jun 23 11:04:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:04:33.064307 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6989f91-3cb3-48f7-b5bb-f08ad4457fe0 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:33.088651 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d4999-2132-4aae-87e9-dab8f932ac43 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:33.093462 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2b8ff-01a4-4c53-bf9e-4cbedf30d70b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:33.094129 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2b8ff-01a4-4c53-bf9e-4cbedf30d70b service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:33.094418 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2b8ff-01a4-4c53-bf9e-4cbedf30d70b service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:33.094702 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2b8ff-01a4-4c53-bf9e-4cbedf30d70b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:33.098932 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:33.133543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6989f91-3cb3-48f7-b5bb-f08ad4457fe0 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:33.138800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393121dc-929f-47a5-bcd8-99ec072bfcf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a54fa1c326f41e88688404a56b75c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:33.141739 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393121dc-929f-47a5-bcd8-99ec072bfcf9 service swift] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:33.141739 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393121dc-929f-47a5-bcd8-99ec072bfcf9 service swift] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:33.141739 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393121dc-929f-47a5-bcd8-99ec072bfcf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:33.149160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393121dc-929f-47a5-bcd8-99ec072bfcf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:33.150747 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393121dc-929f-47a5-bcd8-99ec072bfcf9 service swift] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:33.154525 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2b8ff-01a4-4c53-bf9e-4cbedf30d70b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:33.156038 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2b8ff-01a4-4c53-bf9e-4cbedf30d70b service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:33.159267 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1252/2527] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 23 11:04:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 11:04:33.167801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1276/2528] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:04:33.771151 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64dac7-d1bd-4306-bd40-8b4f744d4f76 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:33.771710 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64dac7-d1bd-4306-bd40-8b4f744d4f76 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:33.771817 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64dac7-d1bd-4306-bd40-8b4f744d4f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:33.797333 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-3e64dac7-d1bd-4306-bd40-8b4f744d4f76 None None] MFA Rules not processed for user `1b03d940626a449dbe904f02f3d70854`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:33.798866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-3e64dac7-d1bd-4306-bd40-8b4f744d4f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:33.822578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1253/2529] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 23 11:04:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:33.837992 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2b8ff-01a4-4c53-bf9e-4cbedf30d70b service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:33.851656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2b8ff-01a4-4c53-bf9e-4cbedf30d70b service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:33.857483 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa736d82-a0fd-40a9-b082-0d90f43eb491 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a54fa1c326f41e88688404a56b75c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:33.858505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa736d82-a0fd-40a9-b082-0d90f43eb491 service swift] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:33.859113 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa736d82-a0fd-40a9-b082-0d90f43eb491 service swift] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:33.859584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa736d82-a0fd-40a9-b082-0d90f43eb491 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:33.869626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa736d82-a0fd-40a9-b082-0d90f43eb491 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:33.871321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa736d82-a0fd-40a9-b082-0d90f43eb491 service swift] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:33.880771 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1277/2530] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 23 11:04:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:04:34.427579 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad123066-f1c3-48ad-98d0-ff3631052ee4 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:34.427901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad123066-f1c3-48ad-98d0-ff3631052ee4 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:34.428188 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad123066-f1c3-48ad-98d0-ff3631052ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:34.455782 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-ad123066-f1c3-48ad-98d0-ff3631052ee4 None None] MFA Rules not processed for user `1b03d940626a449dbe904f02f3d70854`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:34.455782 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ad123066-f1c3-48ad-98d0-ff3631052ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:34.458133 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1254/2531] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jun 23 11:04:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:04:34.470592 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa736d82-a0fd-40a9-b082-0d90f43eb491 service swift] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:34.481186 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa736d82-a0fd-40a9-b082-0d90f43eb491 service swift] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:34.487384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5ed8b-9832-43f5-8d1a-c60219af345b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a54fa1c326f41e88688404a56b75c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:34.487384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5ed8b-9832-43f5-8d1a-c60219af345b service swift] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:34.487384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5ed8b-9832-43f5-8d1a-c60219af345b service swift] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:34.487679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5ed8b-9832-43f5-8d1a-c60219af345b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:34.496364 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5ed8b-9832-43f5-8d1a-c60219af345b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:34.498271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5ed8b-9832-43f5-8d1a-c60219af345b service swift] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:34.507144 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1278/2532] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 23 11:04:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:04:34.896741 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad123066-f1c3-48ad-98d0-ff3631052ee4 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:34.898139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ad123066-f1c3-48ad-98d0-ff3631052ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:34.910225 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad123066-f1c3-48ad-98d0-ff3631052ee4 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:34.914254 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b2414-9a90-4d35-aa3d-38ec480bcc1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:34.915175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b2414-9a90-4d35-aa3d-38ec480bcc1b service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:34.915518 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b2414-9a90-4d35-aa3d-38ec480bcc1b service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:34.915805 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b2414-9a90-4d35-aa3d-38ec480bcc1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:34.926686 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b2414-9a90-4d35-aa3d-38ec480bcc1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:34.928354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b2414-9a90-4d35-aa3d-38ec480bcc1b service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:34.945282 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1255/2533] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:36.989163 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5ed8b-9832-43f5-8d1a-c60219af345b service swift] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:36.990595 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-f0d5ed8b-9832-43f5-8d1a-c60219af345b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:37.021784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:37.057295 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5ed8b-9832-43f5-8d1a-c60219af345b service swift] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:37.061956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf885d6a-d870-4227-bc2a-d9bbd14cc493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:37.062774 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf885d6a-d870-4227-bc2a-d9bbd14cc493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:37.063092 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf885d6a-d870-4227-bc2a-d9bbd14cc493 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:37.063375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf885d6a-d870-4227-bc2a-d9bbd14cc493 admin admin] PATH_INFO: `/v3/users/0b7bef3e3d4543659486b417306b856e` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:37.064617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf885d6a-d870-4227-bc2a-d9bbd14cc493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b7bef3e3d4543659486b417306b856e)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:37.067238 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf885d6a-d870-4227-bc2a-d9bbd14cc493 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:37.281847 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b2414-9a90-4d35-aa3d-38ec480bcc1b service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:37.283291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-6e2b2414-9a90-4d35-aa3d-38ec480bcc1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:37.297275 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b2414-9a90-4d35-aa3d-38ec480bcc1b service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:37.301510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4734436-81cd-44cf-9287-2d28d8832bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:37.302416 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4734436-81cd-44cf-9287-2d28d8832bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:37.302729 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4734436-81cd-44cf-9287-2d28d8832bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:37.303573 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4734436-81cd-44cf-9287-2d28d8832bf2 admin admin] PATH_INFO: `/v3/users/f7e63509db9145baa02f889cea3bc7bf` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:37.304298 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4734436-81cd-44cf-9287-2d28d8832bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e63509db9145baa02f889cea3bc7bf)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:37.306360 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4734436-81cd-44cf-9287-2d28d8832bf2 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:37.325433 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-bf885d6a-d870-4227-bc2a-d9bbd14cc493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b7bef3e3d4543659486b417306b856e'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:37.333210 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-bf885d6a-d870-4227-bc2a-d9bbd14cc493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b7bef3e3d4543659486b417306b856e'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:37.425044 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-bf885d6a-d870-4227-bc2a-d9bbd14cc493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b7bef3e3d4543659486b417306b856e'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:37.426339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-bf885d6a-d870-4227-bc2a-d9bbd14cc493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b7bef3e3d4543659486b417306b856e'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:37.427021 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-bf885d6a-d870-4227-bc2a-d9bbd14cc493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b7bef3e3d4543659486b417306b856e'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:37.447620 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1279/2534] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:04:36 2022] DELETE /identity/v3/users/0b7bef3e3d4543659486b417306b856e => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:37.452109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901da556-4d7d-4726-8962-f399948d5b33 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:37.452345 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901da556-4d7d-4726-8962-f399948d5b33 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:37.452631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901da556-4d7d-4726-8962-f399948d5b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:37.472926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-901da556-4d7d-4726-8962-f399948d5b33 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:37.474168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-901da556-4d7d-4726-8962-f399948d5b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:37.536684 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1280/2535] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:04:37.546442 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901da556-4d7d-4726-8962-f399948d5b33 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:37.547898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-901da556-4d7d-4726-8962-f399948d5b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:37.553445 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c4734436-81cd-44cf-9287-2d28d8832bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e63509db9145baa02f889cea3bc7bf'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:37.560578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c4734436-81cd-44cf-9287-2d28d8832bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e63509db9145baa02f889cea3bc7bf'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:37.561301 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c4734436-81cd-44cf-9287-2d28d8832bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e63509db9145baa02f889cea3bc7bf'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:37.600534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:37.605713 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901da556-4d7d-4726-8962-f399948d5b33 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:37.609385 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c8e0b-e4ff-4739-a9e2-a506d7b78dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:37.610211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c8e0b-e4ff-4739-a9e2-a506d7b78dba service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:37.613568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c8e0b-e4ff-4739-a9e2-a506d7b78dba service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:37.613568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c8e0b-e4ff-4739-a9e2-a506d7b78dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:37.613568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-2d4c8e0b-e4ff-4739-a9e2-a506d7b78dba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:37.627426 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c8e0b-e4ff-4739-a9e2-a506d7b78dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:37.629427 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c8e0b-e4ff-4739-a9e2-a506d7b78dba service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:37.630898 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c4734436-81cd-44cf-9287-2d28d8832bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e63509db9145baa02f889cea3bc7bf'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:37.631512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c4734436-81cd-44cf-9287-2d28d8832bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e63509db9145baa02f889cea3bc7bf'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:37.639568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1281/2536] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:04:37.650285 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1256/2537] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:04:37 2022] DELETE /identity/v3/users/f7e63509db9145baa02f889cea3bc7bf => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:04:37.654848 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63c7e8-c361-4ccc-b625-522eafa149c5 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:37.655222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63c7e8-c361-4ccc-b625-522eafa149c5 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:37.655400 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63c7e8-c361-4ccc-b625-522eafa149c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:37.674256 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-ce63c7e8-c361-4ccc-b625-522eafa149c5 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:37.675462 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ce63c7e8-c361-4ccc-b625-522eafa149c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:37.735178 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1282/2538] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:37.744943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4734436-81cd-44cf-9287-2d28d8832bf2 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:37.746419 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c4734436-81cd-44cf-9287-2d28d8832bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:37.806022 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4734436-81cd-44cf-9287-2d28d8832bf2 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:37.809957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1593710-4451-4842-bc40-5fa0ed32f5f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:37.810627 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1593710-4451-4842-bc40-5fa0ed32f5f0 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:37.810912 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1593710-4451-4842-bc40-5fa0ed32f5f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:37.811189 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1593710-4451-4842-bc40-5fa0ed32f5f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:37.822075 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1593710-4451-4842-bc40-5fa0ed32f5f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:37.823560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1593710-4451-4842-bc40-5fa0ed32f5f0 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:37.835451 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1257/2539] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:38.217180 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63c7e8-c361-4ccc-b625-522eafa149c5 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:38.217180 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ce63c7e8-c361-4ccc-b625-522eafa149c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:38.217693 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1593710-4451-4842-bc40-5fa0ed32f5f0 service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:38.217693 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c1593710-4451-4842-bc40-5fa0ed32f5f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:38.228498 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63c7e8-c361-4ccc-b625-522eafa149c5 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:38.245838 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53114536-f97c-4cbf-a788-a7488489eba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:38.246733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53114536-f97c-4cbf-a788-a7488489eba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:38.247032 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53114536-f97c-4cbf-a788-a7488489eba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:38.247424 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53114536-f97c-4cbf-a788-a7488489eba7 admin admin] PATH_INFO: `/v3/projects/6a761286c8f3489e9ae70badda98cb16` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:38.250395 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1593710-4451-4842-bc40-5fa0ed32f5f0 service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:38.253317 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53114536-f97c-4cbf-a788-a7488489eba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a761286c8f3489e9ae70badda98cb16)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:38.255510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53114536-f97c-4cbf-a788-a7488489eba7 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:38.263503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2eb48-2c38-4701-8776-ac90368c8162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:38.264302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2eb48-2c38-4701-8776-ac90368c8162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:38.264592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2eb48-2c38-4701-8776-ac90368c8162 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:38.264940 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2eb48-2c38-4701-8776-ac90368c8162 admin admin] PATH_INFO: `/v3/projects/8013904717f445268610545e3d97214f` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:38.266174 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2eb48-2c38-4701-8776-ac90368c8162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8013904717f445268610545e3d97214f)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:38.268267 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2eb48-2c38-4701-8776-ac90368c8162 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:38.280398 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:38.468418 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-53114536-f97c-4cbf-a788-a7488489eba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a761286c8f3489e9ae70badda98cb16', 'request_id': 'req-53114536-f97c-4cbf-a788-a7488489eba7'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:38.471317 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-b2f2eb48-2c38-4701-8776-ac90368c8162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8013904717f445268610545e3d97214f', 'request_id': 'req-b2f2eb48-2c38-4701-8776-ac90368c8162'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:38.474951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-53114536-f97c-4cbf-a788-a7488489eba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a761286c8f3489e9ae70badda98cb16', 'request_id': 'req-53114536-f97c-4cbf-a788-a7488489eba7'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:38.562948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-b2f2eb48-2c38-4701-8776-ac90368c8162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8013904717f445268610545e3d97214f', 'request_id': 'req-b2f2eb48-2c38-4701-8776-ac90368c8162'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:38.570003 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-b2f2eb48-2c38-4701-8776-ac90368c8162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8013904717f445268610545e3d97214f', 'request_id': 'req-b2f2eb48-2c38-4701-8776-ac90368c8162'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:38.582993 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-b2f2eb48-2c38-4701-8776-ac90368c8162 admin admin] The token cache is being invalidate because project 8013904717f445268610545e3d97214f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:04:38.583389 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-b2f2eb48-2c38-4701-8776-ac90368c8162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:38.584058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-b2f2eb48-2c38-4701-8776-ac90368c8162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:38.585798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1258/2540] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:04:38 2022] DELETE /identity/v3/projects/8013904717f445268610545e3d97214f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:38.589593 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2eb48-2c38-4701-8776-ac90368c8162 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:38.590941 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-b2f2eb48-2c38-4701-8776-ac90368c8162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:38.647061 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-53114536-f97c-4cbf-a788-a7488489eba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a761286c8f3489e9ae70badda98cb16', 'request_id': 'req-53114536-f97c-4cbf-a788-a7488489eba7'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:38.658833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-53114536-f97c-4cbf-a788-a7488489eba7 admin admin] The token cache is being invalidate because project 6a761286c8f3489e9ae70badda98cb16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:04:38.659121 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-53114536-f97c-4cbf-a788-a7488489eba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:38.659770 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-53114536-f97c-4cbf-a788-a7488489eba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:38.661620 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1283/2541] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:04:38 2022] DELETE /identity/v3/projects/6a761286c8f3489e9ae70badda98cb16 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:38.666170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc3317-da55-4c3c-9b6d-48822ac3ac27 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:38.666588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc3317-da55-4c3c-9b6d-48822ac3ac27 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:38.666958 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc3317-da55-4c3c-9b6d-48822ac3ac27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:38.667513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2eb48-2c38-4701-8776-ac90368c8162 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:38.673022 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d795757-4791-43d6-b2f7-627b9bcd1298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:38.675186 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d795757-4791-43d6-b2f7-627b9bcd1298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:38.675873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d795757-4791-43d6-b2f7-627b9bcd1298 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:38.676256 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d795757-4791-43d6-b2f7-627b9bcd1298 admin admin] PATH_INFO: `/v3/users/cea22b2411f94e0099cb04985ceb980f` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:38.677622 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d795757-4791-43d6-b2f7-627b9bcd1298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea22b2411f94e0099cb04985ceb980f)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:38.679639 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d795757-4791-43d6-b2f7-627b9bcd1298 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:38.690261 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-b3bc3317-da55-4c3c-9b6d-48822ac3ac27 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:38.692390 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b3bc3317-da55-4c3c-9b6d-48822ac3ac27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:38.710474 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1284/2542] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:04:38.719714 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5767fa-f27c-41ca-bbeb-2e28bd045bb0 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:38.720200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5767fa-f27c-41ca-bbeb-2e28bd045bb0 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:38.720424 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5767fa-f27c-41ca-bbeb-2e28bd045bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:38.739297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-ca5767fa-f27c-41ca-bbeb-2e28bd045bb0 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:38.740162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ca5767fa-f27c-41ca-bbeb-2e28bd045bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:38.748702 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1285/2543] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:04:38.752822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5767fa-f27c-41ca-bbeb-2e28bd045bb0 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:38.762529 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5767fa-f27c-41ca-bbeb-2e28bd045bb0 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:38.767372 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d3fd1-83cd-41e8-ae52-30ad35642b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:38.768020 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d3fd1-83cd-41e8-ae52-30ad35642b24 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:38.768304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d3fd1-83cd-41e8-ae52-30ad35642b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:38.768583 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d3fd1-83cd-41e8-ae52-30ad35642b24 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:38.769975 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d3fd1-83cd-41e8-ae52-30ad35642b24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:04:38.770293 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d3fd1-83cd-41e8-ae52-30ad35642b24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:38.772104 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d3fd1-83cd-41e8-ae52-30ad35642b24 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:38.783936 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1286/2544] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:04:38.788419 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d3fd1-83cd-41e8-ae52-30ad35642b24 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:38.799136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d3fd1-83cd-41e8-ae52-30ad35642b24 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:38.804240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d740a97-3344-48d5-9aed-21138d15167b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:38.804933 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d740a97-3344-48d5-9aed-21138d15167b admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:38.805217 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d740a97-3344-48d5-9aed-21138d15167b admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:38.805493 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d740a97-3344-48d5-9aed-21138d15167b admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:38.806185 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d740a97-3344-48d5-9aed-21138d15167b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:38.808093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d740a97-3344-48d5-9aed-21138d15167b admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:38.886275 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-1d795757-4791-43d6-b2f7-627b9bcd1298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea22b2411f94e0099cb04985ceb980f'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:38.893439 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-1d795757-4791-43d6-b2f7-627b9bcd1298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea22b2411f94e0099cb04985ceb980f'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:38.894132 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-1d795757-4791-43d6-b2f7-627b9bcd1298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea22b2411f94e0099cb04985ceb980f'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:38.909291 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1287/2545] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:38 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:04:38.913672 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d740a97-3344-48d5-9aed-21138d15167b admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:38.915302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-5d740a97-3344-48d5-9aed-21138d15167b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:38.945386 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:38.978888 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-1d795757-4791-43d6-b2f7-627b9bcd1298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea22b2411f94e0099cb04985ceb980f'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:38.979846 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-1d795757-4791-43d6-b2f7-627b9bcd1298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea22b2411f94e0099cb04985ceb980f'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:38.983375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d740a97-3344-48d5-9aed-21138d15167b admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:38.989171 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af8c53-f604-4c7e-b351-8cb2dc5f2fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:38.990046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af8c53-f604-4c7e-b351-8cb2dc5f2fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:38.990338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af8c53-f604-4c7e-b351-8cb2dc5f2fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:38.990626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af8c53-f604-4c7e-b351-8cb2dc5f2fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:38.991495 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af8c53-f604-4c7e-b351-8cb2dc5f2fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:38.993479 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af8c53-f604-4c7e-b351-8cb2dc5f2fd8 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:39.006749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1259/2546] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:04:38 2022] DELETE /identity/v3/users/cea22b2411f94e0099cb04985ceb980f => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:04:39.075761 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1288/2547] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:38 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:04:39.077451 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d795757-4791-43d6-b2f7-627b9bcd1298 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:39.093122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:39.146135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d795757-4791-43d6-b2f7-627b9bcd1298 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:39.151139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f19929-0560-4198-b312-443eb3dd9616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:39.151824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f19929-0560-4198-b312-443eb3dd9616 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:39.156751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f19929-0560-4198-b312-443eb3dd9616 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:39.156751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f19929-0560-4198-b312-443eb3dd9616 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:39.156751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f19929-0560-4198-b312-443eb3dd9616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:39.156751 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f19929-0560-4198-b312-443eb3dd9616 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:39.168075 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1260/2548] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:04:39.172369 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af8c53-f604-4c7e-b351-8cb2dc5f2fd8 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:39.187872 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af8c53-f604-4c7e-b351-8cb2dc5f2fd8 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:39.198036 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dfa9f-50cc-4587-af0e-9c9871926b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:39.198732 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dfa9f-50cc-4587-af0e-9c9871926b63 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:39.199016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dfa9f-50cc-4587-af0e-9c9871926b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:39.199294 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dfa9f-50cc-4587-af0e-9c9871926b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:39.201931 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dfa9f-50cc-4587-af0e-9c9871926b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:39.203217 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dfa9f-50cc-4587-af0e-9c9871926b63 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:39.217151 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f19929-0560-4198-b312-443eb3dd9616 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:39.219133 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-02f19929-0560-4198-b312-443eb3dd9616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:39.220733 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1289/2549] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:39.222708 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dfa9f-50cc-4587-af0e-9c9871926b63 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:39.233665 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dfa9f-50cc-4587-af0e-9c9871926b63 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:39.240542 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f19929-0560-4198-b312-443eb3dd9616 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:39.247765 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111f8e2-041d-4c1a-ac13-6f40250c4eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:39.254811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111f8e2-041d-4c1a-ac13-6f40250c4eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:39.254811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111f8e2-041d-4c1a-ac13-6f40250c4eff admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:39.254811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111f8e2-041d-4c1a-ac13-6f40250c4eff admin admin] PATH_INFO: `/v3/users/22e8bb2717dd4633ab3a54dfab3ed956` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:39.254811 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111f8e2-041d-4c1a-ac13-6f40250c4eff admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e8bb2717dd4633ab3a54dfab3ed956)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:39.256059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f76a2d-7179-4009-812e-04945ed56d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:39.256480 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111f8e2-041d-4c1a-ac13-6f40250c4eff admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:39.257145 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f76a2d-7179-4009-812e-04945ed56d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:39.257432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f76a2d-7179-4009-812e-04945ed56d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:39.257755 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f76a2d-7179-4009-812e-04945ed56d16 admin admin] PATH_INFO: `/v3/projects/b1fb452952da4626b8811156dbb1e51b/users/8fa38ff2dae2460ea363f1c3448d533c/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:39.275792 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f76a2d-7179-4009-812e-04945ed56d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1fb452952da4626b8811156dbb1e51b, user_id=8fa38ff2dae2460ea363f1c3448d533c, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:39.279109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f76a2d-7179-4009-812e-04945ed56d16 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:39.369065 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1290/2550] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:39 2022] PUT /identity/v3/projects/b1fb452952da4626b8811156dbb1e51b/users/8fa38ff2dae2460ea363f1c3448d533c/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:39.374300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e597b-83b4-4651-99c1-ed34ef46f25c None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:39.374499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e597b-83b4-4651-99c1-ed34ef46f25c None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:39.374776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e597b-83b4-4651-99c1-ed34ef46f25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:39.393692 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-512e597b-83b4-4651-99c1-ed34ef46f25c None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:39.395104 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-512e597b-83b4-4651-99c1-ed34ef46f25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:39.461391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1291/2551] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:04:39.469067 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e597b-83b4-4651-99c1-ed34ef46f25c None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:39.470495 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-512e597b-83b4-4651-99c1-ed34ef46f25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:39.484885 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7111f8e2-041d-4c1a-ac13-6f40250c4eff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e8bb2717dd4633ab3a54dfab3ed956'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:39.492962 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7111f8e2-041d-4c1a-ac13-6f40250c4eff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e8bb2717dd4633ab3a54dfab3ed956'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:39.494050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7111f8e2-041d-4c1a-ac13-6f40250c4eff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e8bb2717dd4633ab3a54dfab3ed956'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:39.542902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e597b-83b4-4651-99c1-ed34ef46f25c None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:39.547125 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b06180-151e-4d8f-a221-ecc1189f3ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:39.547802 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b06180-151e-4d8f-a221-ecc1189f3ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:39.548119 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b06180-151e-4d8f-a221-ecc1189f3ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:39.548390 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b06180-151e-4d8f-a221-ecc1189f3ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:39.550366 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e7b06180-151e-4d8f-a221-ecc1189f3ad6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:39.562046 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7111f8e2-041d-4c1a-ac13-6f40250c4eff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e8bb2717dd4633ab3a54dfab3ed956'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:39.562755 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-7111f8e2-041d-4c1a-ac13-6f40250c4eff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e8bb2717dd4633ab3a54dfab3ed956'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:39.563240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b06180-151e-4d8f-a221-ecc1189f3ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:39.564774 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b06180-151e-4d8f-a221-ecc1189f3ad6 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:39.575554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1292/2552] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:39.583330 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1261/2553] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:04:39 2022] DELETE /identity/v3/users/22e8bb2717dd4633ab3a54dfab3ed956 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:04:39.587846 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a38322-43ae-40d7-93cd-c377eb5a9df0 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:39.588422 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a38322-43ae-40d7-93cd-c377eb5a9df0 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:39.588744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a38322-43ae-40d7-93cd-c377eb5a9df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:39.601651 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111f8e2-041d-4c1a-ac13-6f40250c4eff admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:39.603698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-7111f8e2-041d-4c1a-ac13-6f40250c4eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:39.607451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-37a38322-43ae-40d7-93cd-c377eb5a9df0 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:39.614899 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-37a38322-43ae-40d7-93cd-c377eb5a9df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:39.632422 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:39.716495 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1293/2554] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:39.724309 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111f8e2-041d-4c1a-ac13-6f40250c4eff admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:39.728127 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a38322-43ae-40d7-93cd-c377eb5a9df0 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:39.729943 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-37a38322-43ae-40d7-93cd-c377eb5a9df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:39.739686 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a26c28-a5ae-4978-9891-8cecabe8515f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:39.741656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a26c28-a5ae-4978-9891-8cecabe8515f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:39.741943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a26c28-a5ae-4978-9891-8cecabe8515f admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:39.742220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a26c28-a5ae-4978-9891-8cecabe8515f admin admin] PATH_INFO: `/v3/projects/403e3cc9becc4fad883a6d22318bc1c7` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:39.747196 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a26c28-a5ae-4978-9891-8cecabe8515f admin admin] RBAC: Authorizing `identity:delete_project(project_id=403e3cc9becc4fad883a6d22318bc1c7)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:39.752675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a26c28-a5ae-4978-9891-8cecabe8515f admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:39.850544 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a38322-43ae-40d7-93cd-c377eb5a9df0 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:39.856399 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443c29f-9fd9-415b-ab13-8333569bc42d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:39.858165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443c29f-9fd9-415b-ab13-8333569bc42d service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:39.858165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443c29f-9fd9-415b-ab13-8333569bc42d service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:39.858165 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443c29f-9fd9-415b-ab13-8333569bc42d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:39.871200 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443c29f-9fd9-415b-ab13-8333569bc42d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:39.891255 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443c29f-9fd9-415b-ab13-8333569bc42d service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:39.915612 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1294/2555] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:39.929113 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:39.964711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c3a26c28-a5ae-4978-9891-8cecabe8515f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '403e3cc9becc4fad883a6d22318bc1c7', 'request_id': 'req-c3a26c28-a5ae-4978-9891-8cecabe8515f'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:40.042901 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c3a26c28-a5ae-4978-9891-8cecabe8515f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '403e3cc9becc4fad883a6d22318bc1c7', 'request_id': 'req-c3a26c28-a5ae-4978-9891-8cecabe8515f'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:40.057510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c3a26c28-a5ae-4978-9891-8cecabe8515f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '403e3cc9becc4fad883a6d22318bc1c7', 'request_id': 'req-c3a26c28-a5ae-4978-9891-8cecabe8515f'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:40.078304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c3a26c28-a5ae-4978-9891-8cecabe8515f admin admin] The token cache is being invalidate because project 403e3cc9becc4fad883a6d22318bc1c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:04:40.078719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c3a26c28-a5ae-4978-9891-8cecabe8515f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:40.079494 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c3a26c28-a5ae-4978-9891-8cecabe8515f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:40.082614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1262/2556] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:04:39 2022] DELETE /identity/v3/projects/403e3cc9becc4fad883a6d22318bc1c7 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:04:40.086816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e2125-e1c7-4ef7-8998-28143c422f54 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:40.087127 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e2125-e1c7-4ef7-8998-28143c422f54 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:40.087405 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e2125-e1c7-4ef7-8998-28143c422f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:40.107596 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-df7e2125-e1c7-4ef7-8998-28143c422f54 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:40.108906 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-df7e2125-e1c7-4ef7-8998-28143c422f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:40.175923 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1295/2557] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:40.185970 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d62103-7a2d-4eb6-b140-b903f43addde None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:40.186217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d62103-7a2d-4eb6-b140-b903f43addde None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:40.186502 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d62103-7a2d-4eb6-b140-b903f43addde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:40.220350 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-57d62103-7a2d-4eb6-b140-b903f43addde None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:40.221624 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-57d62103-7a2d-4eb6-b140-b903f43addde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:40.231204 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1263/2558] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:40.235547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e2125-e1c7-4ef7-8998-28143c422f54 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:40.248228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e2125-e1c7-4ef7-8998-28143c422f54 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:40.255600 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7a991-cbf3-4c3c-94a5-965bb1ac0f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:40.258595 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7a991-cbf3-4c3c-94a5-965bb1ac0f71 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:40.258595 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7a991-cbf3-4c3c-94a5-965bb1ac0f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:40.258595 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7a991-cbf3-4c3c-94a5-965bb1ac0f71 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:40.258595 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7a991-cbf3-4c3c-94a5-965bb1ac0f71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:04:40.258595 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7a991-cbf3-4c3c-94a5-965bb1ac0f71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:40.261256 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7a991-cbf3-4c3c-94a5-965bb1ac0f71 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:40.283533 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1296/2559] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:04:40.285632 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d62103-7a2d-4eb6-b140-b903f43addde None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:40.296094 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d62103-7a2d-4eb6-b140-b903f43addde None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:40.302666 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534451f-a713-401b-bdaa-71c38bda1d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:40.303636 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534451f-a713-401b-bdaa-71c38bda1d4e admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:40.303636 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534451f-a713-401b-bdaa-71c38bda1d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:40.303921 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534451f-a713-401b-bdaa-71c38bda1d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:40.304618 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534451f-a713-401b-bdaa-71c38bda1d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:40.306591 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534451f-a713-401b-bdaa-71c38bda1d4e admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:40.422019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1264/2560] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:40 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:40.427010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7a991-cbf3-4c3c-94a5-965bb1ac0f71 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:40.437359 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7a991-cbf3-4c3c-94a5-965bb1ac0f71 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:40.491127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534451f-a713-401b-bdaa-71c38bda1d4e admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:40.492956 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-d534451f-a713-401b-bdaa-71c38bda1d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:40.507983 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:40.521524 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763e42d-4d3c-4fbb-89a5-20b7a7669b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:40.522205 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763e42d-4d3c-4fbb-89a5-20b7a7669b5e admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:40.522495 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763e42d-4d3c-4fbb-89a5-20b7a7669b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:40.522773 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763e42d-4d3c-4fbb-89a5-20b7a7669b5e admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:40.523467 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763e42d-4d3c-4fbb-89a5-20b7a7669b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:40.525460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763e42d-4d3c-4fbb-89a5-20b7a7669b5e admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:40.590490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534451f-a713-401b-bdaa-71c38bda1d4e admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:40.596799 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a784ccb-6e81-4462-9eee-49689f38ce72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:40.597865 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a784ccb-6e81-4462-9eee-49689f38ce72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:40.599194 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a784ccb-6e81-4462-9eee-49689f38ce72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:40.599659 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a784ccb-6e81-4462-9eee-49689f38ce72 admin admin] PATH_INFO: `/v3/projects/0fc9b7d7c4d24f32ae52fb45cd84e320` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:40.601226 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a784ccb-6e81-4462-9eee-49689f38ce72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc9b7d7c4d24f32ae52fb45cd84e320)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:40.603822 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a784ccb-6e81-4462-9eee-49689f38ce72 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:40.640244 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1297/2561] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:40 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:40.646867 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763e42d-4d3c-4fbb-89a5-20b7a7669b5e admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:40.660890 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763e42d-4d3c-4fbb-89a5-20b7a7669b5e admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:40.667898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8c81b-7cf5-466e-8713-a6fc81c7622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:40.669356 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8c81b-7cf5-466e-8713-a6fc81c7622d admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:40.670043 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8c81b-7cf5-466e-8713-a6fc81c7622d admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:40.670216 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8c81b-7cf5-466e-8713-a6fc81c7622d admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:40.671147 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8c81b-7cf5-466e-8713-a6fc81c7622d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:40.672875 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8c81b-7cf5-466e-8713-a6fc81c7622d admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:40.692281 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1298/2562] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:40.696904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8c81b-7cf5-466e-8713-a6fc81c7622d admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:40.708507 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8c81b-7cf5-466e-8713-a6fc81c7622d admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:40.718489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1352d2f-dda4-4f2d-a5b0-0dddc09e9a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:40.719516 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1352d2f-dda4-4f2d-a5b0-0dddc09e9a5b admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:40.719883 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1352d2f-dda4-4f2d-a5b0-0dddc09e9a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:40.720233 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1352d2f-dda4-4f2d-a5b0-0dddc09e9a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:40.721093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1352d2f-dda4-4f2d-a5b0-0dddc09e9a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:40.723129 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1352d2f-dda4-4f2d-a5b0-0dddc09e9a5b admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:40.735133 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1299/2563] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:04:40.739898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1352d2f-dda4-4f2d-a5b0-0dddc09e9a5b admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:40.751504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1352d2f-dda4-4f2d-a5b0-0dddc09e9a5b admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:40.764565 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8a784ccb-6e81-4462-9eee-49689f38ce72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc9b7d7c4d24f32ae52fb45cd84e320', 'request_id': 'req-8a784ccb-6e81-4462-9eee-49689f38ce72'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:40.822879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e8cf5-1c5e-4f67-858b-4657bbeb7a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:40.823785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e8cf5-1c5e-4f67-858b-4657bbeb7a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:40.824070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e8cf5-1c5e-4f67-858b-4657bbeb7a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:40.824445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e8cf5-1c5e-4f67-858b-4657bbeb7a31 admin admin] PATH_INFO: `/v3/projects/e6fe7cafc3524db3a40e0ae66a7f20c6/users/9a9601b0da6d49998ead7ae1a6c04487/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:40.843263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e8cf5-1c5e-4f67-858b-4657bbeb7a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6fe7cafc3524db3a40e0ae66a7f20c6, user_id=9a9601b0da6d49998ead7ae1a6c04487, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:40.846081 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e8cf5-1c5e-4f67-858b-4657bbeb7a31 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:40.865980 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8a784ccb-6e81-4462-9eee-49689f38ce72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc9b7d7c4d24f32ae52fb45cd84e320', 'request_id': 'req-8a784ccb-6e81-4462-9eee-49689f38ce72'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:40.873830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8a784ccb-6e81-4462-9eee-49689f38ce72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc9b7d7c4d24f32ae52fb45cd84e320', 'request_id': 'req-8a784ccb-6e81-4462-9eee-49689f38ce72'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:40.889454 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8a784ccb-6e81-4462-9eee-49689f38ce72 admin admin] The token cache is being invalidate because project 0fc9b7d7c4d24f32ae52fb45cd84e320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:04:40.889748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8a784ccb-6e81-4462-9eee-49689f38ce72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:40.890438 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8a784ccb-6e81-4462-9eee-49689f38ce72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:40.892063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1265/2564] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:04:40 2022] DELETE /identity/v3/projects/0fc9b7d7c4d24f32ae52fb45cd84e320 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:40.896180 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a784ccb-6e81-4462-9eee-49689f38ce72 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:40.899562 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8a784ccb-6e81-4462-9eee-49689f38ce72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:40.911024 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a784ccb-6e81-4462-9eee-49689f38ce72 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:40.916407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb394a-d155-4dde-ad92-a8f99113651b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:40.917568 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb394a-d155-4dde-ad92-a8f99113651b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:40.917568 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb394a-d155-4dde-ad92-a8f99113651b admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:40.918037 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb394a-d155-4dde-ad92-a8f99113651b admin admin] PATH_INFO: `/v3/users/ac46f8d5f98b488db404fafedec4a824` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:40.919521 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb394a-d155-4dde-ad92-a8f99113651b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac46f8d5f98b488db404fafedec4a824)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:40.921684 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb394a-d155-4dde-ad92-a8f99113651b admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:40.960987 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1300/2565] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:40 2022] PUT /identity/v3/projects/e6fe7cafc3524db3a40e0ae66a7f20c6/users/9a9601b0da6d49998ead7ae1a6c04487/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:04:40.971415 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b12bb-db5c-45ae-afa7-5b72a3dd3147 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:40.971932 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b12bb-db5c-45ae-afa7-5b72a3dd3147 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:40.972827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b12bb-db5c-45ae-afa7-5b72a3dd3147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:40.976819 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:41.005011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-aa2b12bb-db5c-45ae-afa7-5b72a3dd3147 None None] MFA Rules not processed for user `9a9601b0da6d49998ead7ae1a6c04487`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:41.006189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-aa2b12bb-db5c-45ae-afa7-5b72a3dd3147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:41.074969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1301/2566] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:04:41.079199 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b12bb-db5c-45ae-afa7-5b72a3dd3147 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:41.080769 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-aa2b12bb-db5c-45ae-afa7-5b72a3dd3147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:41.132222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-51cb394a-d155-4dde-ad92-a8f99113651b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac46f8d5f98b488db404fafedec4a824'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:41.140543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-51cb394a-d155-4dde-ad92-a8f99113651b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac46f8d5f98b488db404fafedec4a824'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:41.141503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-51cb394a-d155-4dde-ad92-a8f99113651b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac46f8d5f98b488db404fafedec4a824'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:41.145599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:41.188825 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b12bb-db5c-45ae-afa7-5b72a3dd3147 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:41.194693 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172f551-98bb-4629-8044-acfdcb118f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:41.195381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172f551-98bb-4629-8044-acfdcb118f38 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:41.197982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172f551-98bb-4629-8044-acfdcb118f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:41.197982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172f551-98bb-4629-8044-acfdcb118f38 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:41.197982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172f551-98bb-4629-8044-acfdcb118f38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:41.202939 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172f551-98bb-4629-8044-acfdcb118f38 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:41.219281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-51cb394a-d155-4dde-ad92-a8f99113651b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac46f8d5f98b488db404fafedec4a824'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:41.219880 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-51cb394a-d155-4dde-ad92-a8f99113651b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac46f8d5f98b488db404fafedec4a824'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:41.243160 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1266/2567] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:04:40 2022] DELETE /identity/v3/users/ac46f8d5f98b488db404fafedec4a824 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:04:41.392234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1302/2568] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:41 2022] POST /identity/v3/projects => generated 379 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:04:41.396934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb394a-d155-4dde-ad92-a8f99113651b admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:41.398960 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-51cb394a-d155-4dde-ad92-a8f99113651b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:41.489938 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb394a-d155-4dde-ad92-a8f99113651b admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:41.607039 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efdde1-211d-4b3d-92b8-7a54bcecdb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:41.607799 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efdde1-211d-4b3d-92b8-7a54bcecdb56 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:41.608082 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efdde1-211d-4b3d-92b8-7a54bcecdb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:41.608369 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efdde1-211d-4b3d-92b8-7a54bcecdb56 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:41.609348 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efdde1-211d-4b3d-92b8-7a54bcecdb56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:41.613941 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efdde1-211d-4b3d-92b8-7a54bcecdb56 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:41.746788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1267/2569] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:41 2022] POST /identity/v3/users => generated 296 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:41.751242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172f551-98bb-4629-8044-acfdcb118f38 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:41.762297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172f551-98bb-4629-8044-acfdcb118f38 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:41.767872 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268a0e8-c5bc-48a2-bbd0-c6013a2805ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:41.769314 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268a0e8-c5bc-48a2-bbd0-c6013a2805ac admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:41.770304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268a0e8-c5bc-48a2-bbd0-c6013a2805ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:41.770884 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268a0e8-c5bc-48a2-bbd0-c6013a2805ac admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:41.771677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268a0e8-c5bc-48a2-bbd0-c6013a2805ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:41.773426 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268a0e8-c5bc-48a2-bbd0-c6013a2805ac admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:41.788689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1303/2570] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:41.790507 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efdde1-211d-4b3d-92b8-7a54bcecdb56 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:41.806798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efdde1-211d-4b3d-92b8-7a54bcecdb56 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:41.812684 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5d63e-fab5-40ae-b913-88748123b940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:41.813821 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5d63e-fab5-40ae-b913-88748123b940 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:41.814510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5d63e-fab5-40ae-b913-88748123b940 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:41.815104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5d63e-fab5-40ae-b913-88748123b940 admin admin] PATH_INFO: `/v3/projects/d3e26b8dfa964f0ebe585b1b14d0b39f/users/8d7e172f300a4cfbad7e1b64cb4621ea/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:41.837260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5d63e-fab5-40ae-b913-88748123b940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e26b8dfa964f0ebe585b1b14d0b39f, user_id=8d7e172f300a4cfbad7e1b64cb4621ea, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:41.843071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5d63e-fab5-40ae-b913-88748123b940 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:41.844144 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268a0e8-c5bc-48a2-bbd0-c6013a2805ac admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:41.846068 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c268a0e8-c5bc-48a2-bbd0-c6013a2805ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:41.865234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268a0e8-c5bc-48a2-bbd0-c6013a2805ac admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:41.871071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53537a9-3809-40ae-bcd1-538f17dc7492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:41.872026 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53537a9-3809-40ae-bcd1-538f17dc7492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:41.872313 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53537a9-3809-40ae-bcd1-538f17dc7492 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:41.872665 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53537a9-3809-40ae-bcd1-538f17dc7492 admin admin] PATH_INFO: `/v3/projects/a4d31d14c83f43d3b2f78962a5956c35` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:41.873925 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53537a9-3809-40ae-bcd1-538f17dc7492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4d31d14c83f43d3b2f78962a5956c35)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:41.876046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53537a9-3809-40ae-bcd1-538f17dc7492 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:41.924037 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1268/2571] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:41 2022] PUT /identity/v3/projects/d3e26b8dfa964f0ebe585b1b14d0b39f/users/8d7e172f300a4cfbad7e1b64cb4621ea/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:41.928380 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5d63e-fab5-40ae-b913-88748123b940 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:42.024008 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5d63e-fab5-40ae-b913-88748123b940 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:42.028937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff678037-8d24-46ea-ada1-7d2f1b331db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:42.030126 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff678037-8d24-46ea-ada1-7d2f1b331db5 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:42.030490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff678037-8d24-46ea-ada1-7d2f1b331db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:42.030851 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff678037-8d24-46ea-ada1-7d2f1b331db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:42.031850 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff678037-8d24-46ea-ada1-7d2f1b331db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:42.033644 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff678037-8d24-46ea-ada1-7d2f1b331db5 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:42.044620 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c53537a9-3809-40ae-bcd1-538f17dc7492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4d31d14c83f43d3b2f78962a5956c35', 'request_id': 'req-c53537a9-3809-40ae-bcd1-538f17dc7492'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:42.047887 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1269/2572] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:04:42.050944 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c53537a9-3809-40ae-bcd1-538f17dc7492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4d31d14c83f43d3b2f78962a5956c35', 'request_id': 'req-c53537a9-3809-40ae-bcd1-538f17dc7492'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:42.053613 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff678037-8d24-46ea-ada1-7d2f1b331db5 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:42.064719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff678037-8d24-46ea-ada1-7d2f1b331db5 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:42.133717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c53537a9-3809-40ae-bcd1-538f17dc7492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4d31d14c83f43d3b2f78962a5956c35', 'request_id': 'req-c53537a9-3809-40ae-bcd1-538f17dc7492'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:42.150833 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c53537a9-3809-40ae-bcd1-538f17dc7492 admin admin] The token cache is being invalidate because project a4d31d14c83f43d3b2f78962a5956c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:04:42.152306 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c53537a9-3809-40ae-bcd1-538f17dc7492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:42.154084 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c53537a9-3809-40ae-bcd1-538f17dc7492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:42.156519 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1304/2573] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:04:41 2022] DELETE /identity/v3/projects/a4d31d14c83f43d3b2f78962a5956c35 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:04:42.162948 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9b3b1-4120-453f-ae89-760552c5c212 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:42.163248 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9b3b1-4120-453f-ae89-760552c5c212 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:42.163540 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9b3b1-4120-453f-ae89-760552c5c212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:42.170507 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235197d4-49f0-4a6a-bc4c-2b8707588952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:42.171607 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235197d4-49f0-4a6a-bc4c-2b8707588952 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:42.171926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235197d4-49f0-4a6a-bc4c-2b8707588952 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:42.172193 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235197d4-49f0-4a6a-bc4c-2b8707588952 admin admin] PATH_INFO: `/v3/projects/d3e26b8dfa964f0ebe585b1b14d0b39f/users/8d7e172f300a4cfbad7e1b64cb4621ea/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:42.177110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235197d4-49f0-4a6a-bc4c-2b8707588952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e26b8dfa964f0ebe585b1b14d0b39f, user_id=8d7e172f300a4cfbad7e1b64cb4621ea, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:42.180007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235197d4-49f0-4a6a-bc4c-2b8707588952 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:42.198898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-c5b9b3b1-4120-453f-ae89-760552c5c212 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:42.202445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c5b9b3b1-4120-453f-ae89-760552c5c212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:42.207278 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1270/2574] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:42 2022] PUT /identity/v3/projects/d3e26b8dfa964f0ebe585b1b14d0b39f/users/8d7e172f300a4cfbad7e1b64cb4621ea/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:42.218281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dc8da-1d81-4ca1-82fd-6a2309fc05c9 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:42.218580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dc8da-1d81-4ca1-82fd-6a2309fc05c9 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:42.218866 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dc8da-1d81-4ca1-82fd-6a2309fc05c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:42.257721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-4d2dc8da-1d81-4ca1-82fd-6a2309fc05c9 None None] MFA Rules not processed for user `8d7e172f300a4cfbad7e1b64cb4621ea`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:42.259117 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4d2dc8da-1d81-4ca1-82fd-6a2309fc05c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:42.291343 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1305/2575] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:42.300537 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd96e98-d770-4260-8119-2294a478ce8e None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:42.300791 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd96e98-d770-4260-8119-2294a478ce8e None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:42.301227 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd96e98-d770-4260-8119-2294a478ce8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:42.323830 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-6dd96e98-d770-4260-8119-2294a478ce8e None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:42.325106 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6dd96e98-d770-4260-8119-2294a478ce8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:42.342568 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1306/2576] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:42.343491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd96e98-d770-4260-8119-2294a478ce8e None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:42.358051 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd96e98-d770-4260-8119-2294a478ce8e None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:42.366680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef1b9b-4c3b-4001-a224-e27f9a357f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:42.367418 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef1b9b-4c3b-4001-a224-e27f9a357f0c admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:42.367740 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef1b9b-4c3b-4001-a224-e27f9a357f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:42.368024 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef1b9b-4c3b-4001-a224-e27f9a357f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:42.368948 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef1b9b-4c3b-4001-a224-e27f9a357f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:04:42.369274 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef1b9b-4c3b-4001-a224-e27f9a357f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:42.371853 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef1b9b-4c3b-4001-a224-e27f9a357f0c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:42.374814 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1271/2577] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:42.386258 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dc8da-1d81-4ca1-82fd-6a2309fc05c9 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:42.387900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4d2dc8da-1d81-4ca1-82fd-6a2309fc05c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:42.388407 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1307/2578] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:04:42.392525 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef1b9b-4c3b-4001-a224-e27f9a357f0c admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:42.409632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef1b9b-4c3b-4001-a224-e27f9a357f0c admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:42.423429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf34a3a-7478-4e3c-971b-2fb734d899bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:42.426392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf34a3a-7478-4e3c-971b-2fb734d899bc admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:42.426962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf34a3a-7478-4e3c-971b-2fb734d899bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:42.427410 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf34a3a-7478-4e3c-971b-2fb734d899bc admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:42.428958 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf34a3a-7478-4e3c-971b-2fb734d899bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:42.431883 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf34a3a-7478-4e3c-971b-2fb734d899bc admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:42.502510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dc8da-1d81-4ca1-82fd-6a2309fc05c9 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:42.507454 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7042f-6423-43d4-a3b5-267cad01435f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:42.508141 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7042f-6423-43d4-a3b5-267cad01435f service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:42.508429 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7042f-6423-43d4-a3b5-267cad01435f service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:42.508789 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7042f-6423-43d4-a3b5-267cad01435f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:42.524982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7042f-6423-43d4-a3b5-267cad01435f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:42.527235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7042f-6423-43d4-a3b5-267cad01435f service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:42.538047 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1272/2579] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:42 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:04:42.550235 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1308/2580] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:42 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:42.551465 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7042f-6423-43d4-a3b5-267cad01435f service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:42.567402 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7042f-6423-43d4-a3b5-267cad01435f service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:42.648347 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b263a-3d8f-4a01-bfb5-82d39af52f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:42.649069 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b263a-3d8f-4a01-bfb5-82d39af52f0b admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:42.649342 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b263a-3d8f-4a01-bfb5-82d39af52f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:42.649618 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b263a-3d8f-4a01-bfb5-82d39af52f0b admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:42.650312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b263a-3d8f-4a01-bfb5-82d39af52f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:42.652371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b263a-3d8f-4a01-bfb5-82d39af52f0b admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:42.722447 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:42.764291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1273/2581] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:42 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:42.774544 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf34a3a-7478-4e3c-971b-2fb734d899bc admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:42.786131 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf34a3a-7478-4e3c-971b-2fb734d899bc admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:42.791990 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c879a-8d0c-4f28-85c7-c70313be1908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:42.792709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c879a-8d0c-4f28-85c7-c70313be1908 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:42.793182 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c879a-8d0c-4f28-85c7-c70313be1908 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:42.793464 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c879a-8d0c-4f28-85c7-c70313be1908 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:42.794308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c879a-8d0c-4f28-85c7-c70313be1908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:42.795794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c879a-8d0c-4f28-85c7-c70313be1908 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:42.808686 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1309/2582] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:42.811258 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b263a-3d8f-4a01-bfb5-82d39af52f0b admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:42.823493 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b263a-3d8f-4a01-bfb5-82d39af52f0b admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:42.830041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e751e5c-1304-425f-9da1-a97e381a640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:42.830041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e751e5c-1304-425f-9da1-a97e381a640c admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:42.830041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e751e5c-1304-425f-9da1-a97e381a640c admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:42.830041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e751e5c-1304-425f-9da1-a97e381a640c admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:42.830467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e751e5c-1304-425f-9da1-a97e381a640c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:42.832385 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e751e5c-1304-425f-9da1-a97e381a640c admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:42.843391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1274/2583] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:42.847737 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c879a-8d0c-4f28-85c7-c70313be1908 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:42.863834 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c879a-8d0c-4f28-85c7-c70313be1908 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:42.868524 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbd681-53a9-4f61-bf6a-c6e32ebf714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:42.869541 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbd681-53a9-4f61-bf6a-c6e32ebf714e admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:42.869814 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbd681-53a9-4f61-bf6a-c6e32ebf714e admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:42.870098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbd681-53a9-4f61-bf6a-c6e32ebf714e admin admin] PATH_INFO: `/v3/projects/fec9aa0032884843b26724e9fa5e11ad/users/258a4f3e320549a08fb239028cab0ba7/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:42.893855 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcbd681-53a9-4f61-bf6a-c6e32ebf714e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec9aa0032884843b26724e9fa5e11ad, user_id=258a4f3e320549a08fb239028cab0ba7, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:42.896853 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcbd681-53a9-4f61-bf6a-c6e32ebf714e admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:43.009651 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1310/2584] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:42 2022] PUT /identity/v3/projects/fec9aa0032884843b26724e9fa5e11ad/users/258a4f3e320549a08fb239028cab0ba7/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:43.022076 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55d454-99af-44a5-83ab-068cc369f16e None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:43.022465 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55d454-99af-44a5-83ab-068cc369f16e None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:43.022963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55d454-99af-44a5-83ab-068cc369f16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:43.054398 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-fb55d454-99af-44a5-83ab-068cc369f16e None None] MFA Rules not processed for user `258a4f3e320549a08fb239028cab0ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:43.059089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-fb55d454-99af-44a5-83ab-068cc369f16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:43.074569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbd681-53a9-4f61-bf6a-c6e32ebf714e admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:43.076278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-efcbd681-53a9-4f61-bf6a-c6e32ebf714e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:43.146582 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:43.150789 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1275/2585] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:43.155644 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55d454-99af-44a5-83ab-068cc369f16e None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:43.167854 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbd681-53a9-4f61-bf6a-c6e32ebf714e admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:43.174287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55d454-99af-44a5-83ab-068cc369f16e None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:43.179641 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e28c05-bfb1-440e-a923-5d91ddf2ce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:43.180662 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e28c05-bfb1-440e-a923-5d91ddf2ce4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:43.180960 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e28c05-bfb1-440e-a923-5d91ddf2ce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:43.181242 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e28c05-bfb1-440e-a923-5d91ddf2ce4f admin admin] PATH_INFO: `/v3/users/9a9601b0da6d49998ead7ae1a6c04487` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:43.182572 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070c083-3ae2-4464-a32b-d98054bf64b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:43.182705 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e28c05-bfb1-440e-a923-5d91ddf2ce4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a9601b0da6d49998ead7ae1a6c04487)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:43.184109 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070c083-3ae2-4464-a32b-d98054bf64b5 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:43.184483 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070c083-3ae2-4464-a32b-d98054bf64b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:43.184758 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e28c05-bfb1-440e-a923-5d91ddf2ce4f admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:43.184891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070c083-3ae2-4464-a32b-d98054bf64b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:43.186159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070c083-3ae2-4464-a32b-d98054bf64b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:43.188745 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070c083-3ae2-4464-a32b-d98054bf64b5 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:43.303636 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1276/2586] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:43 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:43.307992 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070c083-3ae2-4464-a32b-d98054bf64b5 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:43.337571 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-10e28c05-bfb1-440e-a923-5d91ddf2ce4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a9601b0da6d49998ead7ae1a6c04487'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:43.346887 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-10e28c05-bfb1-440e-a923-5d91ddf2ce4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a9601b0da6d49998ead7ae1a6c04487'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:43.390632 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070c083-3ae2-4464-a32b-d98054bf64b5 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:43.397096 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d1e16-3a58-4015-9a49-facb05766809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:43.398110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d1e16-3a58-4015-9a49-facb05766809 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:43.398564 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d1e16-3a58-4015-9a49-facb05766809 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:43.398869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d1e16-3a58-4015-9a49-facb05766809 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:43.399981 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d1e16-3a58-4015-9a49-facb05766809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:43.402412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d1e16-3a58-4015-9a49-facb05766809 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:43.432554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-10e28c05-bfb1-440e-a923-5d91ddf2ce4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a9601b0da6d49998ead7ae1a6c04487'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:43.433541 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-10e28c05-bfb1-440e-a923-5d91ddf2ce4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a9601b0da6d49998ead7ae1a6c04487'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:43.434518 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-10e28c05-bfb1-440e-a923-5d91ddf2ce4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a9601b0da6d49998ead7ae1a6c04487'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:43.459736 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1277/2587] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:43 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:43.464688 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d1e16-3a58-4015-9a49-facb05766809 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:43.466781 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-926d1e16-3a58-4015-9a49-facb05766809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:43.477723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1311/2588] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:04:43 2022] DELETE /identity/v3/users/9a9601b0da6d49998ead7ae1a6c04487 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:04:43.484364 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641f0d2-c2c7-418b-8676-f74609d9665d None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:43.484744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641f0d2-c2c7-418b-8676-f74609d9665d None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:43.485037 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641f0d2-c2c7-418b-8676-f74609d9665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:43.508405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d1e16-3a58-4015-9a49-facb05766809 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:43.508989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-b641f0d2-c2c7-418b-8676-f74609d9665d None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:43.511122 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b641f0d2-c2c7-418b-8676-f74609d9665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:43.622080 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b652e-9a9f-48ed-98a1-7fa224751825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:43.623223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b652e-9a9f-48ed-98a1-7fa224751825 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:43.624748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b652e-9a9f-48ed-98a1-7fa224751825 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:43.629405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b652e-9a9f-48ed-98a1-7fa224751825 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:43.629405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b652e-9a9f-48ed-98a1-7fa224751825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:43.629623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1312/2589] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:04:43.629707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b652e-9a9f-48ed-98a1-7fa224751825 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:43.638259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641f0d2-c2c7-418b-8676-f74609d9665d None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:43.640055 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b641f0d2-c2c7-418b-8676-f74609d9665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:43.647602 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1278/2590] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:43.652195 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b652e-9a9f-48ed-98a1-7fa224751825 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:43.667173 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b652e-9a9f-48ed-98a1-7fa224751825 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:43.671527 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d1f9b-39d1-4299-8730-864a17599f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:43.672287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d1f9b-39d1-4299-8730-864a17599f55 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:43.672761 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d1f9b-39d1-4299-8730-864a17599f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:43.673116 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d1f9b-39d1-4299-8730-864a17599f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:43.674101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d1f9b-39d1-4299-8730-864a17599f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:43.678278 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d1f9b-39d1-4299-8730-864a17599f55 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:43.693072 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1279/2591] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:04:43.702822 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d1f9b-39d1-4299-8730-864a17599f55 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:43.717641 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d1f9b-39d1-4299-8730-864a17599f55 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:43.724253 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509698f3-06fd-476f-b914-5adce785569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:43.725733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509698f3-06fd-476f-b914-5adce785569e admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:43.726136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509698f3-06fd-476f-b914-5adce785569e admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:43.726541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509698f3-06fd-476f-b914-5adce785569e admin admin] PATH_INFO: `/v3/projects/c0805d4e718f46beb2c0cacdfbd721c0/users/efb18b0bc2fd42d18157748ed822663d/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:43.759705 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509698f3-06fd-476f-b914-5adce785569e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0805d4e718f46beb2c0cacdfbd721c0, user_id=efb18b0bc2fd42d18157748ed822663d, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:43.768498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509698f3-06fd-476f-b914-5adce785569e admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:43.771175 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641f0d2-c2c7-418b-8676-f74609d9665d None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:43.775300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3202f9b-f939-430e-abb1-3ab2fe807e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:43.776029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3202f9b-f939-430e-abb1-3ab2fe807e61 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:43.776384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3202f9b-f939-430e-abb1-3ab2fe807e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:43.776882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3202f9b-f939-430e-abb1-3ab2fe807e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:43.787806 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3202f9b-f939-430e-abb1-3ab2fe807e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:43.789659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3202f9b-f939-430e-abb1-3ab2fe807e61 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:43.802700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1313/2592] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:04:43.860199 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1280/2593] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:43 2022] PUT /identity/v3/projects/c0805d4e718f46beb2c0cacdfbd721c0/users/efb18b0bc2fd42d18157748ed822663d/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:43.871133 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2ce2e-e37b-4d7a-a009-fda67c16d87f None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:43.871430 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2ce2e-e37b-4d7a-a009-fda67c16d87f None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:43.871717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2ce2e-e37b-4d7a-a009-fda67c16d87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:43.904086 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-7ca2ce2e-e37b-4d7a-a009-fda67c16d87f None None] MFA Rules not processed for user `efb18b0bc2fd42d18157748ed822663d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:43.905894 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-7ca2ce2e-e37b-4d7a-a009-fda67c16d87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:43.995297 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509698f3-06fd-476f-b914-5adce785569e admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:43.995413 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1314/2594] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:44.116597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509698f3-06fd-476f-b914-5adce785569e admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:44.122963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b4132-1143-4bb4-963f-63525a774b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:44.123838 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b4132-1143-4bb4-963f-63525a774b8e admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:44.124483 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b4132-1143-4bb4-963f-63525a774b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:44.124822 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b4132-1143-4bb4-963f-63525a774b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:44.125703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b4132-1143-4bb4-963f-63525a774b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:44.129313 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b4132-1143-4bb4-963f-63525a774b8e admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:44.270247 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1281/2595] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:43 2022] POST /identity/v3/projects => generated 387 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:44.276359 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2ce2e-e37b-4d7a-a009-fda67c16d87f None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:44.288356 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2ce2e-e37b-4d7a-a009-fda67c16d87f None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:44.356539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbad35-2bad-4c67-8318-bb61b4c7b55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:44.357403 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbad35-2bad-4c67-8318-bb61b4c7b55c admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:44.358264 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbad35-2bad-4c67-8318-bb61b4c7b55c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:44.358557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbad35-2bad-4c67-8318-bb61b4c7b55c admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:44.359449 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbad35-2bad-4c67-8318-bb61b4c7b55c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:44.361268 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbad35-2bad-4c67-8318-bb61b4c7b55c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:44.399125 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b4132-1143-4bb4-963f-63525a774b8e admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:44.401782 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-616b4132-1143-4bb4-963f-63525a774b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:44.434595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b4132-1143-4bb4-963f-63525a774b8e admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:44.440323 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c2919-90fa-4b2d-af20-79c8097d1f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:44.441832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c2919-90fa-4b2d-af20-79c8097d1f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:44.442272 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c2919-90fa-4b2d-af20-79c8097d1f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:44.442561 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c2919-90fa-4b2d-af20-79c8097d1f2b admin admin] PATH_INFO: `/v3/projects/e6fe7cafc3524db3a40e0ae66a7f20c6` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:44.443804 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c2919-90fa-4b2d-af20-79c8097d1f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6fe7cafc3524db3a40e0ae66a7f20c6)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:44.447149 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c2919-90fa-4b2d-af20-79c8097d1f2b admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:44.495089 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1315/2596] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:44 2022] POST /identity/v3/users => generated 300 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:44.499424 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbad35-2bad-4c67-8318-bb61b4c7b55c admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:44.512710 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbad35-2bad-4c67-8318-bb61b4c7b55c admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:44.514520 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:44.522384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7d145-f74b-4bda-a1c2-95f01d10518f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:44.523293 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7d145-f74b-4bda-a1c2-95f01d10518f admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:44.523579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7d145-f74b-4bda-a1c2-95f01d10518f admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:44.524101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7d145-f74b-4bda-a1c2-95f01d10518f admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:44.525076 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7d145-f74b-4bda-a1c2-95f01d10518f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:44.526921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7d145-f74b-4bda-a1c2-95f01d10518f admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:44.538621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1316/2597] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:44.547433 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7d145-f74b-4bda-a1c2-95f01d10518f admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:44.553649 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7d145-f74b-4bda-a1c2-95f01d10518f admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:44.559334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5ae4a-4b6e-4042-b438-ad683c11f29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:44.560499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5ae4a-4b6e-4042-b438-ad683c11f29e admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:44.560832 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5ae4a-4b6e-4042-b438-ad683c11f29e admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:44.561342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5ae4a-4b6e-4042-b438-ad683c11f29e admin admin] PATH_INFO: `/v3/projects/6ff98e3bfc1e41799e96f9ee020f59e5/users/c9b1e09d4d8b48e6aa96f46d80148e7d/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:44.579258 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5ae4a-4b6e-4042-b438-ad683c11f29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff98e3bfc1e41799e96f9ee020f59e5, user_id=c9b1e09d4d8b48e6aa96f46d80148e7d, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:44.582508 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5ae4a-4b6e-4042-b438-ad683c11f29e admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:44.592134 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-712c2919-90fa-4b2d-af20-79c8097d1f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6fe7cafc3524db3a40e0ae66a7f20c6', 'request_id': 'req-712c2919-90fa-4b2d-af20-79c8097d1f2b'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:44.648438 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1317/2598] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:44 2022] PUT /identity/v3/projects/6ff98e3bfc1e41799e96f9ee020f59e5/users/c9b1e09d4d8b48e6aa96f46d80148e7d/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:44.652262 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5ae4a-4b6e-4042-b438-ad683c11f29e admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:44.676302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-712c2919-90fa-4b2d-af20-79c8097d1f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6fe7cafc3524db3a40e0ae66a7f20c6', 'request_id': 'req-712c2919-90fa-4b2d-af20-79c8097d1f2b'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:44.684284 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-712c2919-90fa-4b2d-af20-79c8097d1f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6fe7cafc3524db3a40e0ae66a7f20c6', 'request_id': 'req-712c2919-90fa-4b2d-af20-79c8097d1f2b'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:44.698571 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-712c2919-90fa-4b2d-af20-79c8097d1f2b admin admin] The token cache is being invalidate because project e6fe7cafc3524db3a40e0ae66a7f20c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:04:44.698880 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-712c2919-90fa-4b2d-af20-79c8097d1f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:44.699534 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-712c2919-90fa-4b2d-af20-79c8097d1f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:44.701396 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1282/2599] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:04:44 2022] DELETE /identity/v3/projects/e6fe7cafc3524db3a40e0ae66a7f20c6 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:44.705251 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c2919-90fa-4b2d-af20-79c8097d1f2b admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:44.707953 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-712c2919-90fa-4b2d-af20-79c8097d1f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:44.720519 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5ae4a-4b6e-4042-b438-ad683c11f29e admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:44.727012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca6a70-561f-46b1-b8fb-b28b52b83992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:44.728077 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca6a70-561f-46b1-b8fb-b28b52b83992 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:44.728530 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca6a70-561f-46b1-b8fb-b28b52b83992 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:44.728841 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca6a70-561f-46b1-b8fb-b28b52b83992 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:44.729584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca6a70-561f-46b1-b8fb-b28b52b83992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:44.731376 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca6a70-561f-46b1-b8fb-b28b52b83992 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:44.742744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1318/2600] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:04:44.746726 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca6a70-561f-46b1-b8fb-b28b52b83992 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:44.748513 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-1aca6a70-561f-46b1-b8fb-b28b52b83992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:44.773354 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca6a70-561f-46b1-b8fb-b28b52b83992 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:44.779473 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e8583-2ac2-424f-aabe-22175efd0cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:44.780551 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e8583-2ac2-424f-aabe-22175efd0cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:44.781109 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e8583-2ac2-424f-aabe-22175efd0cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:44.781403 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e8583-2ac2-424f-aabe-22175efd0cc3 admin admin] PATH_INFO: `/v3/projects/6ff98e3bfc1e41799e96f9ee020f59e5/users/c9b1e09d4d8b48e6aa96f46d80148e7d/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:44.784352 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e8583-2ac2-424f-aabe-22175efd0cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff98e3bfc1e41799e96f9ee020f59e5, user_id=c9b1e09d4d8b48e6aa96f46d80148e7d, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:44.788060 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e8583-2ac2-424f-aabe-22175efd0cc3 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:44.789196 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c2919-90fa-4b2d-af20-79c8097d1f2b admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:44.799184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47cdb0-64b5-4236-891d-b8a8b2eff0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:44.800089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47cdb0-64b5-4236-891d-b8a8b2eff0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:44.800721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47cdb0-64b5-4236-891d-b8a8b2eff0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:44.801465 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47cdb0-64b5-4236-891d-b8a8b2eff0a4 admin admin] PATH_INFO: `/v3/users/8d7e172f300a4cfbad7e1b64cb4621ea` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:44.803533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47cdb0-64b5-4236-891d-b8a8b2eff0a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d7e172f300a4cfbad7e1b64cb4621ea)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:44.805579 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47cdb0-64b5-4236-891d-b8a8b2eff0a4 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:44.811810 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1319/2601] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:44 2022] PUT /identity/v3/projects/6ff98e3bfc1e41799e96f9ee020f59e5/users/c9b1e09d4d8b48e6aa96f46d80148e7d/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:44.824423 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0eef5-3e2a-4338-80dd-c3b77d8addbe None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:44.825552 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0eef5-3e2a-4338-80dd-c3b77d8addbe None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:44.826086 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0eef5-3e2a-4338-80dd-c3b77d8addbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:44.861985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-cab0eef5-3e2a-4338-80dd-c3b77d8addbe None None] MFA Rules not processed for user `c9b1e09d4d8b48e6aa96f46d80148e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:44.864392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-cab0eef5-3e2a-4338-80dd-c3b77d8addbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:44.944415 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1320/2602] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:44.955996 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0eef5-3e2a-4338-80dd-c3b77d8addbe None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:44.956912 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:44.957664 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-cab0eef5-3e2a-4338-80dd-c3b77d8addbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:45.029655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4a47cdb0-64b5-4236-891d-b8a8b2eff0a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d7e172f300a4cfbad7e1b64cb4621ea'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:45.063913 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4a47cdb0-64b5-4236-891d-b8a8b2eff0a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d7e172f300a4cfbad7e1b64cb4621ea'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:45.064852 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4a47cdb0-64b5-4236-891d-b8a8b2eff0a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d7e172f300a4cfbad7e1b64cb4621ea'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:45.077979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0eef5-3e2a-4338-80dd-c3b77d8addbe None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:45.084911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cad629-5f3f-4438-b293-86eef4781de5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:45.086163 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cad629-5f3f-4438-b293-86eef4781de5 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:45.088039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cad629-5f3f-4438-b293-86eef4781de5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:45.088475 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cad629-5f3f-4438-b293-86eef4781de5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:45.093156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-44cad629-5f3f-4438-b293-86eef4781de5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:45.138936 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cad629-5f3f-4438-b293-86eef4781de5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:45.140467 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cad629-5f3f-4438-b293-86eef4781de5 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:45.145324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4a47cdb0-64b5-4236-891d-b8a8b2eff0a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d7e172f300a4cfbad7e1b64cb4621ea'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:45.145969 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4a47cdb0-64b5-4236-891d-b8a8b2eff0a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d7e172f300a4cfbad7e1b64cb4621ea'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:45.175307 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1321/2603] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:45.192977 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1283/2604] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:04:44 2022] DELETE /identity/v3/users/8d7e172f300a4cfbad7e1b64cb4621ea => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:04:45.217880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cad629-5f3f-4438-b293-86eef4781de5 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:45.217880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-44cad629-5f3f-4438-b293-86eef4781de5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:45.341257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cad629-5f3f-4438-b293-86eef4781de5 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:45.402654 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f89868-9b02-464b-9b30-b14176fdbe91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:45.403811 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f89868-9b02-464b-9b30-b14176fdbe91 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:45.404169 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f89868-9b02-464b-9b30-b14176fdbe91 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:45.404985 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f89868-9b02-464b-9b30-b14176fdbe91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:45.406476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-56f89868-9b02-464b-9b30-b14176fdbe91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:45.485172 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f89868-9b02-464b-9b30-b14176fdbe91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:45.504995 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f89868-9b02-464b-9b30-b14176fdbe91 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:45.518534 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1322/2605] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:45.769814 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47cdb0-64b5-4236-891d-b8a8b2eff0a4 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:45.771664 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4a47cdb0-64b5-4236-891d-b8a8b2eff0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:45.798996 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47cdb0-64b5-4236-891d-b8a8b2eff0a4 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:45.804672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f05d5a-8a27-4a2c-bba3-fa098c133aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:45.805611 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f05d5a-8a27-4a2c-bba3-fa098c133aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:45.806122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f05d5a-8a27-4a2c-bba3-fa098c133aee admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:45.806470 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f05d5a-8a27-4a2c-bba3-fa098c133aee admin admin] PATH_INFO: `/v3/projects/d3e26b8dfa964f0ebe585b1b14d0b39f` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:45.807601 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f05d5a-8a27-4a2c-bba3-fa098c133aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3e26b8dfa964f0ebe585b1b14d0b39f)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:45.809628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f05d5a-8a27-4a2c-bba3-fa098c133aee admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:45.947641 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a0f05d5a-8a27-4a2c-bba3-fa098c133aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3e26b8dfa964f0ebe585b1b14d0b39f', 'request_id': 'req-a0f05d5a-8a27-4a2c-bba3-fa098c133aee'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:46.020106 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a0f05d5a-8a27-4a2c-bba3-fa098c133aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3e26b8dfa964f0ebe585b1b14d0b39f', 'request_id': 'req-a0f05d5a-8a27-4a2c-bba3-fa098c133aee'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:46.027001 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a0f05d5a-8a27-4a2c-bba3-fa098c133aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3e26b8dfa964f0ebe585b1b14d0b39f', 'request_id': 'req-a0f05d5a-8a27-4a2c-bba3-fa098c133aee'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:46.041312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a0f05d5a-8a27-4a2c-bba3-fa098c133aee admin admin] The token cache is being invalidate because project d3e26b8dfa964f0ebe585b1b14d0b39f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:04:46.041769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a0f05d5a-8a27-4a2c-bba3-fa098c133aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:46.042530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a0f05d5a-8a27-4a2c-bba3-fa098c133aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:46.048753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1284/2606] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:04:45 2022] DELETE /identity/v3/projects/d3e26b8dfa964f0ebe585b1b14d0b39f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:04:46.049434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6c61a-5e3b-4a61-bed1-fed1555b60f0 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:46.049996 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6c61a-5e3b-4a61-bed1-fed1555b60f0 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:46.049996 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6c61a-5e3b-4a61-bed1-fed1555b60f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:46.101800 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-e5e6c61a-5e3b-4a61-bed1-fed1555b60f0 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:46.103114 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e5e6c61a-5e3b-4a61-bed1-fed1555b60f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:46.209343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:46.219814 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1323/2607] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:46.228239 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d406d-b262-4e30-b65b-63f4ca90a459 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:46.228522 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d406d-b262-4e30-b65b-63f4ca90a459 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:46.228835 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d406d-b262-4e30-b65b-63f4ca90a459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:46.261008 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-230d406d-b262-4e30-b65b-63f4ca90a459 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:46.262628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-230d406d-b262-4e30-b65b-63f4ca90a459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:46.272960 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1285/2608] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:46.277601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6c61a-5e3b-4a61-bed1-fed1555b60f0 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:46.293206 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6c61a-5e3b-4a61-bed1-fed1555b60f0 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:46.311228 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691f89f-a773-4b93-9b23-f9c79225fa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:46.311635 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691f89f-a773-4b93-9b23-f9c79225fa7c admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:46.311748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691f89f-a773-4b93-9b23-f9c79225fa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:46.311979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691f89f-a773-4b93-9b23-f9c79225fa7c admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:46.312757 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691f89f-a773-4b93-9b23-f9c79225fa7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:04:46.313071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691f89f-a773-4b93-9b23-f9c79225fa7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:46.320812 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691f89f-a773-4b93-9b23-f9c79225fa7c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:46.352304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1324/2609] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:04:46.356435 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d406d-b262-4e30-b65b-63f4ca90a459 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:46.371036 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d406d-b262-4e30-b65b-63f4ca90a459 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:46.399632 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5772dae-a2f2-4b20-bff6-cca0e6d34556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:46.402725 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5772dae-a2f2-4b20-bff6-cca0e6d34556 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:46.403253 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5772dae-a2f2-4b20-bff6-cca0e6d34556 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:46.404298 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5772dae-a2f2-4b20-bff6-cca0e6d34556 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:46.407249 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5772dae-a2f2-4b20-bff6-cca0e6d34556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:46.412988 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5772dae-a2f2-4b20-bff6-cca0e6d34556 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:46.545255 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691f89f-a773-4b93-9b23-f9c79225fa7c admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:46.551093 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:46.558690 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-8691f89f-a773-4b93-9b23-f9c79225fa7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:46.569065 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1286/2610] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:46 2022] POST /identity/v3/projects => generated 377 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:46.572314 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5772dae-a2f2-4b20-bff6-cca0e6d34556 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:46.669354 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691f89f-a773-4b93-9b23-f9c79225fa7c admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:46.670926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5772dae-a2f2-4b20-bff6-cca0e6d34556 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:46.678234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4f87f-d8da-486c-ac0c-458b81fe9f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:46.678962 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4f87f-d8da-486c-ac0c-458b81fe9f2c admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:46.679305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4f87f-d8da-486c-ac0c-458b81fe9f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:46.679529 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4f87f-d8da-486c-ac0c-458b81fe9f2c admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:46.680235 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4f87f-d8da-486c-ac0c-458b81fe9f2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:46.682434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4f87f-d8da-486c-ac0c-458b81fe9f2c admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:46.728074 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86eb40d-dca7-4832-8114-5bf9aa6883c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:46.728804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86eb40d-dca7-4832-8114-5bf9aa6883c8 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:46.729072 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86eb40d-dca7-4832-8114-5bf9aa6883c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:46.729354 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86eb40d-dca7-4832-8114-5bf9aa6883c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:46.731169 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c86eb40d-dca7-4832-8114-5bf9aa6883c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:46.752847 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1287/2611] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:46 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:46.758207 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8189e1-f4e0-405f-80dc-2d79fd240596 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:46.758207 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8189e1-f4e0-405f-80dc-2d79fd240596 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:46.758207 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8189e1-f4e0-405f-80dc-2d79fd240596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:46.795687 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-5b8189e1-f4e0-405f-80dc-2d79fd240596 None None] MFA Rules not processed for user `8fa38ff2dae2460ea363f1c3448d533c`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:46.796998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-5b8189e1-f4e0-405f-80dc-2d79fd240596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:46.818644 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86eb40d-dca7-4832-8114-5bf9aa6883c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:46.820329 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86eb40d-dca7-4832-8114-5bf9aa6883c8 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:46.836850 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1325/2612] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:46.838296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86eb40d-dca7-4832-8114-5bf9aa6883c8 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:46.861318 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86eb40d-dca7-4832-8114-5bf9aa6883c8 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:46.870071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a19488-53a5-4aa5-a3d4-a3ab64c12d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:46.870902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a19488-53a5-4aa5-a3d4-a3ab64c12d9d admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:46.872523 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a19488-53a5-4aa5-a3d4-a3ab64c12d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:46.873282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a19488-53a5-4aa5-a3d4-a3ab64c12d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:46.874162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a19488-53a5-4aa5-a3d4-a3ab64c12d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:46.876890 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:46.877219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a19488-53a5-4aa5-a3d4-a3ab64c12d9d admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:46.891907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1288/2613] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:46.893065 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1326/2614] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:46.897547 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8189e1-f4e0-405f-80dc-2d79fd240596 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:46.898723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a19488-53a5-4aa5-a3d4-a3ab64c12d9d admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:46.904417 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-5b8189e1-f4e0-405f-80dc-2d79fd240596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:46.914700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a19488-53a5-4aa5-a3d4-a3ab64c12d9d admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:46.926806 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8189e1-f4e0-405f-80dc-2d79fd240596 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:46.928229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d756474-d9b2-4404-a05e-b78c63338654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:46.929420 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d756474-d9b2-4404-a05e-b78c63338654 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:46.930511 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d756474-d9b2-4404-a05e-b78c63338654 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:46.931076 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d756474-d9b2-4404-a05e-b78c63338654 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:46.932287 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe41af-48d7-4211-8c60-7cf2c03001ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:46.932706 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe41af-48d7-4211-8c60-7cf2c03001ec admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:46.932987 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe41af-48d7-4211-8c60-7cf2c03001ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:46.933213 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d756474-d9b2-4404-a05e-b78c63338654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:46.933333 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe41af-48d7-4211-8c60-7cf2c03001ec admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:46.933964 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe41af-48d7-4211-8c60-7cf2c03001ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:46.935685 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d756474-d9b2-4404-a05e-b78c63338654 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:46.935981 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe41af-48d7-4211-8c60-7cf2c03001ec admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:46.959181 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1327/2615] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:46.960384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d756474-d9b2-4404-a05e-b78c63338654 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:46.970127 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d756474-d9b2-4404-a05e-b78c63338654 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:46.975805 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33b55d-237c-4af1-a113-6eb955c87d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:46.976731 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33b55d-237c-4af1-a113-6eb955c87d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:46.977484 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33b55d-237c-4af1-a113-6eb955c87d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:46.977767 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33b55d-237c-4af1-a113-6eb955c87d76 admin admin] PATH_INFO: `/v3/projects/26e643c495c44c0ba8aa570d66b2a913/users/e79afcf53e544524b762a1d4a9f7ca9d/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:46.995569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33b55d-237c-4af1-a113-6eb955c87d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e643c495c44c0ba8aa570d66b2a913, user_id=e79afcf53e544524b762a1d4a9f7ca9d, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:46.998244 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33b55d-237c-4af1-a113-6eb955c87d76 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:47.053114 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1289/2616] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:46 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:04:47.054220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe41af-48d7-4211-8c60-7cf2c03001ec admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:47.072725 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:47.079098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1328/2617] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:46 2022] PUT /identity/v3/projects/26e643c495c44c0ba8aa570d66b2a913/users/e79afcf53e544524b762a1d4a9f7ca9d/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:47.089867 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b79e09-fcc4-4817-93ed-b52c02bebd66 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:47.090162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b79e09-fcc4-4817-93ed-b52c02bebd66 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:47.090448 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b79e09-fcc4-4817-93ed-b52c02bebd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:47.125700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-b5b79e09-fcc4-4817-93ed-b52c02bebd66 None None] MFA Rules not processed for user `e79afcf53e544524b762a1d4a9f7ca9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:47.127015 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b5b79e09-fcc4-4817-93ed-b52c02bebd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:47.136302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe41af-48d7-4211-8c60-7cf2c03001ec admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:47.218721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01115ba8-c1a6-478b-b518-bc6481499b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:47.219412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01115ba8-c1a6-478b-b518-bc6481499b15 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:47.219695 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01115ba8-c1a6-478b-b518-bc6481499b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:47.220032 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01115ba8-c1a6-478b-b518-bc6481499b15 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:47.220758 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01115ba8-c1a6-478b-b518-bc6481499b15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:47.224430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01115ba8-c1a6-478b-b518-bc6481499b15 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:47.230390 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1329/2618] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:47.240311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b79e09-fcc4-4817-93ed-b52c02bebd66 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:47.243148 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b5b79e09-fcc4-4817-93ed-b52c02bebd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:47.311366 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1290/2619] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:47 2022] POST /identity/v3/users => generated 299 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:04:47.314506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01115ba8-c1a6-478b-b518-bc6481499b15 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:47.332800 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01115ba8-c1a6-478b-b518-bc6481499b15 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:47.339965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7298d97-7bd1-435b-b9b6-3b05ff75d997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:47.340819 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7298d97-7bd1-435b-b9b6-3b05ff75d997 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:47.341397 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7298d97-7bd1-435b-b9b6-3b05ff75d997 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:47.341778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7298d97-7bd1-435b-b9b6-3b05ff75d997 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:47.342647 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7298d97-7bd1-435b-b9b6-3b05ff75d997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:47.344428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7298d97-7bd1-435b-b9b6-3b05ff75d997 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:47.358110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1291/2620] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:47.362548 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7298d97-7bd1-435b-b9b6-3b05ff75d997 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:47.372711 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b79e09-fcc4-4817-93ed-b52c02bebd66 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:47.377098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf35b31-441d-48ca-89ba-825b4f75da76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06498e12426947908d5217e2c948519d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:47.378034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf35b31-441d-48ca-89ba-825b4f75da76 service glance] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:47.378426 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf35b31-441d-48ca-89ba-825b4f75da76 service glance] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:47.379013 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf35b31-441d-48ca-89ba-825b4f75da76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:47.380073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7298d97-7bd1-435b-b9b6-3b05ff75d997 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:47.385588 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c669c-3863-4e47-a71e-609501c959b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:47.386869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c669c-3863-4e47-a71e-609501c959b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:47.387166 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c669c-3863-4e47-a71e-609501c959b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:47.387450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c669c-3863-4e47-a71e-609501c959b6 admin admin] PATH_INFO: `/v3/projects/d64c19a50c094bed875506686479b442/users/e0c69d68dc2a46cbb04832174f3e8c40/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:47.393703 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf35b31-441d-48ca-89ba-825b4f75da76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:47.393703 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf35b31-441d-48ca-89ba-825b4f75da76 service glance] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:47.404402 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1330/2621] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:04:47.407535 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c669c-3863-4e47-a71e-609501c959b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64c19a50c094bed875506686479b442, user_id=e0c69d68dc2a46cbb04832174f3e8c40, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:47.414244 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c669c-3863-4e47-a71e-609501c959b6 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:47.489850 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf35b31-441d-48ca-89ba-825b4f75da76 service glance] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:47.491719 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1292/2622] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:47 2022] PUT /identity/v3/projects/d64c19a50c094bed875506686479b442/users/e0c69d68dc2a46cbb04832174f3e8c40/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:47.525715 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf35b31-441d-48ca-89ba-825b4f75da76 service glance] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:47.582822 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:47.638609 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4ab30-f018-49f2-889a-55afe00f2eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:47.639997 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4ab30-f018-49f2-889a-55afe00f2eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:47.640252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4ab30-f018-49f2-889a-55afe00f2eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:47.640549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4ab30-f018-49f2-889a-55afe00f2eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:47.641347 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4ab30-f018-49f2-889a-55afe00f2eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:47.643149 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4ab30-f018-49f2-889a-55afe00f2eb0 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:47.656341 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1331/2623] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:47.660688 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c669c-3863-4e47-a71e-609501c959b6 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:47.673558 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c669c-3863-4e47-a71e-609501c959b6 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:47.680604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3fd16-9237-47ef-9b30-1e1c51bf7a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:47.680604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3fd16-9237-47ef-9b30-1e1c51bf7a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:47.680604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3fd16-9237-47ef-9b30-1e1c51bf7a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:47.680604 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3fd16-9237-47ef-9b30-1e1c51bf7a58 admin admin] PATH_INFO: `/v3/projects/d64c19a50c094bed875506686479b442/users/e0c69d68dc2a46cbb04832174f3e8c40/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:47.688878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3fd16-9237-47ef-9b30-1e1c51bf7a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64c19a50c094bed875506686479b442, user_id=e0c69d68dc2a46cbb04832174f3e8c40, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:47.692366 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3fd16-9237-47ef-9b30-1e1c51bf7a58 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:47.718940 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1293/2624] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:47 2022] PUT /identity/v3/projects/d64c19a50c094bed875506686479b442/users/e0c69d68dc2a46cbb04832174f3e8c40/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:47.791311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:48.222160 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=100 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:48.625574 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:48.720545 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:50.301542 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:51.205606 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4ab30-f018-49f2-889a-55afe00f2eb0 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:51.208312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-dbd4ab30-f018-49f2-889a-55afe00f2eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:51.226950 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4ab30-f018-49f2-889a-55afe00f2eb0 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:51.309230 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a850aea-28c8-4a0a-b2b1-c59683850830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:51.310325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a850aea-28c8-4a0a-b2b1-c59683850830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:51.310789 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a850aea-28c8-4a0a-b2b1-c59683850830 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:51.311226 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a850aea-28c8-4a0a-b2b1-c59683850830 admin admin] PATH_INFO: `/v3/users/d4ffb26d86d64d81bea84268e10386fc` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:51.312905 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a850aea-28c8-4a0a-b2b1-c59683850830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ffb26d86d64d81bea84268e10386fc)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:51.315397 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a850aea-28c8-4a0a-b2b1-c59683850830 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:51.485919 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6a850aea-28c8-4a0a-b2b1-c59683850830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ffb26d86d64d81bea84268e10386fc'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:51.495615 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6a850aea-28c8-4a0a-b2b1-c59683850830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ffb26d86d64d81bea84268e10386fc'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:51.585390 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6a850aea-28c8-4a0a-b2b1-c59683850830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ffb26d86d64d81bea84268e10386fc'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:51.586694 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6a850aea-28c8-4a0a-b2b1-c59683850830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ffb26d86d64d81bea84268e10386fc'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:51.587648 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-6a850aea-28c8-4a0a-b2b1-c59683850830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ffb26d86d64d81bea84268e10386fc'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:51.629755 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1332/2625] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:04:51 2022] DELETE /identity/v3/users/d4ffb26d86d64d81bea84268e10386fc => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:52.143409 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3fd16-9237-47ef-9b30-1e1c51bf7a58 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:52.146727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-94c3fd16-9237-47ef-9b30-1e1c51bf7a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:52.180873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3fd16-9237-47ef-9b30-1e1c51bf7a58 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:52.297282 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3aa84-08f5-4e03-ae7e-b420f35c189a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:52.302305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3aa84-08f5-4e03-ae7e-b420f35c189a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:52.302305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3aa84-08f5-4e03-ae7e-b420f35c189a admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:52.302613 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3aa84-08f5-4e03-ae7e-b420f35c189a admin admin] PATH_INFO: `/v3/projects/eec3f3dcd90246b1a893afa783f2d2aa` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:52.304058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3aa84-08f5-4e03-ae7e-b420f35c189a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec3f3dcd90246b1a893afa783f2d2aa)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:52.306050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3aa84-08f5-4e03-ae7e-b420f35c189a admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:52.318401 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a850aea-28c8-4a0a-b2b1-c59683850830 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:52.325882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6a850aea-28c8-4a0a-b2b1-c59683850830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:52.412019 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a850aea-28c8-4a0a-b2b1-c59683850830 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:52.416822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d2c92-6248-42a5-b41a-a24c385c1997 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:52.418454 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d2c92-6248-42a5-b41a-a24c385c1997 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:52.419003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d2c92-6248-42a5-b41a-a24c385c1997 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:52.419651 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d2c92-6248-42a5-b41a-a24c385c1997 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:52.426321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-841d2c92-6248-42a5-b41a-a24c385c1997 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:52.452417 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8eb3aa84-08f5-4e03-ae7e-b420f35c189a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec3f3dcd90246b1a893afa783f2d2aa', 'request_id': 'req-8eb3aa84-08f5-4e03-ae7e-b420f35c189a'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:52.470954 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:52.511547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d2c92-6248-42a5-b41a-a24c385c1997 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:52.514979 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d2c92-6248-42a5-b41a-a24c385c1997 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:52.528145 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8eb3aa84-08f5-4e03-ae7e-b420f35c189a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec3f3dcd90246b1a893afa783f2d2aa', 'request_id': 'req-8eb3aa84-08f5-4e03-ae7e-b420f35c189a'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:52.537110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8eb3aa84-08f5-4e03-ae7e-b420f35c189a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec3f3dcd90246b1a893afa783f2d2aa', 'request_id': 'req-8eb3aa84-08f5-4e03-ae7e-b420f35c189a'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:52.557854 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1333/2626] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:52.558652 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8eb3aa84-08f5-4e03-ae7e-b420f35c189a admin admin] The token cache is being invalidate because project eec3f3dcd90246b1a893afa783f2d2aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:04:52.559135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8eb3aa84-08f5-4e03-ae7e-b420f35c189a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:52.560193 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8eb3aa84-08f5-4e03-ae7e-b420f35c189a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:52.562018 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1294/2627] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:04:52 2022] DELETE /identity/v3/projects/eec3f3dcd90246b1a893afa783f2d2aa => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:52.567702 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0a202-fa44-4262-b0f9-4e69673fca6a None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:52.567997 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0a202-fa44-4262-b0f9-4e69673fca6a None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:52.568279 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0a202-fa44-4262-b0f9-4e69673fca6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:52.591778 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-19e0a202-fa44-4262-b0f9-4e69673fca6a None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:52.593594 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-19e0a202-fa44-4262-b0f9-4e69673fca6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:52.703801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1334/2628] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:52.736295 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8a758-9ac1-4af3-8910-692607db91eb None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:52.737268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8a758-9ac1-4af3-8910-692607db91eb None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:52.737553 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8a758-9ac1-4af3-8910-692607db91eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:52.777239 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-0dd8a758-9ac1-4af3-8910-692607db91eb None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:52.777239 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-0dd8a758-9ac1-4af3-8910-692607db91eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:52.786016 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1295/2629] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:52.790481 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0a202-fa44-4262-b0f9-4e69673fca6a None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:52.806826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0a202-fa44-4262-b0f9-4e69673fca6a None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:52.830745 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c58977-a078-4d2a-9095-77b7b7c63184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:52.831621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c58977-a078-4d2a-9095-77b7b7c63184 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:52.831799 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c58977-a078-4d2a-9095-77b7b7c63184 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:52.832119 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c58977-a078-4d2a-9095-77b7b7c63184 admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:52.833771 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c58977-a078-4d2a-9095-77b7b7c63184 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:04:52.834088 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c58977-a078-4d2a-9095-77b7b7c63184 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:52.835727 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c58977-a078-4d2a-9095-77b7b7c63184 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:52.861134 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1335/2630] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:04:52.866106 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8a758-9ac1-4af3-8910-692607db91eb None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:52.886197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8a758-9ac1-4af3-8910-692607db91eb None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:52.901947 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8578d-d490-4595-9989-56818c0be9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:52.903078 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8578d-d490-4595-9989-56818c0be9cc admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:52.903428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8578d-d490-4595-9989-56818c0be9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:52.903771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8578d-d490-4595-9989-56818c0be9cc admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:52.904656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8578d-d490-4595-9989-56818c0be9cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:52.909258 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8578d-d490-4595-9989-56818c0be9cc admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:53.018907 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c58977-a078-4d2a-9095-77b7b7c63184 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:53.027062 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1296/2631] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:52 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:04:53.035574 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c58977-a078-4d2a-9095-77b7b7c63184 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:53.166977 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db1176-9d40-49a1-965e-d1b42e54b04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:53.167690 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db1176-9d40-49a1-965e-d1b42e54b04c admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:53.167982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db1176-9d40-49a1-965e-d1b42e54b04c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:53.168282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db1176-9d40-49a1-965e-d1b42e54b04c admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:53.171957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db1176-9d40-49a1-965e-d1b42e54b04c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:53.172796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db1176-9d40-49a1-965e-d1b42e54b04c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:53.263773 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1336/2632] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:53 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:53.264767 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8578d-d490-4595-9989-56818c0be9cc admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:53.278443 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8578d-d490-4595-9989-56818c0be9cc admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:53.285513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb36f93-d4cd-41c5-b47d-99c92f0457b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:53.286871 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb36f93-d4cd-41c5-b47d-99c92f0457b0 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:53.287313 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb36f93-d4cd-41c5-b47d-99c92f0457b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:53.287808 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb36f93-d4cd-41c5-b47d-99c92f0457b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:53.289678 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb36f93-d4cd-41c5-b47d-99c92f0457b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:53.292161 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb36f93-d4cd-41c5-b47d-99c92f0457b0 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:53.309505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db1176-9d40-49a1-965e-d1b42e54b04c admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:53.315573 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1297/2633] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:53.322183 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db1176-9d40-49a1-965e-d1b42e54b04c admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:53.335209 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab6b21-b447-4214-8322-0a3eb2592293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:53.336256 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab6b21-b447-4214-8322-0a3eb2592293 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:53.336798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab6b21-b447-4214-8322-0a3eb2592293 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:53.337293 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab6b21-b447-4214-8322-0a3eb2592293 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:53.339253 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab6b21-b447-4214-8322-0a3eb2592293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:53.343004 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab6b21-b447-4214-8322-0a3eb2592293 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:53.360826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb36f93-d4cd-41c5-b47d-99c92f0457b0 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:53.362635 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1337/2634] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:04:53.375015 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb36f93-d4cd-41c5-b47d-99c92f0457b0 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:53.381317 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd9f11-69ce-4360-8cff-855fa410141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:53.382748 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd9f11-69ce-4360-8cff-855fa410141d admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:53.383304 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd9f11-69ce-4360-8cff-855fa410141d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:53.383733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd9f11-69ce-4360-8cff-855fa410141d admin admin] PATH_INFO: `/v3/projects/395d61f5494345a192527db4de15f635/users/4c3ce167e6084138ba1452bf464daa81/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:53.402516 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd9f11-69ce-4360-8cff-855fa410141d admin admin] RBAC: Authorizing `identity:create_grant(project_id=395d61f5494345a192527db4de15f635, user_id=4c3ce167e6084138ba1452bf464daa81, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:53.405947 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd9f11-69ce-4360-8cff-855fa410141d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:53.478727 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1298/2635] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:53 2022] PUT /identity/v3/projects/395d61f5494345a192527db4de15f635/users/4c3ce167e6084138ba1452bf464daa81/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:53.489754 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e545d-3d81-4d52-9240-58aa04798892 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:53.490054 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e545d-3d81-4d52-9240-58aa04798892 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:53.490334 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e545d-3d81-4d52-9240-58aa04798892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:53.518488 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-459e545d-3d81-4d52-9240-58aa04798892 None None] MFA Rules not processed for user `4c3ce167e6084138ba1452bf464daa81`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:53.520566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-459e545d-3d81-4d52-9240-58aa04798892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:53.564853 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:53.639859 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1338/2636] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:53.641074 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd9f11-69ce-4360-8cff-855fa410141d admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:53.655978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:53.729682 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd9f11-69ce-4360-8cff-855fa410141d admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:53.734466 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80086e-9eee-49ab-8caf-422ce5af6fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:53.735129 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80086e-9eee-49ab-8caf-422ce5af6fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:53.735408 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80086e-9eee-49ab-8caf-422ce5af6fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:53.735683 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80086e-9eee-49ab-8caf-422ce5af6fb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:53.736385 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80086e-9eee-49ab-8caf-422ce5af6fb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:53.738409 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80086e-9eee-49ab-8caf-422ce5af6fb5 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:53.851370 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1299/2637] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:04:53 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:04:53.855428 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e545d-3d81-4d52-9240-58aa04798892 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:53.871637 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e545d-3d81-4d52-9240-58aa04798892 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:53.949258 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905ea65-c8ea-44ea-a779-838674035495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:53.950085 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905ea65-c8ea-44ea-a779-838674035495 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:53.950491 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905ea65-c8ea-44ea-a779-838674035495 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:53.950951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905ea65-c8ea-44ea-a779-838674035495 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:53.951826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905ea65-c8ea-44ea-a779-838674035495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:53.957485 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905ea65-c8ea-44ea-a779-838674035495 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:54.059868 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1339/2638] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:04:53 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:04:54.065037 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80086e-9eee-49ab-8caf-422ce5af6fb5 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:54.080544 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80086e-9eee-49ab-8caf-422ce5af6fb5 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:54.098854 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea81c50-8f67-4b95-a2a7-9c1ac24716e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:54.100068 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea81c50-8f67-4b95-a2a7-9c1ac24716e1 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:54.100659 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea81c50-8f67-4b95-a2a7-9c1ac24716e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:54.101523 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea81c50-8f67-4b95-a2a7-9c1ac24716e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:54.102318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea81c50-8f67-4b95-a2a7-9c1ac24716e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:54.116600 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea81c50-8f67-4b95-a2a7-9c1ac24716e1 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:54.158434 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1300/2639] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:54.163162 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905ea65-c8ea-44ea-a779-838674035495 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:54.176608 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905ea65-c8ea-44ea-a779-838674035495 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:54.191484 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d5a9d-2db8-40da-adb8-bb321f359052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:54.195219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d5a9d-2db8-40da-adb8-bb321f359052 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:54.195219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d5a9d-2db8-40da-adb8-bb321f359052 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:54.195219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d5a9d-2db8-40da-adb8-bb321f359052 admin admin] PATH_INFO: `/v3/projects/2903d4235dba4a278e922adcf96b1318/users/2abd7f8203fa48db8418ed74ea2a88bc/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:54.229772 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d5a9d-2db8-40da-adb8-bb321f359052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2903d4235dba4a278e922adcf96b1318, user_id=2abd7f8203fa48db8418ed74ea2a88bc, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:54.234681 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d5a9d-2db8-40da-adb8-bb321f359052 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:54.329842 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1340/2640] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:54 2022] PUT /identity/v3/projects/2903d4235dba4a278e922adcf96b1318/users/2abd7f8203fa48db8418ed74ea2a88bc/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:04:54.335041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea81c50-8f67-4b95-a2a7-9c1ac24716e1 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:54.347578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea81c50-8f67-4b95-a2a7-9c1ac24716e1 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:54.461413 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1be059-10b2-4338-91ad-57a0e344f946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:54.462105 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1be059-10b2-4338-91ad-57a0e344f946 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:54.462392 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1be059-10b2-4338-91ad-57a0e344f946 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:54.462673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1be059-10b2-4338-91ad-57a0e344f946 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:54.463962 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1be059-10b2-4338-91ad-57a0e344f946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:54.470061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1be059-10b2-4338-91ad-57a0e344f946 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:54.485982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1301/2641] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:54.501575 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d5a9d-2db8-40da-adb8-bb321f359052 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:54.522593 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d5a9d-2db8-40da-adb8-bb321f359052 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:54.529260 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9a6b7-2fcc-4d78-8f6a-dcf098d3a240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:54.530681 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9a6b7-2fcc-4d78-8f6a-dcf098d3a240 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:54.531063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9a6b7-2fcc-4d78-8f6a-dcf098d3a240 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:54.531623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9a6b7-2fcc-4d78-8f6a-dcf098d3a240 admin admin] PATH_INFO: `/v3/projects/2903d4235dba4a278e922adcf96b1318/users/2abd7f8203fa48db8418ed74ea2a88bc/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:54.533995 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9a6b7-2fcc-4d78-8f6a-dcf098d3a240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2903d4235dba4a278e922adcf96b1318, user_id=2abd7f8203fa48db8418ed74ea2a88bc, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:54.537259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9a6b7-2fcc-4d78-8f6a-dcf098d3a240 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:54.563607 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1341/2642] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:04:54 2022] PUT /identity/v3/projects/2903d4235dba4a278e922adcf96b1318/users/2abd7f8203fa48db8418ed74ea2a88bc/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:54.565826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ac0cb-3e98-44c5-baa2-212a9ca50f1c None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:54.567860 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ac0cb-3e98-44c5-baa2-212a9ca50f1c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:54.568215 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ac0cb-3e98-44c5-baa2-212a9ca50f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:54.604726 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-d10ac0cb-3e98-44c5-baa2-212a9ca50f1c None None] MFA Rules not processed for user `2abd7f8203fa48db8418ed74ea2a88bc`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:54.606240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-d10ac0cb-3e98-44c5-baa2-212a9ca50f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:54.718825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1302/2643] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:54.730684 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9a6b7-2fcc-4d78-8f6a-dcf098d3a240 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:54.732467 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c9d9a6b7-2fcc-4d78-8f6a-dcf098d3a240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:54.823978 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9a6b7-2fcc-4d78-8f6a-dcf098d3a240 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:54.829105 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4119cf-2c65-4dae-9d26-737ffd277479 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:54.829977 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4119cf-2c65-4dae-9d26-737ffd277479 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:54.830265 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4119cf-2c65-4dae-9d26-737ffd277479 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:54.830544 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4119cf-2c65-4dae-9d26-737ffd277479 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:54.843298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4119cf-2c65-4dae-9d26-737ffd277479 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:54.844826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4119cf-2c65-4dae-9d26-737ffd277479 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:54.858711 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1342/2644] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:55.108834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ac0cb-3e98-44c5-baa2-212a9ca50f1c None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:55.110383 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-d10ac0cb-3e98-44c5-baa2-212a9ca50f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:55.120203 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:55.126405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ac0cb-3e98-44c5-baa2-212a9ca50f1c None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:55.135318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db498f3-8e5a-4187-8363-b5fa99199b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:55.136010 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db498f3-8e5a-4187-8363-b5fa99199b8c service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:55.136300 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db498f3-8e5a-4187-8363-b5fa99199b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:55.136587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db498f3-8e5a-4187-8363-b5fa99199b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:55.200494 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4d71e-047a-4149-bd90-86a408ebce0e None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:55.201258 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4d71e-047a-4149-bd90-86a408ebce0e None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:55.201258 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4d71e-047a-4149-bd90-86a408ebce0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:55.227285 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db498f3-8e5a-4187-8363-b5fa99199b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:55.229649 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db498f3-8e5a-4187-8363-b5fa99199b8c service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:55.231445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-79c4d71e-047a-4149-bd90-86a408ebce0e None None] MFA Rules not processed for user `e0c69d68dc2a46cbb04832174f3e8c40`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:55.240266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-79c4d71e-047a-4149-bd90-86a408ebce0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:55.240829 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1303/2645] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:55.258998 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:55.332606 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1343/2646] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:04:55.346788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db498f3-8e5a-4187-8363-b5fa99199b8c service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:55.349935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-2db498f3-8e5a-4187-8363-b5fa99199b8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:55.412705 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db498f3-8e5a-4187-8363-b5fa99199b8c service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:55.416476 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c119619-305f-4341-9ad4-ded9f68317eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06498e12426947908d5217e2c948519d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:55.417333 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c119619-305f-4341-9ad4-ded9f68317eb service glance] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:55.417614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c119619-305f-4341-9ad4-ded9f68317eb service glance] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:55.418159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c119619-305f-4341-9ad4-ded9f68317eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:55.420215 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8c119619-305f-4341-9ad4-ded9f68317eb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:55.487025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c119619-305f-4341-9ad4-ded9f68317eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:55.488536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c119619-305f-4341-9ad4-ded9f68317eb service glance] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:55.497745 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1304/2647] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:55.809026 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7907f-1c13-47b1-9e99-1c019d3aa83c None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:55.809432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7907f-1c13-47b1-9e99-1c019d3aa83c None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:55.809879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7907f-1c13-47b1-9e99-1c019d3aa83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:55.830626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-dea7907f-1c13-47b1-9e99-1c019d3aa83c None None] MFA Rules not processed for user `1b03d940626a449dbe904f02f3d70854`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:55.833059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-dea7907f-1c13-47b1-9e99-1c019d3aa83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:55.895178 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1344/2648] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 23 11:04:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:55.909156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c119619-305f-4341-9ad4-ded9f68317eb service glance] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:55.909156 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8c119619-305f-4341-9ad4-ded9f68317eb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:55.974209 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:55.990036 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c119619-305f-4341-9ad4-ded9f68317eb service glance] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:55.995928 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc2819-7a21-43e5-b5a1-3cccf8ff6b08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a54fa1c326f41e88688404a56b75c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:55.997389 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc2819-7a21-43e5-b5a1-3cccf8ff6b08 service swift] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:55.997389 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc2819-7a21-43e5-b5a1-3cccf8ff6b08 service swift] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:55.997588 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc2819-7a21-43e5-b5a1-3cccf8ff6b08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:56.009105 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc2819-7a21-43e5-b5a1-3cccf8ff6b08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:56.011458 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc2819-7a21-43e5-b5a1-3cccf8ff6b08 service swift] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:56.025049 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1305/2649] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 23 11:04:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:04:57.342773 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7907f-1c13-47b1-9e99-1c019d3aa83c None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:57.344331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-dea7907f-1c13-47b1-9e99-1c019d3aa83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:57.461609 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7907f-1c13-47b1-9e99-1c019d3aa83c None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:57.469171 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dc0b9-8563-46c5-af03-92b9818b4edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:57.472834 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dc0b9-8563-46c5-af03-92b9818b4edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:57.472834 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dc0b9-8563-46c5-af03-92b9818b4edf admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:57.472834 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dc0b9-8563-46c5-af03-92b9818b4edf admin admin] PATH_INFO: `/v3/users/258a4f3e320549a08fb239028cab0ba7` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:57.472834 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572dc0b9-8563-46c5-af03-92b9818b4edf admin admin] RBAC: Authorizing `identity:delete_user(user_id=258a4f3e320549a08fb239028cab0ba7)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:57.476101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572dc0b9-8563-46c5-af03-92b9818b4edf admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:57.740811 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-572dc0b9-8563-46c5-af03-92b9818b4edf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '258a4f3e320549a08fb239028cab0ba7'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:57.751955 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-572dc0b9-8563-46c5-af03-92b9818b4edf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '258a4f3e320549a08fb239028cab0ba7'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:57.753644 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:57.812567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-572dc0b9-8563-46c5-af03-92b9818b4edf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '258a4f3e320549a08fb239028cab0ba7'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:57.812567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-572dc0b9-8563-46c5-af03-92b9818b4edf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '258a4f3e320549a08fb239028cab0ba7'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:57.812567 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-572dc0b9-8563-46c5-af03-92b9818b4edf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '258a4f3e320549a08fb239028cab0ba7'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:57.857188 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1345/2650] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:04:57 2022] DELETE /identity/v3/users/258a4f3e320549a08fb239028cab0ba7 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:57.861517 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10106f-a6a2-43e4-be2b-2f51b7704576 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:57.862373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10106f-a6a2-43e4-be2b-2f51b7704576 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:57.862907 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10106f-a6a2-43e4-be2b-2f51b7704576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:57.885506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-4d10106f-a6a2-43e4-be2b-2f51b7704576 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:57.887292 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4d10106f-a6a2-43e4-be2b-2f51b7704576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:57.984394 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1306/2651] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:57.992599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dc0b9-8563-46c5-af03-92b9818b4edf admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:57.994866 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-572dc0b9-8563-46c5-af03-92b9818b4edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:58.124607 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dc0b9-8563-46c5-af03-92b9818b4edf admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:58.130063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08456178-1755-401b-a3b9-1cb4c4bf4a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:58.130822 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08456178-1755-401b-a3b9-1cb4c4bf4a50 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:58.131112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08456178-1755-401b-a3b9-1cb4c4bf4a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:58.131389 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08456178-1755-401b-a3b9-1cb4c4bf4a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:58.146192 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08456178-1755-401b-a3b9-1cb4c4bf4a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:58.151040 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08456178-1755-401b-a3b9-1cb4c4bf4a50 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:58.159327 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1346/2652] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:58.716787 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10106f-a6a2-43e4-be2b-2f51b7704576 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:58.723583 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4d10106f-a6a2-43e4-be2b-2f51b7704576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:58.757004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10106f-a6a2-43e4-be2b-2f51b7704576 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:58.790387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745a04f-d2b1-43fe-9cf9-f5eed0190389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:58.791585 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745a04f-d2b1-43fe-9cf9-f5eed0190389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:58.793275 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745a04f-d2b1-43fe-9cf9-f5eed0190389 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:58.793858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745a04f-d2b1-43fe-9cf9-f5eed0190389 admin admin] PATH_INFO: `/v3/projects/fec9aa0032884843b26724e9fa5e11ad` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:58.833392 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745a04f-d2b1-43fe-9cf9-f5eed0190389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec9aa0032884843b26724e9fa5e11ad)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:58.839080 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745a04f-d2b1-43fe-9cf9-f5eed0190389 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:59.016863 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a745a04f-d2b1-43fe-9cf9-f5eed0190389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec9aa0032884843b26724e9fa5e11ad', 'request_id': 'req-a745a04f-d2b1-43fe-9cf9-f5eed0190389'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:59.100122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a745a04f-d2b1-43fe-9cf9-f5eed0190389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec9aa0032884843b26724e9fa5e11ad', 'request_id': 'req-a745a04f-d2b1-43fe-9cf9-f5eed0190389'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:59.114312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a745a04f-d2b1-43fe-9cf9-f5eed0190389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec9aa0032884843b26724e9fa5e11ad', 'request_id': 'req-a745a04f-d2b1-43fe-9cf9-f5eed0190389'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:59.140881 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a745a04f-d2b1-43fe-9cf9-f5eed0190389 admin admin] The token cache is being invalidate because project fec9aa0032884843b26724e9fa5e11ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:04:59.141432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a745a04f-d2b1-43fe-9cf9-f5eed0190389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:59.147212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a745a04f-d2b1-43fe-9cf9-f5eed0190389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:59.154137 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1307/2653] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:04:58 2022] DELETE /identity/v3/projects/fec9aa0032884843b26724e9fa5e11ad => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:59.156015 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08456178-1755-401b-a3b9-1cb4c4bf4a50 service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:59.170504 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08456178-1755-401b-a3b9-1cb4c4bf4a50 service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:59.327557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6fb3d-60f5-4c41-b468-d5e2672b56f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:59.328626 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6fb3d-60f5-4c41-b468-d5e2672b56f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:59.329055 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6fb3d-60f5-4c41-b468-d5e2672b56f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:59.329427 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6fb3d-60f5-4c41-b468-d5e2672b56f1 admin admin] PATH_INFO: `/v3/users/efb18b0bc2fd42d18157748ed822663d` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:59.331267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6fb3d-60f5-4c41-b468-d5e2672b56f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efb18b0bc2fd42d18157748ed822663d)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:59.333769 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6fb3d-60f5-4c41-b468-d5e2672b56f1 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:59.551503 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a2d6fb3d-60f5-4c41-b468-d5e2672b56f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efb18b0bc2fd42d18157748ed822663d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:59.563394 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a2d6fb3d-60f5-4c41-b468-d5e2672b56f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efb18b0bc2fd42d18157748ed822663d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:59.624666 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a2d6fb3d-60f5-4c41-b468-d5e2672b56f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efb18b0bc2fd42d18157748ed822663d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:59.625969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a2d6fb3d-60f5-4c41-b468-d5e2672b56f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efb18b0bc2fd42d18157748ed822663d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:59.626285 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a2d6fb3d-60f5-4c41-b468-d5e2672b56f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efb18b0bc2fd42d18157748ed822663d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:04:59.641837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:59.646672 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1347/2654] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:04:59 2022] DELETE /identity/v3/users/efb18b0bc2fd42d18157748ed822663d => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:00.344933 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745a04f-d2b1-43fe-9cf9-f5eed0190389 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:00.349381 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a745a04f-d2b1-43fe-9cf9-f5eed0190389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:00.421778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745a04f-d2b1-43fe-9cf9-f5eed0190389 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:00.543784 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa81d8-5cd1-4345-81d7-8a2bd410b63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:00.544982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa81d8-5cd1-4345-81d7-8a2bd410b63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:00.545474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa81d8-5cd1-4345-81d7-8a2bd410b63f admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:00.545968 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa81d8-5cd1-4345-81d7-8a2bd410b63f admin admin] PATH_INFO: `/v3/projects/c0805d4e718f46beb2c0cacdfbd721c0` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:00.547498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa81d8-5cd1-4345-81d7-8a2bd410b63f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0805d4e718f46beb2c0cacdfbd721c0)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:00.549972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa81d8-5cd1-4345-81d7-8a2bd410b63f admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:00.563107 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:00.654995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f0fa81d8-5cd1-4345-81d7-8a2bd410b63f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0805d4e718f46beb2c0cacdfbd721c0', 'request_id': 'req-f0fa81d8-5cd1-4345-81d7-8a2bd410b63f'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:00.705984 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f0fa81d8-5cd1-4345-81d7-8a2bd410b63f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0805d4e718f46beb2c0cacdfbd721c0', 'request_id': 'req-f0fa81d8-5cd1-4345-81d7-8a2bd410b63f'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:00.713099 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f0fa81d8-5cd1-4345-81d7-8a2bd410b63f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0805d4e718f46beb2c0cacdfbd721c0', 'request_id': 'req-f0fa81d8-5cd1-4345-81d7-8a2bd410b63f'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:00.727939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f0fa81d8-5cd1-4345-81d7-8a2bd410b63f admin admin] The token cache is being invalidate because project c0805d4e718f46beb2c0cacdfbd721c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:00.727939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f0fa81d8-5cd1-4345-81d7-8a2bd410b63f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:00.727939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-f0fa81d8-5cd1-4345-81d7-8a2bd410b63f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:00.730052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1308/2655] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:00 2022] DELETE /identity/v3/projects/c0805d4e718f46beb2c0cacdfbd721c0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:00.733828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6fb3d-60f5-4c41-b468-d5e2672b56f1 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:00.735296 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-a2d6fb3d-60f5-4c41-b468-d5e2672b56f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:00.751782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6fb3d-60f5-4c41-b468-d5e2672b56f1 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:00.823536 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6fd8b9-728f-4d7c-89ad-92f4a7223377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:00.824772 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fd8b9-728f-4d7c-89ad-92f4a7223377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:00.825064 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fd8b9-728f-4d7c-89ad-92f4a7223377 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:00.825354 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6fd8b9-728f-4d7c-89ad-92f4a7223377 admin admin] PATH_INFO: `/v3/users/c9b1e09d4d8b48e6aa96f46d80148e7d` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:00.826585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6fd8b9-728f-4d7c-89ad-92f4a7223377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9b1e09d4d8b48e6aa96f46d80148e7d)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:00.828522 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6fd8b9-728f-4d7c-89ad-92f4a7223377 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:01.046970 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-2c6fd8b9-728f-4d7c-89ad-92f4a7223377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b1e09d4d8b48e6aa96f46d80148e7d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:01.058638 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-2c6fd8b9-728f-4d7c-89ad-92f4a7223377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b1e09d4d8b48e6aa96f46d80148e7d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:01.128986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-2c6fd8b9-728f-4d7c-89ad-92f4a7223377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b1e09d4d8b48e6aa96f46d80148e7d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:01.130120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-2c6fd8b9-728f-4d7c-89ad-92f4a7223377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b1e09d4d8b48e6aa96f46d80148e7d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:01.132932 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-2c6fd8b9-728f-4d7c-89ad-92f4a7223377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b1e09d4d8b48e6aa96f46d80148e7d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:01.159693 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1348/2656] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:00 2022] DELETE /identity/v3/users/c9b1e09d4d8b48e6aa96f46d80148e7d => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:01.684850 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa81d8-5cd1-4345-81d7-8a2bd410b63f admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:01.686349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f0fa81d8-5cd1-4345-81d7-8a2bd410b63f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:01.714317 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa81d8-5cd1-4345-81d7-8a2bd410b63f admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:01.824705 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde9fa5-c03a-4713-9b8d-3d6933fac143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:01.826643 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde9fa5-c03a-4713-9b8d-3d6933fac143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:01.826643 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde9fa5-c03a-4713-9b8d-3d6933fac143 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:01.826643 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde9fa5-c03a-4713-9b8d-3d6933fac143 admin admin] PATH_INFO: `/v3/projects/6ff98e3bfc1e41799e96f9ee020f59e5` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:01.827510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde9fa5-c03a-4713-9b8d-3d6933fac143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ff98e3bfc1e41799e96f9ee020f59e5)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:01.829521 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde9fa5-c03a-4713-9b8d-3d6933fac143 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:02.043989 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4cde9fa5-c03a-4713-9b8d-3d6933fac143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ff98e3bfc1e41799e96f9ee020f59e5', 'request_id': 'req-4cde9fa5-c03a-4713-9b8d-3d6933fac143'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:02.139073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4cde9fa5-c03a-4713-9b8d-3d6933fac143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ff98e3bfc1e41799e96f9ee020f59e5', 'request_id': 'req-4cde9fa5-c03a-4713-9b8d-3d6933fac143'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:02.152359 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4cde9fa5-c03a-4713-9b8d-3d6933fac143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ff98e3bfc1e41799e96f9ee020f59e5', 'request_id': 'req-4cde9fa5-c03a-4713-9b8d-3d6933fac143'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:02.184798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4cde9fa5-c03a-4713-9b8d-3d6933fac143 admin admin] The token cache is being invalidate because project 6ff98e3bfc1e41799e96f9ee020f59e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:02.184798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4cde9fa5-c03a-4713-9b8d-3d6933fac143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:02.184798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4cde9fa5-c03a-4713-9b8d-3d6933fac143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:02.184798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1309/2657] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:01 2022] DELETE /identity/v3/projects/6ff98e3bfc1e41799e96f9ee020f59e5 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:02.189217 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb264d6e-9141-4329-b763-26a137c3dc41 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:02.189692 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb264d6e-9141-4329-b763-26a137c3dc41 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:02.189794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb264d6e-9141-4329-b763-26a137c3dc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:02.235338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-bb264d6e-9141-4329-b763-26a137c3dc41 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:02.238123 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-bb264d6e-9141-4329-b763-26a137c3dc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:02.352850 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1349/2658] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:02.362568 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092207a3-75fd-476e-bf48-65a1e752625b None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:02.363352 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092207a3-75fd-476e-bf48-65a1e752625b None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:02.363806 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092207a3-75fd-476e-bf48-65a1e752625b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:02.397559 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-092207a3-75fd-476e-bf48-65a1e752625b None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:02.398797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-092207a3-75fd-476e-bf48-65a1e752625b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:02.410501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1310/2659] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:02.414835 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb264d6e-9141-4329-b763-26a137c3dc41 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:02.425146 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb264d6e-9141-4329-b763-26a137c3dc41 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:02.430773 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0edf0-8af1-45fd-b495-83756fd831ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:02.431458 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0edf0-8af1-45fd-b495-83756fd831ce admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:02.431750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0edf0-8af1-45fd-b495-83756fd831ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:02.432033 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0edf0-8af1-45fd-b495-83756fd831ce admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:02.432826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0edf0-8af1-45fd-b495-83756fd831ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:05:02.433140 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0edf0-8af1-45fd-b495-83756fd831ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:02.434779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0edf0-8af1-45fd-b495-83756fd831ce admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:02.447622 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:02.456277 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1350/2660] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:05:02.458646 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092207a3-75fd-476e-bf48-65a1e752625b None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:02.467711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092207a3-75fd-476e-bf48-65a1e752625b None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:02.475703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4f147-3c62-465f-ae2a-176d84cf7ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:02.476387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4f147-3c62-465f-ae2a-176d84cf7ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:02.476715 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4f147-3c62-465f-ae2a-176d84cf7ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:02.476999 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4f147-3c62-465f-ae2a-176d84cf7ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:02.477763 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4f147-3c62-465f-ae2a-176d84cf7ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:02.479886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4f147-3c62-465f-ae2a-176d84cf7ef7 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:02.586336 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:02.594722 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1311/2661] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:02 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:02.599544 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0edf0-8af1-45fd-b495-83756fd831ce admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:02.617920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0edf0-8af1-45fd-b495-83756fd831ce admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:02.694397 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ee455-bad6-43b5-9c46-f197a0ac84e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:02.695330 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ee455-bad6-43b5-9c46-f197a0ac84e8 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:02.695614 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ee455-bad6-43b5-9c46-f197a0ac84e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:02.695896 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ee455-bad6-43b5-9c46-f197a0ac84e8 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:02.696608 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ee455-bad6-43b5-9c46-f197a0ac84e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:02.698729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ee455-bad6-43b5-9c46-f197a0ac84e8 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:02.797184 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1351/2662] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:02 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:02.801519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4f147-3c62-465f-ae2a-176d84cf7ef7 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:02.813713 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4f147-3c62-465f-ae2a-176d84cf7ef7 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:02.821518 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957e5c8-2a1a-4791-8fb1-17dd10338dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:02.822545 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957e5c8-2a1a-4791-8fb1-17dd10338dab admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:02.823715 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957e5c8-2a1a-4791-8fb1-17dd10338dab admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:02.824233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957e5c8-2a1a-4791-8fb1-17dd10338dab admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:02.825126 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957e5c8-2a1a-4791-8fb1-17dd10338dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:02.827347 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957e5c8-2a1a-4791-8fb1-17dd10338dab admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:02.844683 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1312/2663] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:02.847637 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ee455-bad6-43b5-9c46-f197a0ac84e8 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:02.861101 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ee455-bad6-43b5-9c46-f197a0ac84e8 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:02.866108 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6c51-96bf-4f12-8588-ddc74f3bf143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:02.867066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6c51-96bf-4f12-8588-ddc74f3bf143 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:02.867454 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6c51-96bf-4f12-8588-ddc74f3bf143 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:02.867854 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6c51-96bf-4f12-8588-ddc74f3bf143 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:02.868748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac6c51-96bf-4f12-8588-ddc74f3bf143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:02.870444 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac6c51-96bf-4f12-8588-ddc74f3bf143 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:02.888968 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1352/2664] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:02.890495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957e5c8-2a1a-4791-8fb1-17dd10338dab admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:02.907671 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957e5c8-2a1a-4791-8fb1-17dd10338dab admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:02.916174 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282f092-2e96-4be6-8e0d-eff66baf0b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:02.917178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282f092-2e96-4be6-8e0d-eff66baf0b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:02.917503 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282f092-2e96-4be6-8e0d-eff66baf0b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:02.917745 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282f092-2e96-4be6-8e0d-eff66baf0b97 admin admin] PATH_INFO: `/v3/projects/9cfeae41cd014ed39f65d3b4ee9807b7/users/88a5e4fcb727423db3f0f143234d0ffb/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:02.937199 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282f092-2e96-4be6-8e0d-eff66baf0b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cfeae41cd014ed39f65d3b4ee9807b7, user_id=88a5e4fcb727423db3f0f143234d0ffb, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:02.939874 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282f092-2e96-4be6-8e0d-eff66baf0b97 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:03.030251 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1313/2665] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:02 2022] PUT /identity/v3/projects/9cfeae41cd014ed39f65d3b4ee9807b7/users/88a5e4fcb727423db3f0f143234d0ffb/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:03.032802 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b89752-6317-4d6e-8625-6d9a2d667539 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:03.033100 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b89752-6317-4d6e-8625-6d9a2d667539 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:03.033384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b89752-6317-4d6e-8625-6d9a2d667539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:03.074887 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-08b89752-6317-4d6e-8625-6d9a2d667539 None None] MFA Rules not processed for user `88a5e4fcb727423db3f0f143234d0ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:03.076120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-08b89752-6317-4d6e-8625-6d9a2d667539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:03.174577 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1353/2666] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:03.186455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282f092-2e96-4be6-8e0d-eff66baf0b97 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:03.188313 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-9282f092-2e96-4be6-8e0d-eff66baf0b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:03.271853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282f092-2e96-4be6-8e0d-eff66baf0b97 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:03.276565 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaa665-7bd8-42eb-96f5-27af29a6fa4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:03.280895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaa665-7bd8-42eb-96f5-27af29a6fa4c service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:03.280895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaa665-7bd8-42eb-96f5-27af29a6fa4c service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:03.280895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaa665-7bd8-42eb-96f5-27af29a6fa4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:03.289863 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eaa665-7bd8-42eb-96f5-27af29a6fa4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:03.295122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eaa665-7bd8-42eb-96f5-27af29a6fa4c service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:03.318939 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1314/2667] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:03.342172 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b89752-6317-4d6e-8625-6d9a2d667539 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:03.431642 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b89752-6317-4d6e-8625-6d9a2d667539 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:03.436731 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dba41-9d32-4fc2-9d46-1c0372b2e588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:03.437754 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dba41-9d32-4fc2-9d46-1c0372b2e588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:03.438071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dba41-9d32-4fc2-9d46-1c0372b2e588 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:03.438354 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dba41-9d32-4fc2-9d46-1c0372b2e588 admin admin] PATH_INFO: `/v3/users/88a5e4fcb727423db3f0f143234d0ffb` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:03.439714 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729dba41-9d32-4fc2-9d46-1c0372b2e588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88a5e4fcb727423db3f0f143234d0ffb)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:03.442617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729dba41-9d32-4fc2-9d46-1c0372b2e588 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:03.453932 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:03.540320 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaa665-7bd8-42eb-96f5-27af29a6fa4c service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:03.541771 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-52eaa665-7bd8-42eb-96f5-27af29a6fa4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:03.555865 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaa665-7bd8-42eb-96f5-27af29a6fa4c service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:03.560902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e4262-cd26-49da-a6ff-4a3bf6e586da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:03.561783 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e4262-cd26-49da-a6ff-4a3bf6e586da admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:03.562065 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e4262-cd26-49da-a6ff-4a3bf6e586da admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:03.562338 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e4262-cd26-49da-a6ff-4a3bf6e586da admin admin] PATH_INFO: `/v3/users/e79afcf53e544524b762a1d4a9f7ca9d` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:03.563516 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e4262-cd26-49da-a6ff-4a3bf6e586da admin admin] RBAC: Authorizing `identity:delete_user(user_id=e79afcf53e544524b762a1d4a9f7ca9d)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:03.565487 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e4262-cd26-49da-a6ff-4a3bf6e586da admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:03.839158 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-729dba41-9d32-4fc2-9d46-1c0372b2e588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88a5e4fcb727423db3f0f143234d0ffb'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:03.842310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-bb3e4262-cd26-49da-a6ff-4a3bf6e586da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e79afcf53e544524b762a1d4a9f7ca9d'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:03.854910 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-729dba41-9d32-4fc2-9d46-1c0372b2e588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88a5e4fcb727423db3f0f143234d0ffb'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:03.856540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-bb3e4262-cd26-49da-a6ff-4a3bf6e586da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e79afcf53e544524b762a1d4a9f7ca9d'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:03.857918 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-bb3e4262-cd26-49da-a6ff-4a3bf6e586da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e79afcf53e544524b762a1d4a9f7ca9d'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:03.949253 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-729dba41-9d32-4fc2-9d46-1c0372b2e588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88a5e4fcb727423db3f0f143234d0ffb'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:03.950394 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-729dba41-9d32-4fc2-9d46-1c0372b2e588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88a5e4fcb727423db3f0f143234d0ffb'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:03.951171 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-729dba41-9d32-4fc2-9d46-1c0372b2e588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88a5e4fcb727423db3f0f143234d0ffb'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:03.972532 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1354/2668] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:03 2022] DELETE /identity/v3/users/88a5e4fcb727423db3f0f143234d0ffb => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:03.977930 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692f045-4912-479b-bfec-b8b2cab1e724 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:03.978222 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692f045-4912-479b-bfec-b8b2cab1e724 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:03.978529 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692f045-4912-479b-bfec-b8b2cab1e724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:03.978963 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-bb3e4262-cd26-49da-a6ff-4a3bf6e586da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e79afcf53e544524b762a1d4a9f7ca9d'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:03.979649 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-bb3e4262-cd26-49da-a6ff-4a3bf6e586da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e79afcf53e544524b762a1d4a9f7ca9d'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:03.997512 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-6692f045-4912-479b-bfec-b8b2cab1e724 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:03.998616 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6692f045-4912-479b-bfec-b8b2cab1e724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:04.009318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1315/2669] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:03 2022] DELETE /identity/v3/users/e79afcf53e544524b762a1d4a9f7ca9d => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:05:04.010784 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39300c3-b472-4d91-bb3c-9b08ea5138be None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:04.011058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39300c3-b472-4d91-bb3c-9b08ea5138be None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:04.011343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39300c3-b472-4d91-bb3c-9b08ea5138be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:04.043384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-c39300c3-b472-4d91-bb3c-9b08ea5138be None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:04.045256 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c39300c3-b472-4d91-bb3c-9b08ea5138be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:04.088387 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1355/2670] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:04.101282 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:04.102796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692f045-4912-479b-bfec-b8b2cab1e724 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:04.104293 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6692f045-4912-479b-bfec-b8b2cab1e724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:04.138014 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1316/2671] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:04.153635 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39300c3-b472-4d91-bb3c-9b08ea5138be None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:04.155483 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-c39300c3-b472-4d91-bb3c-9b08ea5138be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:04.190193 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692f045-4912-479b-bfec-b8b2cab1e724 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:04.251219 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:04.258834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39300c3-b472-4d91-bb3c-9b08ea5138be None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:04.261406 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a554caa-62d9-49ff-b66a-343b4bd166bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:04.262181 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a554caa-62d9-49ff-b66a-343b4bd166bb service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:04.262474 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a554caa-62d9-49ff-b66a-343b4bd166bb service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:04.262759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a554caa-62d9-49ff-b66a-343b4bd166bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:04.263284 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1585b1d-1649-4053-b5ed-6816c768ed10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:04.264481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1585b1d-1649-4053-b5ed-6816c768ed10 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:04.264822 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1585b1d-1649-4053-b5ed-6816c768ed10 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:04.265170 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1585b1d-1649-4053-b5ed-6816c768ed10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:04.279161 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a554caa-62d9-49ff-b66a-343b4bd166bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:04.280843 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a554caa-62d9-49ff-b66a-343b4bd166bb service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:04.281033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1585b1d-1649-4053-b5ed-6816c768ed10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:04.282560 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1585b1d-1649-4053-b5ed-6816c768ed10 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:04.293247 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1356/2672] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:04.294754 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1317/2673] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:05:04.847709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a554caa-62d9-49ff-b66a-343b4bd166bb service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:04.847709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-0a554caa-62d9-49ff-b66a-343b4bd166bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:04.875729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a554caa-62d9-49ff-b66a-343b4bd166bb service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:04.886693 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06645a0-d5a7-49ae-bf31-3850f9c25d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:04.887722 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06645a0-d5a7-49ae-bf31-3850f9c25d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:04.888170 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06645a0-d5a7-49ae-bf31-3850f9c25d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:04.888459 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06645a0-d5a7-49ae-bf31-3850f9c25d68 admin admin] PATH_INFO: `/v3/projects/9cfeae41cd014ed39f65d3b4ee9807b7` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:04.889703 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06645a0-d5a7-49ae-bf31-3850f9c25d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cfeae41cd014ed39f65d3b4ee9807b7)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:04.892199 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06645a0-d5a7-49ae-bf31-3850f9c25d68 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:04.915263 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1585b1d-1649-4053-b5ed-6816c768ed10 service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:04.918767 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e1585b1d-1649-4053-b5ed-6816c768ed10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:04.940879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1585b1d-1649-4053-b5ed-6816c768ed10 service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:04.955995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37154a72-0acc-4be5-aee0-9cdbf570e815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:04.959329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37154a72-0acc-4be5-aee0-9cdbf570e815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:04.959818 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37154a72-0acc-4be5-aee0-9cdbf570e815 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:04.961110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37154a72-0acc-4be5-aee0-9cdbf570e815 admin admin] PATH_INFO: `/v3/projects/26e643c495c44c0ba8aa570d66b2a913` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:04.971529 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37154a72-0acc-4be5-aee0-9cdbf570e815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26e643c495c44c0ba8aa570d66b2a913)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:04.977311 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37154a72-0acc-4be5-aee0-9cdbf570e815 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:05.113377 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f06645a0-d5a7-49ae-bf31-3850f9c25d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cfeae41cd014ed39f65d3b4ee9807b7', 'request_id': 'req-f06645a0-d5a7-49ae-bf31-3850f9c25d68'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:05.122935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f06645a0-d5a7-49ae-bf31-3850f9c25d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cfeae41cd014ed39f65d3b4ee9807b7', 'request_id': 'req-f06645a0-d5a7-49ae-bf31-3850f9c25d68'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:05.124656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-37154a72-0acc-4be5-aee0-9cdbf570e815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26e643c495c44c0ba8aa570d66b2a913', 'request_id': 'req-37154a72-0acc-4be5-aee0-9cdbf570e815'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:05.208269 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f06645a0-d5a7-49ae-bf31-3850f9c25d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cfeae41cd014ed39f65d3b4ee9807b7', 'request_id': 'req-f06645a0-d5a7-49ae-bf31-3850f9c25d68'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:05.231803 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f06645a0-d5a7-49ae-bf31-3850f9c25d68 admin admin] The token cache is being invalidate because project 9cfeae41cd014ed39f65d3b4ee9807b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:05.232154 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f06645a0-d5a7-49ae-bf31-3850f9c25d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:05.232923 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-f06645a0-d5a7-49ae-bf31-3850f9c25d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:05.235197 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1357/2674] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:04 2022] DELETE /identity/v3/projects/9cfeae41cd014ed39f65d3b4ee9807b7 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:05.242958 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2132c0-b0aa-47ae-a9eb-3fa1b03fc5b1 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:05.243281 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2132c0-b0aa-47ae-a9eb-3fa1b03fc5b1 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:05.243552 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2132c0-b0aa-47ae-a9eb-3fa1b03fc5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:05.280365 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-0a2132c0-b0aa-47ae-a9eb-3fa1b03fc5b1 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:05.281772 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-0a2132c0-b0aa-47ae-a9eb-3fa1b03fc5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:05.282400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-37154a72-0acc-4be5-aee0-9cdbf570e815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26e643c495c44c0ba8aa570d66b2a913', 'request_id': 'req-37154a72-0acc-4be5-aee0-9cdbf570e815'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:05.291429 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-37154a72-0acc-4be5-aee0-9cdbf570e815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26e643c495c44c0ba8aa570d66b2a913', 'request_id': 'req-37154a72-0acc-4be5-aee0-9cdbf570e815'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:05.324580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-37154a72-0acc-4be5-aee0-9cdbf570e815 admin admin] The token cache is being invalidate because project 26e643c495c44c0ba8aa570d66b2a913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:05.326105 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-37154a72-0acc-4be5-aee0-9cdbf570e815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:05.327837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-37154a72-0acc-4be5-aee0-9cdbf570e815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:05.336195 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1318/2675] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:04 2022] DELETE /identity/v3/projects/26e643c495c44c0ba8aa570d66b2a913 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:05.339213 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d894d4-2d63-4840-a545-f7c76b26e7a3 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:05.341363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d894d4-2d63-4840-a545-f7c76b26e7a3 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:05.341731 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d894d4-2d63-4840-a545-f7c76b26e7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:05.384580 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-32d894d4-2d63-4840-a545-f7c76b26e7a3 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:05.388365 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-32d894d4-2d63-4840-a545-f7c76b26e7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:05.423151 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1358/2676] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:05.433074 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e0b49-0c7c-4c80-9eef-9cbba5c55675 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:05.433557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e0b49-0c7c-4c80-9eef-9cbba5c55675 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:05.433946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e0b49-0c7c-4c80-9eef-9cbba5c55675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:05.463157 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-166e0b49-0c7c-4c80-9eef-9cbba5c55675 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:05.463157 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-166e0b49-0c7c-4c80-9eef-9cbba5c55675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:05.476514 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1359/2677] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:05.479269 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1319/2678] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:05.487183 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d894d4-2d63-4840-a545-f7c76b26e7a3 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:05.489465 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ad71d-c432-4fd1-b2e5-e2fbb1f67520 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:05.493105 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ad71d-c432-4fd1-b2e5-e2fbb1f67520 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:05.500026 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ad71d-c432-4fd1-b2e5-e2fbb1f67520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:05.502796 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d894d4-2d63-4840-a545-f7c76b26e7a3 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:05.514280 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a4bca-9b52-44f5-ad43-1d2832c6b82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:05.514991 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a4bca-9b52-44f5-ad43-1d2832c6b82c admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:05.517211 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a4bca-9b52-44f5-ad43-1d2832c6b82c admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:05.517211 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a4bca-9b52-44f5-ad43-1d2832c6b82c admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:05.517211 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a4bca-9b52-44f5-ad43-1d2832c6b82c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:05:05.517500 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-bc4ad71d-c432-4fd1-b2e5-e2fbb1f67520 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:05.517596 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a4bca-9b52-44f5-ad43-1d2832c6b82c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:05.518090 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-bc4ad71d-c432-4fd1-b2e5-e2fbb1f67520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:05.518444 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a4bca-9b52-44f5-ad43-1d2832c6b82c admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:05.528127 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1360/2679] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:05.529240 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:05.534030 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ad71d-c432-4fd1-b2e5-e2fbb1f67520 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:05.545540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1320/2680] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:05:05.550093 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a4bca-9b52-44f5-ad43-1d2832c6b82c admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:05.552285 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ad71d-c432-4fd1-b2e5-e2fbb1f67520 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:05.558793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1160b-244d-4a06-8351-666a32d2ce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:05.559201 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1160b-244d-4a06-8351-666a32d2ce1c admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:05.559527 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1160b-244d-4a06-8351-666a32d2ce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:05.559851 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1160b-244d-4a06-8351-666a32d2ce1c admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:05.560582 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1160b-244d-4a06-8351-666a32d2ce1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:05:05.560938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1160b-244d-4a06-8351-666a32d2ce1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:05.562575 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1160b-244d-4a06-8351-666a32d2ce1c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:05.563070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a4bca-9b52-44f5-ad43-1d2832c6b82c admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:05.572033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8a429-a600-4848-997e-b03f5ed281bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:05.573444 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8a429-a600-4848-997e-b03f5ed281bc admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:05.573805 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8a429-a600-4848-997e-b03f5ed281bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:05.574214 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8a429-a600-4848-997e-b03f5ed281bc admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:05.575042 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8a429-a600-4848-997e-b03f5ed281bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:05.576797 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1361/2681] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:05:05.577406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8a429-a600-4848-997e-b03f5ed281bc admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:05.580706 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1160b-244d-4a06-8351-666a32d2ce1c admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:05.592318 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1160b-244d-4a06-8351-666a32d2ce1c admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:05.598176 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c3b77-8650-4e92-8401-b0fc8b97e3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:05.598865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c3b77-8650-4e92-8401-b0fc8b97e3be admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:05.599209 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c3b77-8650-4e92-8401-b0fc8b97e3be admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:05.599470 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c3b77-8650-4e92-8401-b0fc8b97e3be admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:05.600227 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c3b77-8650-4e92-8401-b0fc8b97e3be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:05.602704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c3b77-8650-4e92-8401-b0fc8b97e3be admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:05.672134 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1321/2682] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:05 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:05:05.677187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8a429-a600-4848-997e-b03f5ed281bc admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:05.725294 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1362/2683] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:05 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:05:05.729535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c3b77-8650-4e92-8401-b0fc8b97e3be admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:05.762020 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8a429-a600-4848-997e-b03f5ed281bc admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:05.764032 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:05.811030 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c3b77-8650-4e92-8401-b0fc8b97e3be admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:05.818213 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8f15c-2917-4c9a-b039-82a2c218d054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:05.819016 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8f15c-2917-4c9a-b039-82a2c218d054 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:05.819350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8f15c-2917-4c9a-b039-82a2c218d054 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:05.819696 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8f15c-2917-4c9a-b039-82a2c218d054 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:05.820415 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8f15c-2917-4c9a-b039-82a2c218d054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:05.822429 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8f15c-2917-4c9a-b039-82a2c218d054 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:05.848681 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc4558-d1ba-4234-a55f-90d9423458cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:05.849814 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc4558-d1ba-4234-a55f-90d9423458cc admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:05.850224 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc4558-d1ba-4234-a55f-90d9423458cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:05.850856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc4558-d1ba-4234-a55f-90d9423458cc admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:05.851739 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc4558-d1ba-4234-a55f-90d9423458cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:05.854053 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc4558-d1ba-4234-a55f-90d9423458cc admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:05.907097 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1363/2684] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:05 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:05:05.911564 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8f15c-2917-4c9a-b039-82a2c218d054 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:05.924100 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8f15c-2917-4c9a-b039-82a2c218d054 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:05.930554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f967f-cc61-4055-b869-d64f935ee115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:05.931304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f967f-cc61-4055-b869-d64f935ee115 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:05.931848 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f967f-cc61-4055-b869-d64f935ee115 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:05.932223 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f967f-cc61-4055-b869-d64f935ee115 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:05.933204 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f967f-cc61-4055-b869-d64f935ee115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:05.937223 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1322/2685] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:05 2022] POST /identity/v3/users => generated 286 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:05:05.940837 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f967f-cc61-4055-b869-d64f935ee115 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:05.940967 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc4558-d1ba-4234-a55f-90d9423458cc admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:05.954311 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1364/2686] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:05.955896 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f967f-cc61-4055-b869-d64f935ee115 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:05.956798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc4558-d1ba-4234-a55f-90d9423458cc admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:05.962468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b1da2-7487-4da4-ba66-f581ee7b7c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:05.963169 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b1da2-7487-4da4-ba66-f581ee7b7c2d admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:05.963455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b1da2-7487-4da4-ba66-f581ee7b7c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:05.963733 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b1da2-7487-4da4-ba66-f581ee7b7c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:05.967350 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b1da2-7487-4da4-ba66-f581ee7b7c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:05.971145 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b1da2-7487-4da4-ba66-f581ee7b7c2d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:05.972203 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f967f-cc61-4055-b869-d64f935ee115 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:05.978382 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e6c5c-9cfe-4077-998b-66ced8080bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:05.979237 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e6c5c-9cfe-4077-998b-66ced8080bfc admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:05.979618 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e6c5c-9cfe-4077-998b-66ced8080bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:05.979997 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e6c5c-9cfe-4077-998b-66ced8080bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:05.980917 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e6c5c-9cfe-4077-998b-66ced8080bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:05.984018 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1323/2687] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:05.984185 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e6c5c-9cfe-4077-998b-66ced8080bfc admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:05.992430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b1da2-7487-4da4-ba66-f581ee7b7c2d admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:05.997391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1365/2688] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:06.001893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e6c5c-9cfe-4077-998b-66ced8080bfc admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:06.004527 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b1da2-7487-4da4-ba66-f581ee7b7c2d admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:06.013572 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02cbf4-d2b3-49f9-b4ef-0777f95ba8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:06.014430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02cbf4-d2b3-49f9-b4ef-0777f95ba8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:06.014718 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02cbf4-d2b3-49f9-b4ef-0777f95ba8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:06.014996 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02cbf4-d2b3-49f9-b4ef-0777f95ba8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:06.015777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02cbf4-d2b3-49f9-b4ef-0777f95ba8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:06.017440 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02cbf4-d2b3-49f9-b4ef-0777f95ba8f0 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:06.018578 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e6c5c-9cfe-4077-998b-66ced8080bfc admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:06.024177 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63838aec-9639-47cd-82f1-93f120641310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:06.025445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63838aec-9639-47cd-82f1-93f120641310 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:06.026079 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63838aec-9639-47cd-82f1-93f120641310 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:06.026452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63838aec-9639-47cd-82f1-93f120641310 admin admin] PATH_INFO: `/v3/projects/9ea42a1ac47c47e9be0db8cf3f5e201d/users/133e870fdcec4b19822e8a5b849d70de/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:06.034177 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1324/2689] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:06.035150 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02cbf4-d2b3-49f9-b4ef-0777f95ba8f0 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:06.048834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02cbf4-d2b3-49f9-b4ef-0777f95ba8f0 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:06.052134 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63838aec-9639-47cd-82f1-93f120641310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea42a1ac47c47e9be0db8cf3f5e201d, user_id=133e870fdcec4b19822e8a5b849d70de, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:06.055127 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63838aec-9639-47cd-82f1-93f120641310 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:06.056006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04378b45-8d0d-41a4-9568-db1b577618b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:06.057573 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04378b45-8d0d-41a4-9568-db1b577618b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:06.057927 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04378b45-8d0d-41a4-9568-db1b577618b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:06.058400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04378b45-8d0d-41a4-9568-db1b577618b1 admin admin] PATH_INFO: `/v3/projects/d117b958d466410aa0b5705368d083d2/users/93958adbf45a45e8897aca781d6db4c0/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:06.077444 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04378b45-8d0d-41a4-9568-db1b577618b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d117b958d466410aa0b5705368d083d2, user_id=93958adbf45a45e8897aca781d6db4c0, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:06.080779 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04378b45-8d0d-41a4-9568-db1b577618b1 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:06.151740 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1366/2690] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:06 2022] PUT /identity/v3/projects/9ea42a1ac47c47e9be0db8cf3f5e201d/users/133e870fdcec4b19822e8a5b849d70de/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:06.162691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b863d-a00a-4c73-93ce-cd4f1ddfb2dd None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:06.162984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b863d-a00a-4c73-93ce-cd4f1ddfb2dd None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:06.163266 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b863d-a00a-4c73-93ce-cd4f1ddfb2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:06.193247 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1325/2691] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:06 2022] PUT /identity/v3/projects/d117b958d466410aa0b5705368d083d2/users/93958adbf45a45e8897aca781d6db4c0/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:05:06.198169 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010271eb-9540-49c5-920b-fc128e28930b None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:06.200717 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010271eb-9540-49c5-920b-fc128e28930b None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:06.200717 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010271eb-9540-49c5-920b-fc128e28930b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:06.207774 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-d24b863d-a00a-4c73-93ce-cd4f1ddfb2dd None None] MFA Rules not processed for user `133e870fdcec4b19822e8a5b849d70de`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:06.209132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d24b863d-a00a-4c73-93ce-cd4f1ddfb2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:06.233749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-010271eb-9540-49c5-920b-fc128e28930b None None] MFA Rules not processed for user `93958adbf45a45e8897aca781d6db4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:06.235321 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-010271eb-9540-49c5-920b-fc128e28930b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:06.256818 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:06.305330 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1367/2692] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:06.318724 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b863d-a00a-4c73-93ce-cd4f1ddfb2dd None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:06.321571 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d24b863d-a00a-4c73-93ce-cd4f1ddfb2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:06.344783 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1326/2693] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:06.357563 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010271eb-9540-49c5-920b-fc128e28930b None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:06.359578 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-010271eb-9540-49c5-920b-fc128e28930b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:06.393655 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b863d-a00a-4c73-93ce-cd4f1ddfb2dd None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:06.400023 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbfccc-eade-4ad4-be7a-8cbc7735ff68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:06.400625 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbfccc-eade-4ad4-be7a-8cbc7735ff68 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:06.400903 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbfccc-eade-4ad4-be7a-8cbc7735ff68 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:06.401186 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbfccc-eade-4ad4-be7a-8cbc7735ff68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:06.412618 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddbfccc-eade-4ad4-be7a-8cbc7735ff68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:06.414091 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddbfccc-eade-4ad4-be7a-8cbc7735ff68 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:06.417905 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:06.427751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1368/2694] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:05:06.464762 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010271eb-9540-49c5-920b-fc128e28930b None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:06.469753 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01aa35-23b4-482c-8607-76d0a0fb2d9c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06498e12426947908d5217e2c948519d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:06.470693 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01aa35-23b4-482c-8607-76d0a0fb2d9c service glance] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:06.473930 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01aa35-23b4-482c-8607-76d0a0fb2d9c service glance] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:06.473930 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01aa35-23b4-482c-8607-76d0a0fb2d9c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:06.482292 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01aa35-23b4-482c-8607-76d0a0fb2d9c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:06.484108 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01aa35-23b4-482c-8607-76d0a0fb2d9c service glance] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:06.498068 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1327/2695] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:05:08.236172 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7d57f-9c61-4c60-b5e7-2b87c5cdc417 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:08.236707 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7d57f-9c61-4c60-b5e7-2b87c5cdc417 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:08.236809 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7d57f-9c61-4c60-b5e7-2b87c5cdc417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:08.256260 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-89b7d57f-9c61-4c60-b5e7-2b87c5cdc417 None None] MFA Rules not processed for user `8fa38ff2dae2460ea363f1c3448d533c`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:08.257547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-89b7d57f-9c61-4c60-b5e7-2b87c5cdc417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:08.317750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1369/2696] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:08.588004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01aa35-23b4-482c-8607-76d0a0fb2d9c service glance] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:08.589556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ad01aa35-23b4-482c-8607-76d0a0fb2d9c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:08.652915 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01aa35-23b4-482c-8607-76d0a0fb2d9c service glance] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:08.656450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa270d5-99b8-450d-b360-ffd9b0c06a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:08.657134 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa270d5-99b8-450d-b360-ffd9b0c06a8a service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:08.657421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa270d5-99b8-450d-b360-ffd9b0c06a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:08.657696 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa270d5-99b8-450d-b360-ffd9b0c06a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:08.659520 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-faa270d5-99b8-450d-b360-ffd9b0c06a8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:08.670750 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa270d5-99b8-450d-b360-ffd9b0c06a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:08.672431 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa270d5-99b8-450d-b360-ffd9b0c06a8a service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:08.681618 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1328/2697] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:12.000141 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51665a24-89bf-4b84-8b30-f8e2698a4ce5 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:12.000691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51665a24-89bf-4b84-8b30-f8e2698a4ce5 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:12.000809 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51665a24-89bf-4b84-8b30-f8e2698a4ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:12.024003 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-51665a24-89bf-4b84-8b30-f8e2698a4ce5 None None] MFA Rules not processed for user `1b03d940626a449dbe904f02f3d70854`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:12.025281 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-51665a24-89bf-4b84-8b30-f8e2698a4ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:12.086046 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1370/2698] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 23 11:05:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:12.101038 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa270d5-99b8-450d-b360-ffd9b0c06a8a service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:12.102624 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-faa270d5-99b8-450d-b360-ffd9b0c06a8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:12.176490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:12.191291 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa270d5-99b8-450d-b360-ffd9b0c06a8a service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:12.202110 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38aa04-5b21-453d-888a-16ecd5474768 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a54fa1c326f41e88688404a56b75c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:12.202944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38aa04-5b21-453d-888a-16ecd5474768 service swift] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:12.203232 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38aa04-5b21-453d-888a-16ecd5474768 service swift] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:12.203506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38aa04-5b21-453d-888a-16ecd5474768 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:12.214032 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38aa04-5b21-453d-888a-16ecd5474768 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:12.215697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38aa04-5b21-453d-888a-16ecd5474768 service swift] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:12.236127 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1329/2699] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 23 11:05:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:05:22.078819 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=51 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:22.224565 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=6 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:23.524865 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51665a24-89bf-4b84-8b30-f8e2698a4ce5 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:23.602796 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51665a24-89bf-4b84-8b30-f8e2698a4ce5 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:23.607728 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae6c27-ae46-4796-8b69-0665b657f476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:23.608615 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae6c27-ae46-4796-8b69-0665b657f476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:23.609361 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae6c27-ae46-4796-8b69-0665b657f476 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:23.609361 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae6c27-ae46-4796-8b69-0665b657f476 admin admin] PATH_INFO: `/v3/users/133e870fdcec4b19822e8a5b849d70de` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:23.610428 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae6c27-ae46-4796-8b69-0665b657f476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=133e870fdcec4b19822e8a5b849d70de)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:23.613028 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae6c27-ae46-4796-8b69-0665b657f476 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:23.816018 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-8eae6c27-ae46-4796-8b69-0665b657f476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '133e870fdcec4b19822e8a5b849d70de'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:23.823124 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-8eae6c27-ae46-4796-8b69-0665b657f476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '133e870fdcec4b19822e8a5b849d70de'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:23.905153 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-8eae6c27-ae46-4796-8b69-0665b657f476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '133e870fdcec4b19822e8a5b849d70de'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:23.905886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-8eae6c27-ae46-4796-8b69-0665b657f476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '133e870fdcec4b19822e8a5b849d70de'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:23.906401 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-8eae6c27-ae46-4796-8b69-0665b657f476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '133e870fdcec4b19822e8a5b849d70de'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:23.928482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1371/2700] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:23 2022] DELETE /identity/v3/users/133e870fdcec4b19822e8a5b849d70de => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:23.933514 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334df20-ded0-428f-ae34-9e671ac9f15c None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:23.934038 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334df20-ded0-428f-ae34-9e671ac9f15c None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:23.934196 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334df20-ded0-428f-ae34-9e671ac9f15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:23.952131 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-b334df20-ded0-428f-ae34-9e671ac9f15c None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:23.953370 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-b334df20-ded0-428f-ae34-9e671ac9f15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:24.024171 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1330/2701] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:24.033652 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae6c27-ae46-4796-8b69-0665b657f476 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:24.035133 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-8eae6c27-ae46-4796-8b69-0665b657f476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:24.099056 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae6c27-ae46-4796-8b69-0665b657f476 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:24.108013 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16431d8e-9ba0-4757-9032-c676e40fdd67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:24.108013 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16431d8e-9ba0-4757-9032-c676e40fdd67 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:24.108013 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16431d8e-9ba0-4757-9032-c676e40fdd67 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:24.108013 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16431d8e-9ba0-4757-9032-c676e40fdd67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:24.114883 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16431d8e-9ba0-4757-9032-c676e40fdd67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:24.116528 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16431d8e-9ba0-4757-9032-c676e40fdd67 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:24.126946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1372/2702] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:24.764556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334df20-ded0-428f-ae34-9e671ac9f15c None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:24.766111 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-b334df20-ded0-428f-ae34-9e671ac9f15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:24.783916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334df20-ded0-428f-ae34-9e671ac9f15c None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:24.788876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a65f8a-1447-4ced-b7da-2d19a1d662e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:24.790299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a65f8a-1447-4ced-b7da-2d19a1d662e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:24.790299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a65f8a-1447-4ced-b7da-2d19a1d662e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:24.790299 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a65f8a-1447-4ced-b7da-2d19a1d662e7 admin admin] PATH_INFO: `/v3/projects/9ea42a1ac47c47e9be0db8cf3f5e201d` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:24.791485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a65f8a-1447-4ced-b7da-2d19a1d662e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ea42a1ac47c47e9be0db8cf3f5e201d)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:24.793494 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a65f8a-1447-4ced-b7da-2d19a1d662e7 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:24.906521 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-66a65f8a-1447-4ced-b7da-2d19a1d662e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ea42a1ac47c47e9be0db8cf3f5e201d', 'request_id': 'req-66a65f8a-1447-4ced-b7da-2d19a1d662e7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:24.968062 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-66a65f8a-1447-4ced-b7da-2d19a1d662e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ea42a1ac47c47e9be0db8cf3f5e201d', 'request_id': 'req-66a65f8a-1447-4ced-b7da-2d19a1d662e7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:24.975259 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-66a65f8a-1447-4ced-b7da-2d19a1d662e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ea42a1ac47c47e9be0db8cf3f5e201d', 'request_id': 'req-66a65f8a-1447-4ced-b7da-2d19a1d662e7'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:24.989284 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-66a65f8a-1447-4ced-b7da-2d19a1d662e7 admin admin] The token cache is being invalidate because project 9ea42a1ac47c47e9be0db8cf3f5e201d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:24.989575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-66a65f8a-1447-4ced-b7da-2d19a1d662e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:24.990383 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-66a65f8a-1447-4ced-b7da-2d19a1d662e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:24.993170 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1331/2703] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:24 2022] DELETE /identity/v3/projects/9ea42a1ac47c47e9be0db8cf3f5e201d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:24.997850 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57c908-a039-43c1-a722-799c833836aa None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:24.998330 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57c908-a039-43c1-a722-799c833836aa None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:24.998558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57c908-a039-43c1-a722-799c833836aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:25.017076 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-cc57c908-a039-43c1-a722-799c833836aa None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:25.018308 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-cc57c908-a039-43c1-a722-799c833836aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:25.040263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:25.101862 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1373/2704] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:25.110621 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663b242-6564-4599-9c87-e870d2538c23 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:25.114879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663b242-6564-4599-9c87-e870d2538c23 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:25.114879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663b242-6564-4599-9c87-e870d2538c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:25.131056 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-b663b242-6564-4599-9c87-e870d2538c23 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:25.132326 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-b663b242-6564-4599-9c87-e870d2538c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:25.141260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1332/2705] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:25.145516 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57c908-a039-43c1-a722-799c833836aa None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:25.155604 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57c908-a039-43c1-a722-799c833836aa None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:25.161779 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4f382-6e00-480f-80bf-04dcc581957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:25.162527 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4f382-6e00-480f-80bf-04dcc581957a admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:25.162813 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4f382-6e00-480f-80bf-04dcc581957a admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:25.163735 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4f382-6e00-480f-80bf-04dcc581957a admin admin] PATH_INFO: `/v3/domains` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:25.164384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4f382-6e00-480f-80bf-04dcc581957a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92003) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:05:25.164736 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4f382-6e00-480f-80bf-04dcc581957a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:25.166431 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4f382-6e00-480f-80bf-04dcc581957a admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:25.178677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1374/2706] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:05:25.184183 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663b242-6564-4599-9c87-e870d2538c23 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:25.193689 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663b242-6564-4599-9c87-e870d2538c23 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:25.198844 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a5867-a567-4985-b651-3e002259f166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:25.205254 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a5867-a567-4985-b651-3e002259f166 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:25.205254 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a5867-a567-4985-b651-3e002259f166 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:25.205254 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a5867-a567-4985-b651-3e002259f166 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:25.205254 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a5867-a567-4985-b651-3e002259f166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:25.205254 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a5867-a567-4985-b651-3e002259f166 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:25.310720 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1333/2707] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:25 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:25.311926 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4f382-6e00-480f-80bf-04dcc581957a admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:25.322310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4f382-6e00-480f-80bf-04dcc581957a admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:25.379230 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5823a-648c-462c-92e2-799f2d7afa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:25.379894 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5823a-648c-462c-92e2-799f2d7afa69 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:25.380179 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5823a-648c-462c-92e2-799f2d7afa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:25.380457 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5823a-648c-462c-92e2-799f2d7afa69 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:25.381246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5823a-648c-462c-92e2-799f2d7afa69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:25.383499 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5823a-648c-462c-92e2-799f2d7afa69 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:25.468206 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1375/2708] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:25 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:25.469931 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a5867-a567-4985-b651-3e002259f166 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:25.481632 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a5867-a567-4985-b651-3e002259f166 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:25.486441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864d265-1fc4-4c2a-95fe-92c6f311ab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:25.487155 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864d265-1fc4-4c2a-95fe-92c6f311ab16 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:25.487441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864d265-1fc4-4c2a-95fe-92c6f311ab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:25.487756 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864d265-1fc4-4c2a-95fe-92c6f311ab16 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:25.488585 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864d265-1fc4-4c2a-95fe-92c6f311ab16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:25.490338 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864d265-1fc4-4c2a-95fe-92c6f311ab16 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:25.501595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1334/2709] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:25.505614 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5823a-648c-462c-92e2-799f2d7afa69 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:25.516232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5823a-648c-462c-92e2-799f2d7afa69 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:25.520932 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522e60f-4560-4d30-95a1-34231faf901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:25.521594 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522e60f-4560-4d30-95a1-34231faf901d admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:25.521880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522e60f-4560-4d30-95a1-34231faf901d admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:25.522161 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522e60f-4560-4d30-95a1-34231faf901d admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:25.523680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522e60f-4560-4d30-95a1-34231faf901d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:25.525300 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522e60f-4560-4d30-95a1-34231faf901d admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:25.535874 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1376/2710] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:25.540506 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864d265-1fc4-4c2a-95fe-92c6f311ab16 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:25.550923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864d265-1fc4-4c2a-95fe-92c6f311ab16 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:25.555616 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176ad8e-c662-4436-80b9-b63a69ca88be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:25.557455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176ad8e-c662-4436-80b9-b63a69ca88be admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:25.557455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176ad8e-c662-4436-80b9-b63a69ca88be admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:25.557455 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176ad8e-c662-4436-80b9-b63a69ca88be admin admin] PATH_INFO: `/v3/projects/0e4e68e0df894e7b9e1a694306f5c744/users/d24191f449a647f288d624fc940abbc5/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:25.573697 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176ad8e-c662-4436-80b9-b63a69ca88be admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4e68e0df894e7b9e1a694306f5c744, user_id=d24191f449a647f288d624fc940abbc5, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:25.577389 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176ad8e-c662-4436-80b9-b63a69ca88be admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:25.648752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1335/2711] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:25 2022] PUT /identity/v3/projects/0e4e68e0df894e7b9e1a694306f5c744/users/d24191f449a647f288d624fc940abbc5/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:25.658991 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09f961-0407-4263-858e-879231e6ab97 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:25.659284 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09f961-0407-4263-858e-879231e6ab97 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:25.659558 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09f961-0407-4263-858e-879231e6ab97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:25.687286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-ae09f961-0407-4263-858e-879231e6ab97 None None] MFA Rules not processed for user `d24191f449a647f288d624fc940abbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:25.688452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ae09f961-0407-4263-858e-879231e6ab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:25.756211 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1377/2712] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:25.761603 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176ad8e-c662-4436-80b9-b63a69ca88be admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:25.783454 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:25.825619 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176ad8e-c662-4436-80b9-b63a69ca88be admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:25.831798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77917971-88a7-4bd3-ba36-b669173ae0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:25.832743 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77917971-88a7-4bd3-ba36-b669173ae0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:25.833269 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77917971-88a7-4bd3-ba36-b669173ae0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:25.833538 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77917971-88a7-4bd3-ba36-b669173ae0f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:25.834250 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77917971-88a7-4bd3-ba36-b669173ae0f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:25.836903 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77917971-88a7-4bd3-ba36-b669173ae0f1 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:25.929556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1336/2713] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:25 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:05:25.931128 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09f961-0407-4263-858e-879231e6ab97 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:25.942953 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09f961-0407-4263-858e-879231e6ab97 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:25.957286 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:26.004619 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb764a6-dfe9-4043-b4d0-cc3407642d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:26.007585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb764a6-dfe9-4043-b4d0-cc3407642d68 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:26.008339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb764a6-dfe9-4043-b4d0-cc3407642d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:26.013447 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb764a6-dfe9-4043-b4d0-cc3407642d68 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:26.014236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb764a6-dfe9-4043-b4d0-cc3407642d68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:26.016992 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb764a6-dfe9-4043-b4d0-cc3407642d68 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:26.100096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1378/2714] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:25 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:26.104413 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77917971-88a7-4bd3-ba36-b669173ae0f1 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:26.118810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77917971-88a7-4bd3-ba36-b669173ae0f1 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:26.125540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0d317-f874-435d-ae94-67f915c2606a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:26.126294 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0d317-f874-435d-ae94-67f915c2606a admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:26.126641 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0d317-f874-435d-ae94-67f915c2606a admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:26.126957 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0d317-f874-435d-ae94-67f915c2606a admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:26.127886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0d317-f874-435d-ae94-67f915c2606a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:26.130037 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0d317-f874-435d-ae94-67f915c2606a admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:26.142149 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1337/2715] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:05:26.146097 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb764a6-dfe9-4043-b4d0-cc3407642d68 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:26.156158 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb764a6-dfe9-4043-b4d0-cc3407642d68 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:26.160922 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddce41f-df03-4bdf-8ac2-d58566adba5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:26.164005 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddce41f-df03-4bdf-8ac2-d58566adba5e admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:26.164005 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddce41f-df03-4bdf-8ac2-d58566adba5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:26.164005 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddce41f-df03-4bdf-8ac2-d58566adba5e admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:26.164005 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddce41f-df03-4bdf-8ac2-d58566adba5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:26.164432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddce41f-df03-4bdf-8ac2-d58566adba5e admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:26.174476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1379/2716] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:26.180312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0d317-f874-435d-ae94-67f915c2606a admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:26.190809 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0d317-f874-435d-ae94-67f915c2606a admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:26.196534 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91dd02-5290-4fe5-9125-ac9290152a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:26.197514 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91dd02-5290-4fe5-9125-ac9290152a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:26.197798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91dd02-5290-4fe5-9125-ac9290152a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:26.198073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91dd02-5290-4fe5-9125-ac9290152a51 admin admin] PATH_INFO: `/v3/projects/e376b4ca0e5a4c898e19adbd2ea13f0b/users/63a2530a72b0420689375defd53617f3/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:26.213663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91dd02-5290-4fe5-9125-ac9290152a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e376b4ca0e5a4c898e19adbd2ea13f0b, user_id=63a2530a72b0420689375defd53617f3, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:26.217408 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91dd02-5290-4fe5-9125-ac9290152a51 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:26.323001 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1338/2717] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:26 2022] PUT /identity/v3/projects/e376b4ca0e5a4c898e19adbd2ea13f0b/users/63a2530a72b0420689375defd53617f3/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:26.333096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320399a-9efb-4285-bd79-4c4c67a7f3f8 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:26.333388 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320399a-9efb-4285-bd79-4c4c67a7f3f8 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:26.333674 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320399a-9efb-4285-bd79-4c4c67a7f3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:26.363983 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-6320399a-9efb-4285-bd79-4c4c67a7f3f8 None None] MFA Rules not processed for user `63a2530a72b0420689375defd53617f3`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:26.365250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6320399a-9efb-4285-bd79-4c4c67a7f3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:26.432405 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1380/2718] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:26.437429 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91dd02-5290-4fe5-9125-ac9290152a51 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:26.500343 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91dd02-5290-4fe5-9125-ac9290152a51 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:26.505359 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2732ee-4335-4c29-b979-f092ea3ab133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:26.506026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2732ee-4335-4c29-b979-f092ea3ab133 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:26.506329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2732ee-4335-4c29-b979-f092ea3ab133 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:26.507082 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2732ee-4335-4c29-b979-f092ea3ab133 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:26.507678 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2732ee-4335-4c29-b979-f092ea3ab133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:26.509669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2732ee-4335-4c29-b979-f092ea3ab133 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:26.602021 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1339/2719] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:26 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:26.606396 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320399a-9efb-4285-bd79-4c4c67a7f3f8 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:26.618702 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320399a-9efb-4285-bd79-4c4c67a7f3f8 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:26.676704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ae7af-9415-4235-bdc7-086080fe0931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:26.677392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ae7af-9415-4235-bdc7-086080fe0931 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:26.677679 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ae7af-9415-4235-bdc7-086080fe0931 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:26.677958 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ae7af-9415-4235-bdc7-086080fe0931 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:26.678713 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ae7af-9415-4235-bdc7-086080fe0931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:26.681157 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ae7af-9415-4235-bdc7-086080fe0931 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:26.780294 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1381/2720] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:26 2022] POST /identity/v3/users => generated 295 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:05:26.784320 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2732ee-4335-4c29-b979-f092ea3ab133 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:26.797262 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2732ee-4335-4c29-b979-f092ea3ab133 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:26.803364 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815f7c4-be35-42ba-bf5a-107d0d3c5da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:26.805407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815f7c4-be35-42ba-bf5a-107d0d3c5da2 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:26.805407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815f7c4-be35-42ba-bf5a-107d0d3c5da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:26.805734 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815f7c4-be35-42ba-bf5a-107d0d3c5da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:26.806486 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815f7c4-be35-42ba-bf5a-107d0d3c5da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:26.808148 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815f7c4-be35-42ba-bf5a-107d0d3c5da2 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:26.820372 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1340/2721] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:26.824338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ae7af-9415-4235-bdc7-086080fe0931 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:26.834538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ae7af-9415-4235-bdc7-086080fe0931 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:26.840283 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d6cc0-debc-4bc5-b73a-dabb78a1a9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:26.841309 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d6cc0-debc-4bc5-b73a-dabb78a1a9af admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:26.841595 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d6cc0-debc-4bc5-b73a-dabb78a1a9af admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:26.841878 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d6cc0-debc-4bc5-b73a-dabb78a1a9af admin admin] PATH_INFO: `/v3/projects/bb83323185ef453e84f62dde732d8691/users/3fe55fe9199c49ca82e4da6860e66d3f/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:26.857738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:26.859199 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d6cc0-debc-4bc5-b73a-dabb78a1a9af admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb83323185ef453e84f62dde732d8691, user_id=3fe55fe9199c49ca82e4da6860e66d3f, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:26.861997 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d6cc0-debc-4bc5-b73a-dabb78a1a9af admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:26.922664 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1382/2722] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:26 2022] PUT /identity/v3/projects/bb83323185ef453e84f62dde732d8691/users/3fe55fe9199c49ca82e4da6860e66d3f/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:26.926677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815f7c4-be35-42ba-bf5a-107d0d3c5da2 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:26.936508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815f7c4-be35-42ba-bf5a-107d0d3c5da2 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:26.981956 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:26.996627 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c1c4b-7366-4587-8496-8bf07dd794cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:26.997313 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c1c4b-7366-4587-8496-8bf07dd794cb admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:26.997623 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c1c4b-7366-4587-8496-8bf07dd794cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:26.997970 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c1c4b-7366-4587-8496-8bf07dd794cb admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:26.998714 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c1c4b-7366-4587-8496-8bf07dd794cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:27.000550 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c1c4b-7366-4587-8496-8bf07dd794cb admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:27.011558 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1341/2723] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:27.015750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d6cc0-debc-4bc5-b73a-dabb78a1a9af admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:27.027234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d6cc0-debc-4bc5-b73a-dabb78a1a9af admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:27.032745 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7fc6d-8247-41d9-9f1e-a6514460b5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:27.033905 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7fc6d-8247-41d9-9f1e-a6514460b5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:27.034192 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7fc6d-8247-41d9-9f1e-a6514460b5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:27.034471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7fc6d-8247-41d9-9f1e-a6514460b5ab admin admin] PATH_INFO: `/v3/projects/bb83323185ef453e84f62dde732d8691/users/3fe55fe9199c49ca82e4da6860e66d3f/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:27.036594 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7fc6d-8247-41d9-9f1e-a6514460b5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb83323185ef453e84f62dde732d8691, user_id=3fe55fe9199c49ca82e4da6860e66d3f, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:27.041722 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7fc6d-8247-41d9-9f1e-a6514460b5ab admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:27.051554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1383/2724] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:27 2022] PUT /identity/v3/projects/bb83323185ef453e84f62dde732d8691/users/3fe55fe9199c49ca82e4da6860e66d3f/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:27.120512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531544b-ff99-4c30-9289-c0dcb76f7477 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:27.121114 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531544b-ff99-4c30-9289-c0dcb76f7477 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:27.121114 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531544b-ff99-4c30-9289-c0dcb76f7477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:27.151198 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-0531544b-ff99-4c30-9289-c0dcb76f7477 None None] MFA Rules not processed for user `3fe55fe9199c49ca82e4da6860e66d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:27.152513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-0531544b-ff99-4c30-9289-c0dcb76f7477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:27.237355 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1342/2725] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:27.248631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7fc6d-8247-41d9-9f1e-a6514460b5ab admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:27.250379 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9ac7fc6d-8247-41d9-9f1e-a6514460b5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:27.308087 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7fc6d-8247-41d9-9f1e-a6514460b5ab admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:27.311826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee309a37-0ebd-4704-8600-1017f8617e35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:27.312552 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee309a37-0ebd-4704-8600-1017f8617e35 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:27.312811 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee309a37-0ebd-4704-8600-1017f8617e35 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:27.313094 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee309a37-0ebd-4704-8600-1017f8617e35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:27.372052 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee309a37-0ebd-4704-8600-1017f8617e35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:27.373542 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee309a37-0ebd-4704-8600-1017f8617e35 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:27.383470 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1384/2726] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:29.356605 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531544b-ff99-4c30-9289-c0dcb76f7477 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:29.367220 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531544b-ff99-4c30-9289-c0dcb76f7477 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:29.370916 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c59467-af28-48b5-ae17-03d16777990c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:29.371563 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c59467-af28-48b5-ae17-03d16777990c service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:29.371926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c59467-af28-48b5-ae17-03d16777990c service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:29.372339 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c59467-af28-48b5-ae17-03d16777990c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:29.434370 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c59467-af28-48b5-ae17-03d16777990c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:29.435810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c59467-af28-48b5-ae17-03d16777990c service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:29.446416 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1343/2727] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:30.899523 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee309a37-0ebd-4704-8600-1017f8617e35 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:30.908338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee309a37-0ebd-4704-8600-1017f8617e35 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:30.912158 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77916935-682d-4eb0-a936-1230a5b1da73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:30.912879 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77916935-682d-4eb0-a936-1230a5b1da73 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:30.913198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77916935-682d-4eb0-a936-1230a5b1da73 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:30.913478 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77916935-682d-4eb0-a936-1230a5b1da73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:30.922905 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77916935-682d-4eb0-a936-1230a5b1da73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:30.924337 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77916935-682d-4eb0-a936-1230a5b1da73 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:30.934335 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1385/2728] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:33.105310 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c59467-af28-48b5-ae17-03d16777990c service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:33.106738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-71c59467-af28-48b5-ae17-03d16777990c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:33.181921 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c59467-af28-48b5-ae17-03d16777990c service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:33.191452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408cf71-5106-404c-94d1-bb93a1440ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:33.191452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408cf71-5106-404c-94d1-bb93a1440ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:33.191452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408cf71-5106-404c-94d1-bb93a1440ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:33.191452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408cf71-5106-404c-94d1-bb93a1440ce8 admin admin] PATH_INFO: `/v3/users/93958adbf45a45e8897aca781d6db4c0` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:33.191864 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408cf71-5106-404c-94d1-bb93a1440ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93958adbf45a45e8897aca781d6db4c0)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:33.193419 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408cf71-5106-404c-94d1-bb93a1440ce8 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:33.201375 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:33.376485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8408cf71-5106-404c-94d1-bb93a1440ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93958adbf45a45e8897aca781d6db4c0'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:33.383635 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8408cf71-5106-404c-94d1-bb93a1440ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93958adbf45a45e8897aca781d6db4c0'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:33.384359 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8408cf71-5106-404c-94d1-bb93a1440ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93958adbf45a45e8897aca781d6db4c0'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:33.487775 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8408cf71-5106-404c-94d1-bb93a1440ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93958adbf45a45e8897aca781d6db4c0'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:33.488390 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-8408cf71-5106-404c-94d1-bb93a1440ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93958adbf45a45e8897aca781d6db4c0'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:33.507827 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1344/2729] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:33 2022] DELETE /identity/v3/users/93958adbf45a45e8897aca781d6db4c0 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:33.512610 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d07ffe-e0ce-4f22-aa5e-34cc16ac19be None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:33.513117 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d07ffe-e0ce-4f22-aa5e-34cc16ac19be None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:33.513263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d07ffe-e0ce-4f22-aa5e-34cc16ac19be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:33.531505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-74d07ffe-e0ce-4f22-aa5e-34cc16ac19be None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:33.532774 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-74d07ffe-e0ce-4f22-aa5e-34cc16ac19be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:33.593827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1386/2730] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:33.604364 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408cf71-5106-404c-94d1-bb93a1440ce8 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:33.605887 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8408cf71-5106-404c-94d1-bb93a1440ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:33.668151 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408cf71-5106-404c-94d1-bb93a1440ce8 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:33.671935 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72013876-cac4-478a-b2a9-17f2ab2a0113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:33.672608 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72013876-cac4-478a-b2a9-17f2ab2a0113 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:33.676659 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72013876-cac4-478a-b2a9-17f2ab2a0113 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:33.676659 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72013876-cac4-478a-b2a9-17f2ab2a0113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:33.682533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72013876-cac4-478a-b2a9-17f2ab2a0113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:33.684058 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72013876-cac4-478a-b2a9-17f2ab2a0113 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:33.693880 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1345/2731] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:34.148297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d07ffe-e0ce-4f22-aa5e-34cc16ac19be None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:34.151541 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-74d07ffe-e0ce-4f22-aa5e-34cc16ac19be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:34.172017 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d07ffe-e0ce-4f22-aa5e-34cc16ac19be None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:34.177903 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd3846-963e-405e-a5e6-c42c8a1fe735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:34.179076 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd3846-963e-405e-a5e6-c42c8a1fe735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:34.179520 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd3846-963e-405e-a5e6-c42c8a1fe735 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:34.179870 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd3846-963e-405e-a5e6-c42c8a1fe735 admin admin] PATH_INFO: `/v3/projects/d117b958d466410aa0b5705368d083d2` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:34.181708 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd3846-963e-405e-a5e6-c42c8a1fe735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d117b958d466410aa0b5705368d083d2)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:34.184432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd3846-963e-405e-a5e6-c42c8a1fe735 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:34.204393 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:34.373632 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-90fd3846-963e-405e-a5e6-c42c8a1fe735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd117b958d466410aa0b5705368d083d2', 'request_id': 'req-90fd3846-963e-405e-a5e6-c42c8a1fe735'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:34.379394 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-90fd3846-963e-405e-a5e6-c42c8a1fe735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd117b958d466410aa0b5705368d083d2', 'request_id': 'req-90fd3846-963e-405e-a5e6-c42c8a1fe735'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:34.453813 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-90fd3846-963e-405e-a5e6-c42c8a1fe735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd117b958d466410aa0b5705368d083d2', 'request_id': 'req-90fd3846-963e-405e-a5e6-c42c8a1fe735'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:34.466588 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-90fd3846-963e-405e-a5e6-c42c8a1fe735 admin admin] The token cache is being invalidate because project d117b958d466410aa0b5705368d083d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:34.466936 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-90fd3846-963e-405e-a5e6-c42c8a1fe735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:34.467609 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-90fd3846-963e-405e-a5e6-c42c8a1fe735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:34.469295 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1387/2732] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:34 2022] DELETE /identity/v3/projects/d117b958d466410aa0b5705368d083d2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:34.474384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ca9b5-e8b2-40af-b734-d3861aeb19a3 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:34.474879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ca9b5-e8b2-40af-b734-d3861aeb19a3 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:34.475013 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ca9b5-e8b2-40af-b734-d3861aeb19a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:34.495961 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-119ca9b5-e8b2-40af-b734-d3861aeb19a3 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:34.497247 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-119ca9b5-e8b2-40af-b734-d3861aeb19a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:34.586192 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1346/2733] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:34.594811 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feaa1b-1144-49c8-9e41-bff6e2f1624f None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:34.595873 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feaa1b-1144-49c8-9e41-bff6e2f1624f None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:34.596443 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feaa1b-1144-49c8-9e41-bff6e2f1624f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:34.625120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-29feaa1b-1144-49c8-9e41-bff6e2f1624f None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:34.626341 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-29feaa1b-1144-49c8-9e41-bff6e2f1624f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:34.635677 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1388/2734] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:34.640001 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ca9b5-e8b2-40af-b734-d3861aeb19a3 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:34.650290 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ca9b5-e8b2-40af-b734-d3861aeb19a3 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:34.655234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cee2d-1c70-46cc-b37c-314138419c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:34.655927 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cee2d-1c70-46cc-b37c-314138419c52 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:34.656212 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cee2d-1c70-46cc-b37c-314138419c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:34.656490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cee2d-1c70-46cc-b37c-314138419c52 admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:34.657256 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024cee2d-1c70-46cc-b37c-314138419c52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:05:34.657644 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024cee2d-1c70-46cc-b37c-314138419c52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:34.659246 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024cee2d-1c70-46cc-b37c-314138419c52 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:34.670964 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1347/2735] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:05:34.675338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29feaa1b-1144-49c8-9e41-bff6e2f1624f None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:34.685388 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29feaa1b-1144-49c8-9e41-bff6e2f1624f None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:34.690167 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262601ba-a883-4578-b8ea-74f0df841f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:34.690826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262601ba-a883-4578-b8ea-74f0df841f1c admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:34.691112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262601ba-a883-4578-b8ea-74f0df841f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:34.691391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262601ba-a883-4578-b8ea-74f0df841f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:34.693187 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262601ba-a883-4578-b8ea-74f0df841f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:34.695911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262601ba-a883-4578-b8ea-74f0df841f1c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:34.771053 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1389/2736] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:34 2022] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:34.775428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cee2d-1c70-46cc-b37c-314138419c52 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:34.795796 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cee2d-1c70-46cc-b37c-314138419c52 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:34.811763 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:34.870742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e517a39-0273-4bda-bfaf-a5f42ff0d1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:34.872040 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e517a39-0273-4bda-bfaf-a5f42ff0d1fa admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:34.872478 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e517a39-0273-4bda-bfaf-a5f42ff0d1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:34.872807 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e517a39-0273-4bda-bfaf-a5f42ff0d1fa admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:34.873513 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e517a39-0273-4bda-bfaf-a5f42ff0d1fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:34.875432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e517a39-0273-4bda-bfaf-a5f42ff0d1fa admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:34.945198 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1348/2737] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:34 2022] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:34.945425 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262601ba-a883-4578-b8ea-74f0df841f1c admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:34.954384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262601ba-a883-4578-b8ea-74f0df841f1c admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:34.959395 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6abf8-6268-4375-960b-a49927ba420b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:34.960087 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6abf8-6268-4375-960b-a49927ba420b admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:34.965287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6abf8-6268-4375-960b-a49927ba420b admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:34.965287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6abf8-6268-4375-960b-a49927ba420b admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:34.965287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6abf8-6268-4375-960b-a49927ba420b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:34.965287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6abf8-6268-4375-960b-a49927ba420b admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:34.973689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1390/2738] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:34.978961 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e517a39-0273-4bda-bfaf-a5f42ff0d1fa admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:34.989389 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e517a39-0273-4bda-bfaf-a5f42ff0d1fa admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:34.995385 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdf5f3-de36-4d84-9fc5-617f5f058c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:34.996063 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdf5f3-de36-4d84-9fc5-617f5f058c39 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:34.996377 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdf5f3-de36-4d84-9fc5-617f5f058c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:34.996693 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdf5f3-de36-4d84-9fc5-617f5f058c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:34.997533 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdf5f3-de36-4d84-9fc5-617f5f058c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:34.999136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdf5f3-de36-4d84-9fc5-617f5f058c39 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:35.009894 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1349/2739] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:05:35.015816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6abf8-6268-4375-960b-a49927ba420b admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:35.026510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6abf8-6268-4375-960b-a49927ba420b admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:35.031431 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440429f1-f1cf-4274-a19d-3a5a554a429f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:35.032397 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440429f1-f1cf-4274-a19d-3a5a554a429f admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:35.032831 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440429f1-f1cf-4274-a19d-3a5a554a429f admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:35.033048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440429f1-f1cf-4274-a19d-3a5a554a429f admin admin] PATH_INFO: `/v3/projects/1e611133a9cd4d0daf66803be057bb81/users/f37cc72b42c349319b262fbd49a20316/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:35.048947 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440429f1-f1cf-4274-a19d-3a5a554a429f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e611133a9cd4d0daf66803be057bb81, user_id=f37cc72b42c349319b262fbd49a20316, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:35.051651 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440429f1-f1cf-4274-a19d-3a5a554a429f admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:35.180252 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1391/2740] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:35 2022] PUT /identity/v3/projects/1e611133a9cd4d0daf66803be057bb81/users/f37cc72b42c349319b262fbd49a20316/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:35.190544 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169b8fe-ff25-4cd2-867f-287c29fdf69f None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:35.190833 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169b8fe-ff25-4cd2-867f-287c29fdf69f None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:35.191115 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169b8fe-ff25-4cd2-867f-287c29fdf69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:35.218026 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-1169b8fe-ff25-4cd2-867f-287c29fdf69f None None] MFA Rules not processed for user `f37cc72b42c349319b262fbd49a20316`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:35.219161 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-1169b8fe-ff25-4cd2-867f-287c29fdf69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:35.289894 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1350/2741] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:35.301328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440429f1-f1cf-4274-a19d-3a5a554a429f admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:35.303297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-440429f1-f1cf-4274-a19d-3a5a554a429f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:35.365336 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440429f1-f1cf-4274-a19d-3a5a554a429f admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:35.369659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb65f9-490e-478f-8f47-737106e5fc75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:35.370384 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb65f9-490e-478f-8f47-737106e5fc75 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:35.373725 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb65f9-490e-478f-8f47-737106e5fc75 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:35.373725 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb65f9-490e-478f-8f47-737106e5fc75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:35.381718 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb65f9-490e-478f-8f47-737106e5fc75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:35.383321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb65f9-490e-478f-8f47-737106e5fc75 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:35.393290 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1392/2742] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:35.619032 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169b8fe-ff25-4cd2-867f-287c29fdf69f None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:35.621122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-1169b8fe-ff25-4cd2-867f-287c29fdf69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:35.633872 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb65f9-490e-478f-8f47-737106e5fc75 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:35.637445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-daeb65f9-490e-478f-8f47-737106e5fc75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:35.682490 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169b8fe-ff25-4cd2-867f-287c29fdf69f None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:35.685119 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:35.687017 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a2e5d-045d-446e-bf41-f99bdfe0ced4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:35.687770 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a2e5d-045d-446e-bf41-f99bdfe0ced4 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:35.688055 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a2e5d-045d-446e-bf41-f99bdfe0ced4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:35.688327 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a2e5d-045d-446e-bf41-f99bdfe0ced4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:35.690143 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ca3a2e5d-045d-446e-bf41-f99bdfe0ced4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:35.705084 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb65f9-490e-478f-8f47-737106e5fc75 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:35.710471 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe2cf8-93ff-4b5b-a03d-b2283b8bebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:35.711360 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe2cf8-93ff-4b5b-a03d-b2283b8bebc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:35.711947 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe2cf8-93ff-4b5b-a03d-b2283b8bebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:35.711947 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe2cf8-93ff-4b5b-a03d-b2283b8bebc0 admin admin] PATH_INFO: `/v3/users/d24191f449a647f288d624fc940abbc5` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:35.713177 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe2cf8-93ff-4b5b-a03d-b2283b8bebc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d24191f449a647f288d624fc940abbc5)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:35.715217 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe2cf8-93ff-4b5b-a03d-b2283b8bebc0 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:35.728921 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:35.757477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a2e5d-045d-446e-bf41-f99bdfe0ced4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:35.758925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a2e5d-045d-446e-bf41-f99bdfe0ced4 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:35.768436 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1351/2743] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:35.896283 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-adbe2cf8-93ff-4b5b-a03d-b2283b8bebc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd24191f449a647f288d624fc940abbc5'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:35.903475 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-adbe2cf8-93ff-4b5b-a03d-b2283b8bebc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd24191f449a647f288d624fc940abbc5'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:35.979508 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-adbe2cf8-93ff-4b5b-a03d-b2283b8bebc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd24191f449a647f288d624fc940abbc5'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:35.984240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-adbe2cf8-93ff-4b5b-a03d-b2283b8bebc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd24191f449a647f288d624fc940abbc5'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:35.984813 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-adbe2cf8-93ff-4b5b-a03d-b2283b8bebc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd24191f449a647f288d624fc940abbc5'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:36.004938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1393/2744] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:35 2022] DELETE /identity/v3/users/d24191f449a647f288d624fc940abbc5 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:36.010357 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cab4c9-55d7-4cb0-ad70-8bf676e9fcae None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:36.010646 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cab4c9-55d7-4cb0-ad70-8bf676e9fcae None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:36.010925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cab4c9-55d7-4cb0-ad70-8bf676e9fcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:36.033231 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-f7cab4c9-55d7-4cb0-ad70-8bf676e9fcae None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:36.034542 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f7cab4c9-55d7-4cb0-ad70-8bf676e9fcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:36.109232 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1352/2745] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:36.120804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe2cf8-93ff-4b5b-a03d-b2283b8bebc0 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:36.122411 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-adbe2cf8-93ff-4b5b-a03d-b2283b8bebc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:36.195808 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe2cf8-93ff-4b5b-a03d-b2283b8bebc0 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:36.207130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b518bd-1f2b-4fc1-b130-19e8ba046ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:36.207130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b518bd-1f2b-4fc1-b130-19e8ba046ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:36.207130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b518bd-1f2b-4fc1-b130-19e8ba046ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:36.207130 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b518bd-1f2b-4fc1-b130-19e8ba046ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:36.214011 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b518bd-1f2b-4fc1-b130-19e8ba046ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:36.216096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b518bd-1f2b-4fc1-b130-19e8ba046ad9 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:36.230346 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1394/2746] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:36.623423 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cab4c9-55d7-4cb0-ad70-8bf676e9fcae None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:36.624929 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f7cab4c9-55d7-4cb0-ad70-8bf676e9fcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:36.637349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cab4c9-55d7-4cb0-ad70-8bf676e9fcae None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:36.642205 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38de93-c525-4964-a725-cd2769bea776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:36.643089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38de93-c525-4964-a725-cd2769bea776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:36.643420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38de93-c525-4964-a725-cd2769bea776 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:36.643826 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38de93-c525-4964-a725-cd2769bea776 admin admin] PATH_INFO: `/v3/users/4c3ce167e6084138ba1452bf464daa81` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:36.644986 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38de93-c525-4964-a725-cd2769bea776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c3ce167e6084138ba1452bf464daa81)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:36.646999 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38de93-c525-4964-a725-cd2769bea776 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:36.658416 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b518bd-1f2b-4fc1-b130-19e8ba046ad9 service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:36.660032 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-30b518bd-1f2b-4fc1-b130-19e8ba046ad9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:36.675315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b518bd-1f2b-4fc1-b130-19e8ba046ad9 service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:36.681866 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23830c6-0c87-42af-abe6-9666ab022c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:36.683096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23830c6-0c87-42af-abe6-9666ab022c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:36.683746 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23830c6-0c87-42af-abe6-9666ab022c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:36.684239 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23830c6-0c87-42af-abe6-9666ab022c02 admin admin] PATH_INFO: `/v3/projects/0e4e68e0df894e7b9e1a694306f5c744` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:36.685816 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23830c6-0c87-42af-abe6-9666ab022c02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e4e68e0df894e7b9e1a694306f5c744)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:36.694435 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23830c6-0c87-42af-abe6-9666ab022c02 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:36.897038 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6b38de93-c525-4964-a725-cd2769bea776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c3ce167e6084138ba1452bf464daa81'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:36.898885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b23830c6-0c87-42af-abe6-9666ab022c02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e4e68e0df894e7b9e1a694306f5c744', 'request_id': 'req-b23830c6-0c87-42af-abe6-9666ab022c02'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:36.904853 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6b38de93-c525-4964-a725-cd2769bea776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c3ce167e6084138ba1452bf464daa81'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:36.905569 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6b38de93-c525-4964-a725-cd2769bea776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c3ce167e6084138ba1452bf464daa81'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:36.905841 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b23830c6-0c87-42af-abe6-9666ab022c02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e4e68e0df894e7b9e1a694306f5c744', 'request_id': 'req-b23830c6-0c87-42af-abe6-9666ab022c02'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:36.907478 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:36.985776 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6b38de93-c525-4964-a725-cd2769bea776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c3ce167e6084138ba1452bf464daa81'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:36.986521 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-6b38de93-c525-4964-a725-cd2769bea776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c3ce167e6084138ba1452bf464daa81'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:37.006728 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1353/2747] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:36 2022] DELETE /identity/v3/users/4c3ce167e6084138ba1452bf464daa81 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:37.011315 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6b842-bdde-4988-bb9f-542e63e22f21 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:37.011608 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6b842-bdde-4988-bb9f-542e63e22f21 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:37.011976 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6b842-bdde-4988-bb9f-542e63e22f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:37.028685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-2fe6b842-bdde-4988-bb9f-542e63e22f21 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:37.029940 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-2fe6b842-bdde-4988-bb9f-542e63e22f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:37.059709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b23830c6-0c87-42af-abe6-9666ab022c02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e4e68e0df894e7b9e1a694306f5c744', 'request_id': 'req-b23830c6-0c87-42af-abe6-9666ab022c02'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:37.072305 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b23830c6-0c87-42af-abe6-9666ab022c02 admin admin] The token cache is being invalidate because project 0e4e68e0df894e7b9e1a694306f5c744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:37.072660 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b23830c6-0c87-42af-abe6-9666ab022c02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:37.073282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-b23830c6-0c87-42af-abe6-9666ab022c02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:37.073924 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:37.076105 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1395/2748] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:36 2022] DELETE /identity/v3/projects/0e4e68e0df894e7b9e1a694306f5c744 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:37.080054 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23830c6-0c87-42af-abe6-9666ab022c02 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:37.086352 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b23830c6-0c87-42af-abe6-9666ab022c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:37.096126 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1354/2749] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:37.114742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6b842-bdde-4988-bb9f-542e63e22f21 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:37.114742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-2fe6b842-bdde-4988-bb9f-542e63e22f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:37.161145 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23830c6-0c87-42af-abe6-9666ab022c02 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:37.167599 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1e229-dcb0-4605-9203-4667cb509d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:37.168687 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1e229-dcb0-4605-9203-4667cb509d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:37.169034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1e229-dcb0-4605-9203-4667cb509d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:37.169313 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1e229-dcb0-4605-9203-4667cb509d7c admin admin] PATH_INFO: `/v3/users/63a2530a72b0420689375defd53617f3` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:37.170547 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1e229-dcb0-4605-9203-4667cb509d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=63a2530a72b0420689375defd53617f3)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:37.173759 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1e229-dcb0-4605-9203-4667cb509d7c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:37.198301 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6b842-bdde-4988-bb9f-542e63e22f21 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:37.202128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5dfd5-8482-4ea0-8642-5d5c776ab8e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:37.202825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5dfd5-8482-4ea0-8642-5d5c776ab8e0 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:37.203111 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5dfd5-8482-4ea0-8642-5d5c776ab8e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:37.203392 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5dfd5-8482-4ea0-8642-5d5c776ab8e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:37.213427 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5dfd5-8482-4ea0-8642-5d5c776ab8e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:37.214871 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5dfd5-8482-4ea0-8642-5d5c776ab8e0 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:37.224803 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1355/2750] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:05:37.405229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-66b1e229-dcb0-4605-9203-4667cb509d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63a2530a72b0420689375defd53617f3'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:37.413886 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-66b1e229-dcb0-4605-9203-4667cb509d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63a2530a72b0420689375defd53617f3'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:37.510495 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-66b1e229-dcb0-4605-9203-4667cb509d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63a2530a72b0420689375defd53617f3'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:37.511113 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-66b1e229-dcb0-4605-9203-4667cb509d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63a2530a72b0420689375defd53617f3'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:37.511719 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-66b1e229-dcb0-4605-9203-4667cb509d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63a2530a72b0420689375defd53617f3'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:37.533556 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1396/2751] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:37 2022] DELETE /identity/v3/users/63a2530a72b0420689375defd53617f3 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:37.873089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5dfd5-8482-4ea0-8642-5d5c776ab8e0 service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:37.875485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-15d5dfd5-8482-4ea0-8642-5d5c776ab8e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:37.891089 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5dfd5-8482-4ea0-8642-5d5c776ab8e0 service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:37.952452 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89279c-7577-4e2b-a3c4-4b8cada77ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:37.953617 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89279c-7577-4e2b-a3c4-4b8cada77ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:37.953975 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89279c-7577-4e2b-a3c4-4b8cada77ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:37.954325 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89279c-7577-4e2b-a3c4-4b8cada77ff6 admin admin] PATH_INFO: `/v3/projects/395d61f5494345a192527db4de15f635` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:37.955744 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89279c-7577-4e2b-a3c4-4b8cada77ff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=395d61f5494345a192527db4de15f635)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:37.957812 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89279c-7577-4e2b-a3c4-4b8cada77ff6 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:38.078574 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-af89279c-7577-4e2b-a3c4-4b8cada77ff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395d61f5494345a192527db4de15f635', 'request_id': 'req-af89279c-7577-4e2b-a3c4-4b8cada77ff6'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:38.150905 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-af89279c-7577-4e2b-a3c4-4b8cada77ff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395d61f5494345a192527db4de15f635', 'request_id': 'req-af89279c-7577-4e2b-a3c4-4b8cada77ff6'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:38.158576 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-af89279c-7577-4e2b-a3c4-4b8cada77ff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395d61f5494345a192527db4de15f635', 'request_id': 'req-af89279c-7577-4e2b-a3c4-4b8cada77ff6'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:38.170671 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-af89279c-7577-4e2b-a3c4-4b8cada77ff6 admin admin] The token cache is being invalidate because project 395d61f5494345a192527db4de15f635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:38.170964 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-af89279c-7577-4e2b-a3c4-4b8cada77ff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:38.171623 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-af89279c-7577-4e2b-a3c4-4b8cada77ff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:38.173246 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1356/2752] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:37 2022] DELETE /identity/v3/projects/395d61f5494345a192527db4de15f635 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:38.177203 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1e229-dcb0-4605-9203-4667cb509d7c admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:38.179578 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-66b1e229-dcb0-4605-9203-4667cb509d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:38.192631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1e229-dcb0-4605-9203-4667cb509d7c admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:38.260059 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82251e6f-e72c-4b87-bed0-543051217788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:38.260963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82251e6f-e72c-4b87-bed0-543051217788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:38.261244 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82251e6f-e72c-4b87-bed0-543051217788 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:38.261734 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82251e6f-e72c-4b87-bed0-543051217788 admin admin] PATH_INFO: `/v3/users/2abd7f8203fa48db8418ed74ea2a88bc` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:38.262961 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82251e6f-e72c-4b87-bed0-543051217788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2abd7f8203fa48db8418ed74ea2a88bc)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:38.265439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82251e6f-e72c-4b87-bed0-543051217788 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:38.273615 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:38.393361 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89279c-7577-4e2b-a3c4-4b8cada77ff6 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:38.396078 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-af89279c-7577-4e2b-a3c4-4b8cada77ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:38.419752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:38.490258 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89279c-7577-4e2b-a3c4-4b8cada77ff6 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:38.499856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273b0a9-4e8d-4253-b7e6-e1c39fde6e8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:38.500536 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273b0a9-4e8d-4253-b7e6-e1c39fde6e8e service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:38.500855 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273b0a9-4e8d-4253-b7e6-e1c39fde6e8e service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:38.501154 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273b0a9-4e8d-4253-b7e6-e1c39fde6e8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:38.502723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-82251e6f-e72c-4b87-bed0-543051217788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2abd7f8203fa48db8418ed74ea2a88bc'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:38.509023 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8273b0a9-4e8d-4253-b7e6-e1c39fde6e8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:38.512434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-82251e6f-e72c-4b87-bed0-543051217788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2abd7f8203fa48db8418ed74ea2a88bc'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:38.525710 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273b0a9-4e8d-4253-b7e6-e1c39fde6e8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:38.528221 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273b0a9-4e8d-4253-b7e6-e1c39fde6e8e service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:38.541628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1357/2753] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:38.542617 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273b0a9-4e8d-4253-b7e6-e1c39fde6e8e service nova] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:38.544055 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-8273b0a9-4e8d-4253-b7e6-e1c39fde6e8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:38.564123 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273b0a9-4e8d-4253-b7e6-e1c39fde6e8e service nova] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:38.569965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffb3a9-54d6-4db2-b9da-8c41f407c06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:38.571955 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffb3a9-54d6-4db2-b9da-8c41f407c06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:38.572254 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffb3a9-54d6-4db2-b9da-8c41f407c06c admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:38.572541 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffb3a9-54d6-4db2-b9da-8c41f407c06c admin admin] PATH_INFO: `/v3/projects/e376b4ca0e5a4c898e19adbd2ea13f0b` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:38.574662 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffb3a9-54d6-4db2-b9da-8c41f407c06c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e376b4ca0e5a4c898e19adbd2ea13f0b)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:38.576849 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffb3a9-54d6-4db2-b9da-8c41f407c06c admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:38.602697 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-82251e6f-e72c-4b87-bed0-543051217788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2abd7f8203fa48db8418ed74ea2a88bc'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:38.603362 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-82251e6f-e72c-4b87-bed0-543051217788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2abd7f8203fa48db8418ed74ea2a88bc'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:38.603986 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-82251e6f-e72c-4b87-bed0-543051217788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2abd7f8203fa48db8418ed74ea2a88bc'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:38.630636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1397/2754] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:38 2022] DELETE /identity/v3/users/2abd7f8203fa48db8418ed74ea2a88bc => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:05:38.725327 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-d4ffb3a9-54d6-4db2-b9da-8c41f407c06c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e376b4ca0e5a4c898e19adbd2ea13f0b', 'request_id': 'req-d4ffb3a9-54d6-4db2-b9da-8c41f407c06c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:38.837320 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-d4ffb3a9-54d6-4db2-b9da-8c41f407c06c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e376b4ca0e5a4c898e19adbd2ea13f0b', 'request_id': 'req-d4ffb3a9-54d6-4db2-b9da-8c41f407c06c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:38.844557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-d4ffb3a9-54d6-4db2-b9da-8c41f407c06c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e376b4ca0e5a4c898e19adbd2ea13f0b', 'request_id': 'req-d4ffb3a9-54d6-4db2-b9da-8c41f407c06c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:38.858749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-d4ffb3a9-54d6-4db2-b9da-8c41f407c06c admin admin] The token cache is being invalidate because project e376b4ca0e5a4c898e19adbd2ea13f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:38.859203 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-d4ffb3a9-54d6-4db2-b9da-8c41f407c06c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:38.859984 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-d4ffb3a9-54d6-4db2-b9da-8c41f407c06c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:38.861982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1358/2755] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:38 2022] DELETE /identity/v3/projects/e376b4ca0e5a4c898e19adbd2ea13f0b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:38.866603 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82251e6f-e72c-4b87-bed0-543051217788 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:38.872927 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-82251e6f-e72c-4b87-bed0-543051217788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:39.021231 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82251e6f-e72c-4b87-bed0-543051217788 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:39.111549 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf1463-efd7-4f85-adb5-2509bfef18eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:39.119982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf1463-efd7-4f85-adb5-2509bfef18eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:39.119982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf1463-efd7-4f85-adb5-2509bfef18eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:39.119982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf1463-efd7-4f85-adb5-2509bfef18eb admin admin] PATH_INFO: `/v3/users/3fe55fe9199c49ca82e4da6860e66d3f` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:39.119982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf1463-efd7-4f85-adb5-2509bfef18eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe55fe9199c49ca82e4da6860e66d3f)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:39.119982 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf1463-efd7-4f85-adb5-2509bfef18eb admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:39.148903 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffb3a9-54d6-4db2-b9da-8c41f407c06c admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:39.151896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-d4ffb3a9-54d6-4db2-b9da-8c41f407c06c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:39.170518 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffb3a9-54d6-4db2-b9da-8c41f407c06c admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:39.179382 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f56d6-6d02-4fbb-aefe-f21daec3f79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:39.180495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f56d6-6d02-4fbb-aefe-f21daec3f79b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:39.180817 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f56d6-6d02-4fbb-aefe-f21daec3f79b admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:39.181103 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f56d6-6d02-4fbb-aefe-f21daec3f79b admin admin] PATH_INFO: `/v3/projects/2903d4235dba4a278e922adcf96b1318` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:39.182352 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f56d6-6d02-4fbb-aefe-f21daec3f79b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2903d4235dba4a278e922adcf96b1318)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:39.184611 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f56d6-6d02-4fbb-aefe-f21daec3f79b admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:39.339010 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:39.351783 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-19bf1463-efd7-4f85-adb5-2509bfef18eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe55fe9199c49ca82e4da6860e66d3f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:39.359077 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4c5f56d6-6d02-4fbb-aefe-f21daec3f79b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2903d4235dba4a278e922adcf96b1318', 'request_id': 'req-4c5f56d6-6d02-4fbb-aefe-f21daec3f79b'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:39.362041 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-19bf1463-efd7-4f85-adb5-2509bfef18eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe55fe9199c49ca82e4da6860e66d3f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:39.453442 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4c5f56d6-6d02-4fbb-aefe-f21daec3f79b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2903d4235dba4a278e922adcf96b1318', 'request_id': 'req-4c5f56d6-6d02-4fbb-aefe-f21daec3f79b'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:39.459556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4c5f56d6-6d02-4fbb-aefe-f21daec3f79b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2903d4235dba4a278e922adcf96b1318', 'request_id': 'req-4c5f56d6-6d02-4fbb-aefe-f21daec3f79b'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:39.471016 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4c5f56d6-6d02-4fbb-aefe-f21daec3f79b admin admin] The token cache is being invalidate because project 2903d4235dba4a278e922adcf96b1318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:39.471302 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4c5f56d6-6d02-4fbb-aefe-f21daec3f79b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:39.471952 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-4c5f56d6-6d02-4fbb-aefe-f21daec3f79b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:39.473530 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1359/2756] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:39 2022] DELETE /identity/v3/projects/2903d4235dba4a278e922adcf96b1318 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:05:39.478992 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b68aa5-e88b-4a71-9469-43141548d51e None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:39.479285 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b68aa5-e88b-4a71-9469-43141548d51e None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:39.483526 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b68aa5-e88b-4a71-9469-43141548d51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:39.498179 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-76b68aa5-e88b-4a71-9469-43141548d51e None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:39.499417 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-76b68aa5-e88b-4a71-9469-43141548d51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:39.503953 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:39.528220 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-19bf1463-efd7-4f85-adb5-2509bfef18eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe55fe9199c49ca82e4da6860e66d3f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:39.528942 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-19bf1463-efd7-4f85-adb5-2509bfef18eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe55fe9199c49ca82e4da6860e66d3f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:39.529582 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-19bf1463-efd7-4f85-adb5-2509bfef18eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe55fe9199c49ca82e4da6860e66d3f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:39.551738 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1398/2757] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:38 2022] DELETE /identity/v3/users/3fe55fe9199c49ca82e4da6860e66d3f => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:39.585345 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1360/2758] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:39.589583 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8028e-eed2-47cc-8856-135f909a57c2 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:39.590256 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8028e-eed2-47cc-8856-135f909a57c2 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:39.590839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8028e-eed2-47cc-8856-135f909a57c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:39.620220 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-c2d8028e-eed2-47cc-8856-135f909a57c2 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:39.620220 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c2d8028e-eed2-47cc-8856-135f909a57c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:39.685460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1399/2759] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:39.695552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b68aa5-e88b-4a71-9469-43141548d51e None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:39.706056 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b68aa5-e88b-4a71-9469-43141548d51e None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:39.711268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94210c-40ac-458f-8b6b-c6b51a78f620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:39.711902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94210c-40ac-458f-8b6b-c6b51a78f620 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:39.712261 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94210c-40ac-458f-8b6b-c6b51a78f620 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:39.712520 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94210c-40ac-458f-8b6b-c6b51a78f620 admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:39.713363 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94210c-40ac-458f-8b6b-c6b51a78f620 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:05:39.713673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94210c-40ac-458f-8b6b-c6b51a78f620 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:39.715315 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94210c-40ac-458f-8b6b-c6b51a78f620 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:39.728832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1361/2760] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:05:39.737977 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8028e-eed2-47cc-8856-135f909a57c2 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:39.749823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8028e-eed2-47cc-8856-135f909a57c2 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:39.754814 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822d798-d23e-40a6-9e60-4ea06f4aa8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:39.755470 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822d798-d23e-40a6-9e60-4ea06f4aa8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:39.755755 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822d798-d23e-40a6-9e60-4ea06f4aa8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:39.756031 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822d798-d23e-40a6-9e60-4ea06f4aa8a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:39.756884 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822d798-d23e-40a6-9e60-4ea06f4aa8a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:39.759480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822d798-d23e-40a6-9e60-4ea06f4aa8a1 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:39.841780 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1400/2761] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:39 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:39.842964 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94210c-40ac-458f-8b6b-c6b51a78f620 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:39.853742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94210c-40ac-458f-8b6b-c6b51a78f620 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:39.911359 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb1492-a5c6-4464-ad1a-3a7e3063af6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:39.912050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb1492-a5c6-4464-ad1a-3a7e3063af6f admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:39.912333 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb1492-a5c6-4464-ad1a-3a7e3063af6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:39.912610 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb1492-a5c6-4464-ad1a-3a7e3063af6f admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:39.914206 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb1492-a5c6-4464-ad1a-3a7e3063af6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:39.916280 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb1492-a5c6-4464-ad1a-3a7e3063af6f admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:40.035601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822d798-d23e-40a6-9e60-4ea06f4aa8a1 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:40.041669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1362/2762] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:39 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:40.041828 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b822d798-d23e-40a6-9e60-4ea06f4aa8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:40.043225 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb1492-a5c6-4464-ad1a-3a7e3063af6f admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:40.062267 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb1492-a5c6-4464-ad1a-3a7e3063af6f admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:40.070581 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b55ebf-5ee5-4e1f-a326-0d5ada719c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:40.071794 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b55ebf-5ee5-4e1f-a326-0d5ada719c84 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:40.072376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b55ebf-5ee5-4e1f-a326-0d5ada719c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:40.073014 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b55ebf-5ee5-4e1f-a326-0d5ada719c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:40.074543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b55ebf-5ee5-4e1f-a326-0d5ada719c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:40.077467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b55ebf-5ee5-4e1f-a326-0d5ada719c84 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:40.078050 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822d798-d23e-40a6-9e60-4ea06f4aa8a1 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:40.086015 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3cde1-602e-4808-8d95-28198fff7a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:40.087327 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3cde1-602e-4808-8d95-28198fff7a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:40.087747 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3cde1-602e-4808-8d95-28198fff7a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:40.088012 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3cde1-602e-4808-8d95-28198fff7a98 admin admin] PATH_INFO: `/v3/projects/bb83323185ef453e84f62dde732d8691` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:40.090489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3cde1-602e-4808-8d95-28198fff7a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb83323185ef453e84f62dde732d8691)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:40.093463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3cde1-602e-4808-8d95-28198fff7a98 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:40.096317 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1363/2763] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:40.100311 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b55ebf-5ee5-4e1f-a326-0d5ada719c84 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:40.111222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b55ebf-5ee5-4e1f-a326-0d5ada719c84 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:40.119991 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dde910-703e-41d6-94e1-d7d2feb5fe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:40.119991 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dde910-703e-41d6-94e1-d7d2feb5fe8e admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:40.119991 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dde910-703e-41d6-94e1-d7d2feb5fe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:40.119991 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dde910-703e-41d6-94e1-d7d2feb5fe8e admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:40.120450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dde910-703e-41d6-94e1-d7d2feb5fe8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:40.120450 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dde910-703e-41d6-94e1-d7d2feb5fe8e admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:40.130108 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1364/2764] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:40.134627 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dde910-703e-41d6-94e1-d7d2feb5fe8e admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:40.144260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dde910-703e-41d6-94e1-d7d2feb5fe8e admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:40.150133 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc9624-bf2b-4340-b57b-80676a194c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:40.151403 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc9624-bf2b-4340-b57b-80676a194c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:40.151546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc9624-bf2b-4340-b57b-80676a194c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:40.151910 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc9624-bf2b-4340-b57b-80676a194c99 admin admin] PATH_INFO: `/v3/projects/5adc9bf47958494a87b0d233ced10d90/users/e8dc008a9f2b4ef5b958085f80db1f4c/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:40.170068 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc9624-bf2b-4340-b57b-80676a194c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5adc9bf47958494a87b0d233ced10d90, user_id=e8dc008a9f2b4ef5b958085f80db1f4c, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:40.173011 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc9624-bf2b-4340-b57b-80676a194c99 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:40.256319 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1365/2765] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:40 2022] PUT /identity/v3/projects/5adc9bf47958494a87b0d233ced10d90/users/e8dc008a9f2b4ef5b958085f80db1f4c/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:05:40.265642 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d9d3cde1-602e-4808-8d95-28198fff7a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb83323185ef453e84f62dde732d8691', 'request_id': 'req-d9d3cde1-602e-4808-8d95-28198fff7a98'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:40.267691 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6c35d-572d-48a5-b8cc-b55e4fe9bfcc None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:40.267970 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6c35d-572d-48a5-b8cc-b55e4fe9bfcc None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:40.268251 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6c35d-572d-48a5-b8cc-b55e4fe9bfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:40.273385 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d9d3cde1-602e-4808-8d95-28198fff7a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb83323185ef453e84f62dde732d8691', 'request_id': 'req-d9d3cde1-602e-4808-8d95-28198fff7a98'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:40.296786 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-84c6c35d-572d-48a5-b8cc-b55e4fe9bfcc None None] MFA Rules not processed for user `e8dc008a9f2b4ef5b958085f80db1f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:40.298000 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-84c6c35d-572d-48a5-b8cc-b55e4fe9bfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:40.365428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1366/2766] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:40.370531 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6c35d-572d-48a5-b8cc-b55e4fe9bfcc None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:40.413244 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d9d3cde1-602e-4808-8d95-28198fff7a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb83323185ef453e84f62dde732d8691', 'request_id': 'req-d9d3cde1-602e-4808-8d95-28198fff7a98'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:40.426039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d9d3cde1-602e-4808-8d95-28198fff7a98 admin admin] The token cache is being invalidate because project bb83323185ef453e84f62dde732d8691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:40.426328 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d9d3cde1-602e-4808-8d95-28198fff7a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:40.426974 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-d9d3cde1-602e-4808-8d95-28198fff7a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:40.429156 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1401/2767] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:40 2022] DELETE /identity/v3/projects/bb83323185ef453e84f62dde732d8691 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:40.433869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6c35d-572d-48a5-b8cc-b55e4fe9bfcc None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:40.438693 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140e02f-5b87-4706-8844-bd5746e19e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:40.439391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140e02f-5b87-4706-8844-bd5746e19e59 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:40.439677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140e02f-5b87-4706-8844-bd5746e19e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:40.440016 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140e02f-5b87-4706-8844-bd5746e19e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:40.440707 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140e02f-5b87-4706-8844-bd5746e19e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:40.442687 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140e02f-5b87-4706-8844-bd5746e19e59 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:40.482598 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:40.525082 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1367/2768] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:40 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:05:40.529582 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3cde1-602e-4808-8d95-28198fff7a98 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:40.531125 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d9d3cde1-602e-4808-8d95-28198fff7a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:40.545508 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3cde1-602e-4808-8d95-28198fff7a98 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:40.557948 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:40.611520 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bd446-839d-4255-ae08-5948005f6742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:40.612352 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bd446-839d-4255-ae08-5948005f6742 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:40.612699 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bd446-839d-4255-ae08-5948005f6742 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:40.612958 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bd446-839d-4255-ae08-5948005f6742 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:40.613754 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bd446-839d-4255-ae08-5948005f6742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:40.615695 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bd446-839d-4255-ae08-5948005f6742 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:40.701356 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1402/2769] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:40 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:40.705726 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140e02f-5b87-4706-8844-bd5746e19e59 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:40.716191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140e02f-5b87-4706-8844-bd5746e19e59 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:40.722260 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bf1a7-cde5-4fa9-bba5-f2edd73768b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:40.723190 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bf1a7-cde5-4fa9-bba5-f2edd73768b2 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:40.723190 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bf1a7-cde5-4fa9-bba5-f2edd73768b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:40.723477 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bf1a7-cde5-4fa9-bba5-f2edd73768b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:40.724263 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bf1a7-cde5-4fa9-bba5-f2edd73768b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:40.726524 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bf1a7-cde5-4fa9-bba5-f2edd73768b2 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:40.737575 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1368/2770] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:05:40.742399 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bd446-839d-4255-ae08-5948005f6742 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:40.752246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bd446-839d-4255-ae08-5948005f6742 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:40.756978 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e7fcc-ed0e-4c86-a072-806c135c5c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:40.757938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e7fcc-ed0e-4c86-a072-806c135c5c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:40.758226 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e7fcc-ed0e-4c86-a072-806c135c5c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:40.758502 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e7fcc-ed0e-4c86-a072-806c135c5c54 admin admin] PATH_INFO: `/v3/projects/ed2da1ff63514d789643986c22918812/users/7712d275ab724d50a7c6ba9ac7dba9ac/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:40.772924 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e7fcc-ed0e-4c86-a072-806c135c5c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed2da1ff63514d789643986c22918812, user_id=7712d275ab724d50a7c6ba9ac7dba9ac, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:40.775560 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e7fcc-ed0e-4c86-a072-806c135c5c54 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:40.866847 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1403/2771] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:40 2022] PUT /identity/v3/projects/ed2da1ff63514d789643986c22918812/users/7712d275ab724d50a7c6ba9ac7dba9ac/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:05:40.871090 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bf1a7-cde5-4fa9-bba5-f2edd73768b2 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:40.882145 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bf1a7-cde5-4fa9-bba5-f2edd73768b2 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:40.939949 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a2a8a-f75f-4373-a7b7-7b11bb8a0f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:40.940661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a2a8a-f75f-4373-a7b7-7b11bb8a0f8a admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:40.940991 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a2a8a-f75f-4373-a7b7-7b11bb8a0f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:40.941268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a2a8a-f75f-4373-a7b7-7b11bb8a0f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:40.941998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a2a8a-f75f-4373-a7b7-7b11bb8a0f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:40.943677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a2a8a-f75f-4373-a7b7-7b11bb8a0f8a admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:40.954401 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1369/2772] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:40.958719 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e7fcc-ed0e-4c86-a072-806c135c5c54 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:40.970636 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e7fcc-ed0e-4c86-a072-806c135c5c54 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:40.976061 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc66aeb-0cb9-42f1-8ca2-aeabfffe1147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:40.982112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc66aeb-0cb9-42f1-8ca2-aeabfffe1147 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:40.982112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc66aeb-0cb9-42f1-8ca2-aeabfffe1147 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:40.982112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc66aeb-0cb9-42f1-8ca2-aeabfffe1147 admin admin] PATH_INFO: `/v3/projects/ed2da1ff63514d789643986c22918812/users/7712d275ab724d50a7c6ba9ac7dba9ac/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:40.982112 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc66aeb-0cb9-42f1-8ca2-aeabfffe1147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed2da1ff63514d789643986c22918812, user_id=7712d275ab724d50a7c6ba9ac7dba9ac, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:40.982576 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc66aeb-0cb9-42f1-8ca2-aeabfffe1147 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:40.992990 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1404/2773] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:40 2022] PUT /identity/v3/projects/ed2da1ff63514d789643986c22918812/users/7712d275ab724d50a7c6ba9ac7dba9ac/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:05:41.003982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3405e-5548-4685-b6d0-509ed29d9636 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:41.004273 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3405e-5548-4685-b6d0-509ed29d9636 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:41.004552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3405e-5548-4685-b6d0-509ed29d9636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:41.031689 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-1aa3405e-5548-4685-b6d0-509ed29d9636 None None] MFA Rules not processed for user `7712d275ab724d50a7c6ba9ac7dba9ac`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:41.032974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-1aa3405e-5548-4685-b6d0-509ed29d9636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:41.101483 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1370/2774] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:41.111801 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:41.114727 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc66aeb-0cb9-42f1-8ca2-aeabfffe1147 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:41.117640 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9bc66aeb-0cb9-42f1-8ca2-aeabfffe1147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:41.180909 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc66aeb-0cb9-42f1-8ca2-aeabfffe1147 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:41.184569 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5924721-092b-4403-af0b-3a86042d6647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:41.185265 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5924721-092b-4403-af0b-3a86042d6647 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:41.185604 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5924721-092b-4403-af0b-3a86042d6647 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:41.185889 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5924721-092b-4403-af0b-3a86042d6647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:41.195713 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5924721-092b-4403-af0b-3a86042d6647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:41.197192 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5924721-092b-4403-af0b-3a86042d6647 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:41.207758 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1405/2775] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:42.148766 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3405e-5548-4685-b6d0-509ed29d9636 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:42.166746 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3405e-5548-4685-b6d0-509ed29d9636 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:42.181946 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084493c-c33c-416b-83b1-1fc5211670c7 tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7712d275ab724d50a7c6ba9ac7dba9ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2da1ff63514d789643986c22918812', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:42.182643 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084493c-c33c-416b-83b1-1fc5211670c7 tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:42.182937 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084493c-c33c-416b-83b1-1fc5211670c7 tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:42.183233 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084493c-c33c-416b-83b1-1fc5211670c7 tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:42.183975 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084493c-c33c-416b-83b1-1fc5211670c7 tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:05:42.184293 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084493c-c33c-416b-83b1-1fc5211670c7 tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:42.185982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084493c-c33c-416b-83b1-1fc5211670c7 tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:42.217685 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1371/2776] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:05:42.218136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5924721-092b-4403-af0b-3a86042d6647 service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:42.233722 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5924721-092b-4403-af0b-3a86042d6647 service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:42.249881 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c1836-df43-4c59-9ae1-1df7987d557d tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7712d275ab724d50a7c6ba9ac7dba9ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2da1ff63514d789643986c22918812', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:42.268032 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c1836-df43-4c59-9ae1-1df7987d557d tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:42.268032 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c1836-df43-4c59-9ae1-1df7987d557d tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:42.268032 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c1836-df43-4c59-9ae1-1df7987d557d tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:42.268032 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c1836-df43-4c59-9ae1-1df7987d557d tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:42.271287 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c1836-df43-4c59-9ae1-1df7987d557d tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:42.406294 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1406/2777] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:42 2022] POST /identity/v3/projects => generated 354 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:05:42.407991 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084493c-c33c-416b-83b1-1fc5211670c7 tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:42.430769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084493c-c33c-416b-83b1-1fc5211670c7 tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:42.515239 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112e40c-6121-488c-94b9-ac359fb6b055 tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7712d275ab724d50a7c6ba9ac7dba9ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2da1ff63514d789643986c22918812', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:42.516070 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112e40c-6121-488c-94b9-ac359fb6b055 tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:42.516371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112e40c-6121-488c-94b9-ac359fb6b055 tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:42.516672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112e40c-6121-488c-94b9-ac359fb6b055 tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:42.517418 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112e40c-6121-488c-94b9-ac359fb6b055 tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:05:42.517786 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112e40c-6121-488c-94b9-ac359fb6b055 tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:42.519419 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112e40c-6121-488c-94b9-ac359fb6b055 tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:42.536274 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1372/2778] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:05:42.579201 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c1836-df43-4c59-9ae1-1df7987d557d tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:42.594647 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c1836-df43-4c59-9ae1-1df7987d557d tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:42.601354 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7066ca-82de-4e79-9833-04abd0fe5c0f tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7712d275ab724d50a7c6ba9ac7dba9ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed2da1ff63514d789643986c22918812', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:42.603140 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7066ca-82de-4e79-9833-04abd0fe5c0f tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:42.603523 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7066ca-82de-4e79-9833-04abd0fe5c0f tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:42.603711 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7066ca-82de-4e79-9833-04abd0fe5c0f tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] PATH_INFO: `/v3/projects/4199bef872e146f7994b50f5bcc50ba1` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:42.605473 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7066ca-82de-4e79-9833-04abd0fe5c0f tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4199bef872e146f7994b50f5bcc50ba1)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:42.607435 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7066ca-82de-4e79-9833-04abd0fe5c0f tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:42.798631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:42.812898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-0e7066ca-82de-4e79-9833-04abd0fe5c0f tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4199bef872e146f7994b50f5bcc50ba1', 'request_id': 'req-0e7066ca-82de-4e79-9833-04abd0fe5c0f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:42.819240 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-0e7066ca-82de-4e79-9833-04abd0fe5c0f tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4199bef872e146f7994b50f5bcc50ba1', 'request_id': 'req-0e7066ca-82de-4e79-9833-04abd0fe5c0f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:42.859482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-0e7066ca-82de-4e79-9833-04abd0fe5c0f tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4199bef872e146f7994b50f5bcc50ba1', 'request_id': 'req-0e7066ca-82de-4e79-9833-04abd0fe5c0f'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:42.874430 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-0e7066ca-82de-4e79-9833-04abd0fe5c0f tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] The token cache is being invalidate because project 4199bef872e146f7994b50f5bcc50ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:42.875032 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-0e7066ca-82de-4e79-9833-04abd0fe5c0f tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:42.876071 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-0e7066ca-82de-4e79-9833-04abd0fe5c0f tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:42.880972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1407/2779] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:42 2022] DELETE /identity/v3/projects/4199bef872e146f7994b50f5bcc50ba1 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:05:43.480148 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112e40c-6121-488c-94b9-ac359fb6b055 tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:43.482011 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-6112e40c-6121-488c-94b9-ac359fb6b055 tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:43.545206 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112e40c-6121-488c-94b9-ac359fb6b055 tempest-VolumeQuotaClassesTest-713620230 tempest-VolumeQuotaClassesTest-713620230-project-admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:43.592879 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:43.601732 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9effa-e507-49bd-a3c4-7458f2bfbf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:43.602810 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9effa-e507-49bd-a3c4-7458f2bfbf46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:43.605545 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9effa-e507-49bd-a3c4-7458f2bfbf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:43.605545 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9effa-e507-49bd-a3c4-7458f2bfbf46 admin admin] PATH_INFO: `/v3/users/e8dc008a9f2b4ef5b958085f80db1f4c` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:43.605545 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9effa-e507-49bd-a3c4-7458f2bfbf46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8dc008a9f2b4ef5b958085f80db1f4c)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:43.606572 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9effa-e507-49bd-a3c4-7458f2bfbf46 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:43.775052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-cfe9effa-e507-49bd-a3c4-7458f2bfbf46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8dc008a9f2b4ef5b958085f80db1f4c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.781806 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-cfe9effa-e507-49bd-a3c4-7458f2bfbf46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8dc008a9f2b4ef5b958085f80db1f4c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.782465 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-cfe9effa-e507-49bd-a3c4-7458f2bfbf46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8dc008a9f2b4ef5b958085f80db1f4c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.847600 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-cfe9effa-e507-49bd-a3c4-7458f2bfbf46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8dc008a9f2b4ef5b958085f80db1f4c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.848268 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-cfe9effa-e507-49bd-a3c4-7458f2bfbf46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8dc008a9f2b4ef5b958085f80db1f4c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.867313 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1373/2780] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:43 2022] DELETE /identity/v3/users/e8dc008a9f2b4ef5b958085f80db1f4c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:43.872826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b3894-25e8-4d4d-ac68-3d7e0282bd94 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:43.873325 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b3894-25e8-4d4d-ac68-3d7e0282bd94 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:43.873422 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b3894-25e8-4d4d-ac68-3d7e0282bd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:43.890983 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-103b3894-25e8-4d4d-ac68-3d7e0282bd94 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:43.892213 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-103b3894-25e8-4d4d-ac68-3d7e0282bd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:43.953938 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1408/2781] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:43.964059 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9effa-e507-49bd-a3c4-7458f2bfbf46 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:43.966749 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-cfe9effa-e507-49bd-a3c4-7458f2bfbf46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:44.022609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9effa-e507-49bd-a3c4-7458f2bfbf46 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:44.027177 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c99e9-2f75-4d47-be80-246dc6d4dff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:44.027831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c99e9-2f75-4d47-be80-246dc6d4dff5 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:44.028154 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c99e9-2f75-4d47-be80-246dc6d4dff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:44.028428 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c99e9-2f75-4d47-be80-246dc6d4dff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:44.038231 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c99e9-2f75-4d47-be80-246dc6d4dff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:44.041082 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c99e9-2f75-4d47-be80-246dc6d4dff5 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:44.051122 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1374/2782] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:05:44.506899 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b3894-25e8-4d4d-ac68-3d7e0282bd94 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:44.508972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-103b3894-25e8-4d4d-ac68-3d7e0282bd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:44.521075 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b3894-25e8-4d4d-ac68-3d7e0282bd94 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:44.526578 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801d61e-bbbb-4892-b464-25403a66248a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:44.533025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801d61e-bbbb-4892-b464-25403a66248a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:44.533025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801d61e-bbbb-4892-b464-25403a66248a admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:44.533025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801d61e-bbbb-4892-b464-25403a66248a admin admin] PATH_INFO: `/v3/projects/5adc9bf47958494a87b0d233ced10d90` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:44.533025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801d61e-bbbb-4892-b464-25403a66248a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5adc9bf47958494a87b0d233ced10d90)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:44.533025 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801d61e-bbbb-4892-b464-25403a66248a admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:44.660144 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c801d61e-bbbb-4892-b464-25403a66248a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5adc9bf47958494a87b0d233ced10d90', 'request_id': 'req-c801d61e-bbbb-4892-b464-25403a66248a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:44.665741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c801d61e-bbbb-4892-b464-25403a66248a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5adc9bf47958494a87b0d233ced10d90', 'request_id': 'req-c801d61e-bbbb-4892-b464-25403a66248a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:44.755872 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c801d61e-bbbb-4892-b464-25403a66248a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5adc9bf47958494a87b0d233ced10d90', 'request_id': 'req-c801d61e-bbbb-4892-b464-25403a66248a'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:44.767907 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c801d61e-bbbb-4892-b464-25403a66248a admin admin] The token cache is being invalidate because project 5adc9bf47958494a87b0d233ced10d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:44.768199 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c801d61e-bbbb-4892-b464-25403a66248a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:44.768856 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c801d61e-bbbb-4892-b464-25403a66248a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:44.770885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1409/2783] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:44 2022] DELETE /identity/v3/projects/5adc9bf47958494a87b0d233ced10d90 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:44.775226 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c99e9-2f75-4d47-be80-246dc6d4dff5 service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:44.785031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c99e9-2f75-4d47-be80-246dc6d4dff5 service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:44.842007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3aae9a-0539-47c0-b848-f244773ea1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:44.842883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3aae9a-0539-47c0-b848-f244773ea1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:44.843168 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3aae9a-0539-47c0-b848-f244773ea1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:44.843467 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3aae9a-0539-47c0-b848-f244773ea1ac admin admin] PATH_INFO: `/v3/users/7712d275ab724d50a7c6ba9ac7dba9ac` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:44.844706 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3aae9a-0539-47c0-b848-f244773ea1ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=7712d275ab724d50a7c6ba9ac7dba9ac)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:44.846623 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3aae9a-0539-47c0-b848-f244773ea1ac admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:44.862050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:45.050380 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-3a3aae9a-0539-47c0-b848-f244773ea1ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7712d275ab724d50a7c6ba9ac7dba9ac'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:45.058346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-3a3aae9a-0539-47c0-b848-f244773ea1ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7712d275ab724d50a7c6ba9ac7dba9ac'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:45.059033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-3a3aae9a-0539-47c0-b848-f244773ea1ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7712d275ab724d50a7c6ba9ac7dba9ac'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:45.151257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-3a3aae9a-0539-47c0-b848-f244773ea1ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7712d275ab724d50a7c6ba9ac7dba9ac'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:45.151911 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-3a3aae9a-0539-47c0-b848-f244773ea1ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7712d275ab724d50a7c6ba9ac7dba9ac'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:45.170865 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1375/2784] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:44 2022] DELETE /identity/v3/users/7712d275ab724d50a7c6ba9ac7dba9ac => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:45.523215 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801d61e-bbbb-4892-b464-25403a66248a admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:45.525431 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-c801d61e-bbbb-4892-b464-25403a66248a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:45.540945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801d61e-bbbb-4892-b464-25403a66248a admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:45.591159 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:45.599711 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a64a99-ba84-4ff4-bf65-ea93f7cecafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:45.600856 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a64a99-ba84-4ff4-bf65-ea93f7cecafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:45.601139 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a64a99-ba84-4ff4-bf65-ea93f7cecafc admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:45.601434 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a64a99-ba84-4ff4-bf65-ea93f7cecafc admin admin] PATH_INFO: `/v3/projects/ed2da1ff63514d789643986c22918812` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:45.602638 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a64a99-ba84-4ff4-bf65-ea93f7cecafc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed2da1ff63514d789643986c22918812)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:45.604700 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a64a99-ba84-4ff4-bf65-ea93f7cecafc admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:45.699354 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-e5a64a99-ba84-4ff4-bf65-ea93f7cecafc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed2da1ff63514d789643986c22918812', 'request_id': 'req-e5a64a99-ba84-4ff4-bf65-ea93f7cecafc'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:45.704689 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-e5a64a99-ba84-4ff4-bf65-ea93f7cecafc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed2da1ff63514d789643986c22918812', 'request_id': 'req-e5a64a99-ba84-4ff4-bf65-ea93f7cecafc'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:45.761693 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-e5a64a99-ba84-4ff4-bf65-ea93f7cecafc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed2da1ff63514d789643986c22918812', 'request_id': 'req-e5a64a99-ba84-4ff4-bf65-ea93f7cecafc'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:45.773659 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-e5a64a99-ba84-4ff4-bf65-ea93f7cecafc admin admin] The token cache is being invalidate because project ed2da1ff63514d789643986c22918812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:45.773887 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-e5a64a99-ba84-4ff4-bf65-ea93f7cecafc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:45.774552 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-e5a64a99-ba84-4ff4-bf65-ea93f7cecafc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:45.776152 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1410/2785] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:45 2022] DELETE /identity/v3/projects/ed2da1ff63514d789643986c22918812 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:45.781023 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed4a50-587f-4911-bde4-f24c68267e03 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:45.781498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed4a50-587f-4911-bde4-f24c68267e03 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:45.781610 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed4a50-587f-4911-bde4-f24c68267e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:45.800071 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-50ed4a50-587f-4911-bde4-f24c68267e03 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:45.801379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-50ed4a50-587f-4911-bde4-f24c68267e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:45.859609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1376/2786] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:45.867304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6e7ad-377b-4d53-bdcf-863d3e0214d2 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:45.867601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6e7ad-377b-4d53-bdcf-863d3e0214d2 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:45.867885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6e7ad-377b-4d53-bdcf-863d3e0214d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:45.886913 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-17c6e7ad-377b-4d53-bdcf-863d3e0214d2 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:45.888136 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-17c6e7ad-377b-4d53-bdcf-863d3e0214d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:45.895989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1411/2787] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:45.900178 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed4a50-587f-4911-bde4-f24c68267e03 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:45.909582 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed4a50-587f-4911-bde4-f24c68267e03 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:45.914076 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0679bcc-7d67-4c2c-b2e3-0fcf08079bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:45.914726 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0679bcc-7d67-4c2c-b2e3-0fcf08079bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:45.915714 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0679bcc-7d67-4c2c-b2e3-0fcf08079bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:45.915999 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0679bcc-7d67-4c2c-b2e3-0fcf08079bd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:45.916824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0679bcc-7d67-4c2c-b2e3-0fcf08079bd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:05:45.917134 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0679bcc-7d67-4c2c-b2e3-0fcf08079bd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:45.918721 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0679bcc-7d67-4c2c-b2e3-0fcf08079bd9 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:45.929856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1377/2788] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:05:45.934478 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6e7ad-377b-4d53-bdcf-863d3e0214d2 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:45.943566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6e7ad-377b-4d53-bdcf-863d3e0214d2 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:45.948435 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836fdc8-dfcb-4681-a91e-18555e07e92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:45.949121 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836fdc8-dfcb-4681-a91e-18555e07e92a admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:45.949408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836fdc8-dfcb-4681-a91e-18555e07e92a admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:45.949691 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836fdc8-dfcb-4681-a91e-18555e07e92a admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:45.950435 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836fdc8-dfcb-4681-a91e-18555e07e92a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:45.952338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836fdc8-dfcb-4681-a91e-18555e07e92a admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:46.033121 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1412/2789] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:45 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:05:46.037187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0679bcc-7d67-4c2c-b2e3-0fcf08079bd9 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:46.048788 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0679bcc-7d67-4c2c-b2e3-0fcf08079bd9 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:46.110729 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30385a-a675-42f2-9d07-8517a9bc3460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:46.111398 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30385a-a675-42f2-9d07-8517a9bc3460 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:46.111681 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30385a-a675-42f2-9d07-8517a9bc3460 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:46.111956 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30385a-a675-42f2-9d07-8517a9bc3460 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:46.112655 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30385a-a675-42f2-9d07-8517a9bc3460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:46.114591 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30385a-a675-42f2-9d07-8517a9bc3460 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:46.200104 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1378/2790] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:46 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:46.201503 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836fdc8-dfcb-4681-a91e-18555e07e92a admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:46.211992 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836fdc8-dfcb-4681-a91e-18555e07e92a admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:46.218716 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92768556-ae4a-44e2-aba6-1490157d1932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:46.219392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92768556-ae4a-44e2-aba6-1490157d1932 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:46.219680 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92768556-ae4a-44e2-aba6-1490157d1932 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:46.219963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92768556-ae4a-44e2-aba6-1490157d1932 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:46.220748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92768556-ae4a-44e2-aba6-1490157d1932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:46.222363 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92768556-ae4a-44e2-aba6-1490157d1932 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:46.233647 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1413/2791] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:46.238032 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30385a-a675-42f2-9d07-8517a9bc3460 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:46.248769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30385a-a675-42f2-9d07-8517a9bc3460 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:46.253683 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4893714-8d8d-4eca-8ca0-d9c694c0d081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:46.254382 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4893714-8d8d-4eca-8ca0-d9c694c0d081 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:46.254669 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4893714-8d8d-4eca-8ca0-d9c694c0d081 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:46.255020 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4893714-8d8d-4eca-8ca0-d9c694c0d081 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:46.255875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4893714-8d8d-4eca-8ca0-d9c694c0d081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:46.257566 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4893714-8d8d-4eca-8ca0-d9c694c0d081 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:46.264927 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:46.270451 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1379/2792] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:46.275433 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92768556-ae4a-44e2-aba6-1490157d1932 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:46.286178 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92768556-ae4a-44e2-aba6-1490157d1932 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:46.291919 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a184cc6-90ff-447b-accf-792fe9bb4edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:46.292853 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a184cc6-90ff-447b-accf-792fe9bb4edb admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:46.293139 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a184cc6-90ff-447b-accf-792fe9bb4edb admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:46.293418 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a184cc6-90ff-447b-accf-792fe9bb4edb admin admin] PATH_INFO: `/v3/projects/e4c3922f07d0448baadbf1375fcfbc48/users/e70a1f25cf594b029f8adc9dd206e6e9/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:46.314521 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a184cc6-90ff-447b-accf-792fe9bb4edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4c3922f07d0448baadbf1375fcfbc48, user_id=e70a1f25cf594b029f8adc9dd206e6e9, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:46.319965 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a184cc6-90ff-447b-accf-792fe9bb4edb admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:46.448475 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1414/2793] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:46 2022] PUT /identity/v3/projects/e4c3922f07d0448baadbf1375fcfbc48/users/e70a1f25cf594b029f8adc9dd206e6e9/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:46.458918 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e571c0-4cbd-4bca-9b33-33dea5b72df1 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:46.459210 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e571c0-4cbd-4bca-9b33-33dea5b72df1 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:46.459500 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e571c0-4cbd-4bca-9b33-33dea5b72df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:46.486155 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-81e571c0-4cbd-4bca-9b33-33dea5b72df1 None None] MFA Rules not processed for user `e70a1f25cf594b029f8adc9dd206e6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:46.487374 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-81e571c0-4cbd-4bca-9b33-33dea5b72df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:46.553552 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1380/2794] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:46.565224 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a184cc6-90ff-447b-accf-792fe9bb4edb admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:46.567161 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-2a184cc6-90ff-447b-accf-792fe9bb4edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:46.625686 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a184cc6-90ff-447b-accf-792fe9bb4edb admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:46.629522 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731f168-2f61-42d0-865b-e9ca1f4b2aa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:46.630180 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731f168-2f61-42d0-865b-e9ca1f4b2aa6 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:46.630470 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731f168-2f61-42d0-865b-e9ca1f4b2aa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:46.630751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731f168-2f61-42d0-865b-e9ca1f4b2aa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:46.640372 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731f168-2f61-42d0-865b-e9ca1f4b2aa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:46.641889 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731f168-2f61-42d0-865b-e9ca1f4b2aa6 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:46.654595 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1415/2795] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:46.674449 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e571c0-4cbd-4bca-9b33-33dea5b72df1 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:46.735893 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e571c0-4cbd-4bca-9b33-33dea5b72df1 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:46.740387 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f335a4-5c6e-42cb-8e66-1f2170eda718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:46.741281 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f335a4-5c6e-42cb-8e66-1f2170eda718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:46.741562 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f335a4-5c6e-42cb-8e66-1f2170eda718 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:46.741833 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f335a4-5c6e-42cb-8e66-1f2170eda718 admin admin] PATH_INFO: `/v3/users/e70a1f25cf594b029f8adc9dd206e6e9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:46.743009 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f335a4-5c6e-42cb-8e66-1f2170eda718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e70a1f25cf594b029f8adc9dd206e6e9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:46.745615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f335a4-5c6e-42cb-8e66-1f2170eda718 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:46.941514 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-72f335a4-5c6e-42cb-8e66-1f2170eda718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e70a1f25cf594b029f8adc9dd206e6e9'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:46.948512 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-72f335a4-5c6e-42cb-8e66-1f2170eda718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e70a1f25cf594b029f8adc9dd206e6e9'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:46.949252 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-72f335a4-5c6e-42cb-8e66-1f2170eda718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e70a1f25cf594b029f8adc9dd206e6e9'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:46.990018 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-72f335a4-5c6e-42cb-8e66-1f2170eda718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e70a1f25cf594b029f8adc9dd206e6e9'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:46.990649 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-72f335a4-5c6e-42cb-8e66-1f2170eda718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e70a1f25cf594b029f8adc9dd206e6e9'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:47.009782 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1381/2796] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:46 2022] DELETE /identity/v3/users/e70a1f25cf594b029f8adc9dd206e6e9 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:47.014360 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fd714-cbfc-4783-8197-6d80ccc85418 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:47.014656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fd714-cbfc-4783-8197-6d80ccc85418 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:47.014940 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fd714-cbfc-4783-8197-6d80ccc85418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:47.032271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-9f9fd714-cbfc-4783-8197-6d80ccc85418 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:47.033498 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9f9fd714-cbfc-4783-8197-6d80ccc85418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:47.050728 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:47.093467 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1416/2797] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:47.104329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f335a4-5c6e-42cb-8e66-1f2170eda718 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:47.105887 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-72f335a4-5c6e-42cb-8e66-1f2170eda718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:47.116673 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:47.164795 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f335a4-5c6e-42cb-8e66-1f2170eda718 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:47.169198 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f78486-813f-4568-a14a-23de795f836a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:47.169979 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f78486-813f-4568-a14a-23de795f836a service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:47.170269 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f78486-813f-4568-a14a-23de795f836a service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:47.170546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f78486-813f-4568-a14a-23de795f836a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:47.179884 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f78486-813f-4568-a14a-23de795f836a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:47.181485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f78486-813f-4568-a14a-23de795f836a service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:47.191381 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1382/2798] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:05:47.493716 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fd714-cbfc-4783-8197-6d80ccc85418 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:47.495256 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9f9fd714-cbfc-4783-8197-6d80ccc85418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:47.507208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fd714-cbfc-4783-8197-6d80ccc85418 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:47.512451 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72916e3-5488-4c64-bdf0-ee8819c7711c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:47.513363 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72916e3-5488-4c64-bdf0-ee8819c7711c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:47.513658 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72916e3-5488-4c64-bdf0-ee8819c7711c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:47.513941 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72916e3-5488-4c64-bdf0-ee8819c7711c admin admin] PATH_INFO: `/v3/users/f37cc72b42c349319b262fbd49a20316` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:47.515147 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72916e3-5488-4c64-bdf0-ee8819c7711c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f37cc72b42c349319b262fbd49a20316)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:47.517149 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72916e3-5488-4c64-bdf0-ee8819c7711c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:47.582242 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f78486-813f-4568-a14a-23de795f836a service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:47.582242 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-63f78486-813f-4568-a14a-23de795f836a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:47.596230 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f78486-813f-4568-a14a-23de795f836a service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:47.601161 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32c888-f291-4897-9c10-02643990bf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:47.602031 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32c888-f291-4897-9c10-02643990bf1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:47.602688 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32c888-f291-4897-9c10-02643990bf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:47.602824 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32c888-f291-4897-9c10-02643990bf1b admin admin] PATH_INFO: `/v3/projects/e4c3922f07d0448baadbf1375fcfbc48` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:47.604052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32c888-f291-4897-9c10-02643990bf1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4c3922f07d0448baadbf1375fcfbc48)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:47.606004 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32c888-f291-4897-9c10-02643990bf1b admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:47.678893 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a72916e3-5488-4c64-bdf0-ee8819c7711c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f37cc72b42c349319b262fbd49a20316'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:47.686539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a72916e3-5488-4c64-bdf0-ee8819c7711c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f37cc72b42c349319b262fbd49a20316'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:47.705525 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-3d32c888-f291-4897-9c10-02643990bf1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4c3922f07d0448baadbf1375fcfbc48', 'request_id': 'req-3d32c888-f291-4897-9c10-02643990bf1b'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:47.738901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a72916e3-5488-4c64-bdf0-ee8819c7711c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f37cc72b42c349319b262fbd49a20316'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:47.739516 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a72916e3-5488-4c64-bdf0-ee8819c7711c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f37cc72b42c349319b262fbd49a20316'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:47.740195 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a72916e3-5488-4c64-bdf0-ee8819c7711c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f37cc72b42c349319b262fbd49a20316'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:47.759137 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1417/2799] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:47 2022] DELETE /identity/v3/users/f37cc72b42c349319b262fbd49a20316 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:47.763557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010493b-edff-43b2-8cca-da2180206321 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:47.763853 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010493b-edff-43b2-8cca-da2180206321 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:47.764169 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010493b-edff-43b2-8cca-da2180206321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:47.781621 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-6010493b-edff-43b2-8cca-da2180206321 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:47.782824 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6010493b-edff-43b2-8cca-da2180206321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:47.801844 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-3d32c888-f291-4897-9c10-02643990bf1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4c3922f07d0448baadbf1375fcfbc48', 'request_id': 'req-3d32c888-f291-4897-9c10-02643990bf1b'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:47.808958 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-3d32c888-f291-4897-9c10-02643990bf1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4c3922f07d0448baadbf1375fcfbc48', 'request_id': 'req-3d32c888-f291-4897-9c10-02643990bf1b'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:47.820221 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-3d32c888-f291-4897-9c10-02643990bf1b admin admin] The token cache is being invalidate because project e4c3922f07d0448baadbf1375fcfbc48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92004) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:47.820509 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-3d32c888-f291-4897-9c10-02643990bf1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:47.821344 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-3d32c888-f291-4897-9c10-02643990bf1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:47.823466 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1383/2800] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:47 2022] DELETE /identity/v3/projects/e4c3922f07d0448baadbf1375fcfbc48 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:05:47.828380 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cae7c4-b8e5-40c7-8da1-b6fae8f08bdb None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:47.828777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cae7c4-b8e5-40c7-8da1-b6fae8f08bdb None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:47.829062 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cae7c4-b8e5-40c7-8da1-b6fae8f08bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:47.845543 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1418/2801] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:47.847769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-13cae7c4-b8e5-40c7-8da1-b6fae8f08bdb None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:47.849183 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-13cae7c4-b8e5-40c7-8da1-b6fae8f08bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:47.855415 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010493b-edff-43b2-8cca-da2180206321 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:47.856755 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6010493b-edff-43b2-8cca-da2180206321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:47.857688 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1384/2802] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:47.866337 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280bbd4-2c33-4816-8e30-69625c284cd8 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:47.866623 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280bbd4-2c33-4816-8e30-69625c284cd8 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:47.866929 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280bbd4-2c33-4816-8e30-69625c284cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:47.885537 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-d280bbd4-2c33-4816-8e30-69625c284cd8 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:47.893168 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-d280bbd4-2c33-4816-8e30-69625c284cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:47.894572 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1385/2803] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:47.898267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:47.898890 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280bbd4-2c33-4816-8e30-69625c284cd8 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:47.908373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280bbd4-2c33-4816-8e30-69625c284cd8 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:47.913211 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5dd29-e363-49f7-b20a-db6f24d07fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:47.915965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5dd29-e363-49f7-b20a-db6f24d07fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:47.915965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5dd29-e363-49f7-b20a-db6f24d07fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:47.915965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5dd29-e363-49f7-b20a-db6f24d07fa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:47.915965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5dd29-e363-49f7-b20a-db6f24d07fa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:05:47.915965 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5dd29-e363-49f7-b20a-db6f24d07fa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:47.916506 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010493b-edff-43b2-8cca-da2180206321 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:47.917217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5dd29-e363-49f7-b20a-db6f24d07fa9 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:47.919956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd85b3-f485-4136-a909-86b6d9677039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:47.920598 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd85b3-f485-4136-a909-86b6d9677039 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:47.920916 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd85b3-f485-4136-a909-86b6d9677039 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:47.921194 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd85b3-f485-4136-a909-86b6d9677039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:47.933041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1386/2804] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:05:47.934296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5dd29-e363-49f7-b20a-db6f24d07fa9 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:47.934745 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd85b3-f485-4136-a909-86b6d9677039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:47.936205 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd85b3-f485-4136-a909-86b6d9677039 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:47.944257 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5dd29-e363-49f7-b20a-db6f24d07fa9 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:47.946246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1419/2805] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:05:47.950884 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316653b2-f0d0-4fb5-a7c5-4f9c34a01a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:47.951556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316653b2-f0d0-4fb5-a7c5-4f9c34a01a12 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:47.951837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316653b2-f0d0-4fb5-a7c5-4f9c34a01a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:47.952114 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316653b2-f0d0-4fb5-a7c5-4f9c34a01a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:47.952839 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316653b2-f0d0-4fb5-a7c5-4f9c34a01a12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:47.954872 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316653b2-f0d0-4fb5-a7c5-4f9c34a01a12 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:48.044665 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1387/2806] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:47 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:05:48.046902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd85b3-f485-4136-a909-86b6d9677039 service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:48.057432 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd85b3-f485-4136-a909-86b6d9677039 service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:48.113669 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e257d-f857-4443-868f-a8260c238e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:48.114498 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e257d-f857-4443-868f-a8260c238e23 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:48.114690 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e257d-f857-4443-868f-a8260c238e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:48.114954 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e257d-f857-4443-868f-a8260c238e23 admin admin] PATH_INFO: `/v3/users` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:48.115652 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e257d-f857-4443-868f-a8260c238e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:48.117628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e257d-f857-4443-868f-a8260c238e23 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:48.206489 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1420/2807] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:48 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:48.207744 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316653b2-f0d0-4fb5-a7c5-4f9c34a01a12 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:48.218740 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316653b2-f0d0-4fb5-a7c5-4f9c34a01a12 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:48.224159 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81b34b-afe2-4813-84d4-7f76bf51cbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:48.224945 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81b34b-afe2-4813-84d4-7f76bf51cbab admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:48.225487 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81b34b-afe2-4813-84d4-7f76bf51cbab admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:48.228769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81b34b-afe2-4813-84d4-7f76bf51cbab admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:48.228769 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81b34b-afe2-4813-84d4-7f76bf51cbab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:48.228974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81b34b-afe2-4813-84d4-7f76bf51cbab admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:48.240084 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1388/2808] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:48.245314 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e257d-f857-4443-868f-a8260c238e23 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:48.255600 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e257d-f857-4443-868f-a8260c238e23 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:48.261270 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cda8d-1736-43f1-8ba0-b31730c25102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:48.261945 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cda8d-1736-43f1-8ba0-b31730c25102 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:48.262237 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cda8d-1736-43f1-8ba0-b31730c25102 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:48.262545 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cda8d-1736-43f1-8ba0-b31730c25102 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:48.263281 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794cda8d-1736-43f1-8ba0-b31730c25102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:48.264923 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794cda8d-1736-43f1-8ba0-b31730c25102 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:48.276326 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1421/2809] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:05:48.280525 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81b34b-afe2-4813-84d4-7f76bf51cbab admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:48.290865 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81b34b-afe2-4813-84d4-7f76bf51cbab admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:48.295739 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c81eeb-936c-401a-8cf2-1ba9b1ebef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:48.296850 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c81eeb-936c-401a-8cf2-1ba9b1ebef99 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:48.297138 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c81eeb-936c-401a-8cf2-1ba9b1ebef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:48.297420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c81eeb-936c-401a-8cf2-1ba9b1ebef99 admin admin] PATH_INFO: `/v3/projects/273e5b0e61fe46989239b561c82cb255/users/bd27a78d5efe47a3bbcfb6b5c3adbb3d/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:48.312698 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c81eeb-936c-401a-8cf2-1ba9b1ebef99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=273e5b0e61fe46989239b561c82cb255, user_id=bd27a78d5efe47a3bbcfb6b5c3adbb3d, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:48.315383 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c81eeb-936c-401a-8cf2-1ba9b1ebef99 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:48.347798 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cda8d-1736-43f1-8ba0-b31730c25102 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:48.349721 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-794cda8d-1736-43f1-8ba0-b31730c25102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:48.362830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1389/2810] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:48 2022] PUT /identity/v3/projects/273e5b0e61fe46989239b561c82cb255/users/bd27a78d5efe47a3bbcfb6b5c3adbb3d/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:05:48.368620 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73652c8c-88b6-48b2-a7c0-f162c45e2563 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:48.369141 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73652c8c-88b6-48b2-a7c0-f162c45e2563 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:48.369638 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73652c8c-88b6-48b2-a7c0-f162c45e2563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:48.371453 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cda8d-1736-43f1-8ba0-b31730c25102 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:48.395474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-73652c8c-88b6-48b2-a7c0-f162c45e2563 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:48.397073 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-73652c8c-88b6-48b2-a7c0-f162c45e2563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:48.402987 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:48.434855 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3dadf-d75f-4ecd-b135-cbf0aed0437c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:48.435870 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3dadf-d75f-4ecd-b135-cbf0aed0437c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:48.436263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3dadf-d75f-4ecd-b135-cbf0aed0437c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:48.436660 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3dadf-d75f-4ecd-b135-cbf0aed0437c admin admin] PATH_INFO: `/v3/projects/1e611133a9cd4d0daf66803be057bb81` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:48.438001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3dadf-d75f-4ecd-b135-cbf0aed0437c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e611133a9cd4d0daf66803be057bb81)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:48.439993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3dadf-d75f-4ecd-b135-cbf0aed0437c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:48.460556 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1390/2811] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:48.471378 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73652c8c-88b6-48b2-a7c0-f162c45e2563 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:48.472777 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-73652c8c-88b6-48b2-a7c0-f162c45e2563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:48.533702 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73652c8c-88b6-48b2-a7c0-f162c45e2563 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:48.547882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c0d3dadf-d75f-4ecd-b135-cbf0aed0437c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e611133a9cd4d0daf66803be057bb81', 'request_id': 'req-c0d3dadf-d75f-4ecd-b135-cbf0aed0437c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:48.554592 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c0d3dadf-d75f-4ecd-b135-cbf0aed0437c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e611133a9cd4d0daf66803be057bb81', 'request_id': 'req-c0d3dadf-d75f-4ecd-b135-cbf0aed0437c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:48.557117 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:48.585895 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23abd73-dde6-49cf-a69a-8194ffb09bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:48.586557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23abd73-dde6-49cf-a69a-8194ffb09bfb service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:48.587019 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23abd73-dde6-49cf-a69a-8194ffb09bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:48.587414 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23abd73-dde6-49cf-a69a-8194ffb09bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:48.614232 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c0d3dadf-d75f-4ecd-b135-cbf0aed0437c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e611133a9cd4d0daf66803be057bb81', 'request_id': 'req-c0d3dadf-d75f-4ecd-b135-cbf0aed0437c'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:48.628163 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c0d3dadf-d75f-4ecd-b135-cbf0aed0437c admin admin] The token cache is being invalidate because project 1e611133a9cd4d0daf66803be057bb81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:48.628510 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c0d3dadf-d75f-4ecd-b135-cbf0aed0437c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:48.629168 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c0d3dadf-d75f-4ecd-b135-cbf0aed0437c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:48.630777 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1422/2812] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:48 2022] DELETE /identity/v3/projects/1e611133a9cd4d0daf66803be057bb81 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:48.655816 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23abd73-dde6-49cf-a69a-8194ffb09bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:48.657336 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23abd73-dde6-49cf-a69a-8194ffb09bfb service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:48.668554 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1391/2813] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:05:49.881932 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a1a75-9728-49cf-b0ed-42a2146cc93a None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:49.882405 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a1a75-9728-49cf-b0ed-42a2146cc93a None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:49.882531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a1a75-9728-49cf-b0ed-42a2146cc93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:49.914415 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-e86a1a75-9728-49cf-b0ed-42a2146cc93a None None] MFA Rules not processed for user `bd27a78d5efe47a3bbcfb6b5c3adbb3d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:49.916258 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-e86a1a75-9728-49cf-b0ed-42a2146cc93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:49.990197 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1423/2814] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:50.001067 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23abd73-dde6-49cf-a69a-8194ffb09bfb service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:50.002617 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a23abd73-dde6-49cf-a69a-8194ffb09bfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:50.023501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:50.061367 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23abd73-dde6-49cf-a69a-8194ffb09bfb service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:50.065021 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62e3b9-102b-4e1a-84f1-c4ccfbd1c736 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:50.065661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62e3b9-102b-4e1a-84f1-c4ccfbd1c736 service cinder] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:50.065943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62e3b9-102b-4e1a-84f1-c4ccfbd1c736 service cinder] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:50.066218 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62e3b9-102b-4e1a-84f1-c4ccfbd1c736 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:50.075061 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62e3b9-102b-4e1a-84f1-c4ccfbd1c736 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:50.076481 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62e3b9-102b-4e1a-84f1-c4ccfbd1c736 service cinder] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:50.085322 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1392/2815] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:51.775160 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b75dc-95c5-41e4-88d2-22b703668df8 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:51.775836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b75dc-95c5-41e4-88d2-22b703668df8 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:51.776000 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b75dc-95c5-41e4-88d2-22b703668df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:51.796842 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-bf3b75dc-95c5-41e4-88d2-22b703668df8 None None] MFA Rules not processed for user `bd27a78d5efe47a3bbcfb6b5c3adbb3d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:51.798114 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-bf3b75dc-95c5-41e4-88d2-22b703668df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:51.807420 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1424/2816] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:05:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:52.042607 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62e3b9-102b-4e1a-84f1-c4ccfbd1c736 service cinder] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:52.044080 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-4b62e3b9-102b-4e1a-84f1-c4ccfbd1c736 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:52.056039 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62e3b9-102b-4e1a-84f1-c4ccfbd1c736 service cinder] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:52.059587 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b2813-2827-4ad8-9a8e-bb82634a8fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:52.060230 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b2813-2827-4ad8-9a8e-bb82634a8fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:52.060521 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b2813-2827-4ad8-9a8e-bb82634a8fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:52.060837 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b2813-2827-4ad8-9a8e-bb82634a8fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:52.062554 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e52b2813-2827-4ad8-9a8e-bb82634a8fb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:52.072833 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b2813-2827-4ad8-9a8e-bb82634a8fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:52.074261 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b2813-2827-4ad8-9a8e-bb82634a8fb7 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:52.082504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1393/2817] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:06:01.789898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=39 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:02.078695 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=24 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:07.689916 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b75dc-95c5-41e4-88d2-22b703668df8 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:07.691369 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-bf3b75dc-95c5-41e4-88d2-22b703668df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:07.761836 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b75dc-95c5-41e4-88d2-22b703668df8 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:07.768144 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e355e6-b2fe-432d-a69e-78676155ee96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff588aaad264f9cbc5a80e73ef0c09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:07.768965 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e355e6-b2fe-432d-a69e-78676155ee96 service placement] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:07.769312 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e355e6-b2fe-432d-a69e-78676155ee96 service placement] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:07.769686 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e355e6-b2fe-432d-a69e-78676155ee96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:07.771873 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-11e355e6-b2fe-432d-a69e-78676155ee96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:07.785315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e355e6-b2fe-432d-a69e-78676155ee96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:07.786946 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e355e6-b2fe-432d-a69e-78676155ee96 service placement] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:07.797972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1425/2818] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:06:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:06:08.495468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92489921-5864-4b8e-8396-a6a2609f797d None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:08.495951 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92489921-5864-4b8e-8396-a6a2609f797d None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:08.496147 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92489921-5864-4b8e-8396-a6a2609f797d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:08.513618 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-92489921-5864-4b8e-8396-a6a2609f797d None None] MFA Rules not processed for user `bd27a78d5efe47a3bbcfb6b5c3adbb3d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:06:08.515519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-92489921-5864-4b8e-8396-a6a2609f797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:08.522217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1394/2819] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:06:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:06:17.792773 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=32 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:18.508320 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:26.064392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72e15c-9c4b-4eff-a042-fb552bb84852 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:26.064880 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72e15c-9c4b-4eff-a042-fb552bb84852 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:26.065144 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72e15c-9c4b-4eff-a042-fb552bb84852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:26.083379 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-fb72e15c-9c4b-4eff-a042-fb552bb84852 None None] MFA Rules not processed for user `1b03d940626a449dbe904f02f3d70854`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:06:26.084912 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-fb72e15c-9c4b-4eff-a042-fb552bb84852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:26.142445 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1426/2820] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 23 11:06:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:06:26.184840 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92489921-5864-4b8e-8396-a6a2609f797d None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:26.186677 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-92489921-5864-4b8e-8396-a6a2609f797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:26.255068 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92489921-5864-4b8e-8396-a6a2609f797d None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:26.259825 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829444c2-e7fe-4c8e-b682-25802ac40868 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a54fa1c326f41e88688404a56b75c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:26.260471 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829444c2-e7fe-4c8e-b682-25802ac40868 service swift] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:26.260785 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829444c2-e7fe-4c8e-b682-25802ac40868 service swift] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:26.261065 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829444c2-e7fe-4c8e-b682-25802ac40868 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:26.269134 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829444c2-e7fe-4c8e-b682-25802ac40868 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:26.270768 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829444c2-e7fe-4c8e-b682-25802ac40868 service swift] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:26.278909 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1395/2821] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 23 11:06:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:06:36.135428 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=25 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:36.275672 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=32 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:41.779961 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56419453-88a8-45c3-9203-e92f137aa8cd None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:41.780885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56419453-88a8-45c3-9203-e92f137aa8cd None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:41.780885 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56419453-88a8-45c3-9203-e92f137aa8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:41.798132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-56419453-88a8-45c3-9203-e92f137aa8cd None None] MFA Rules not processed for user `1b03d940626a449dbe904f02f3d70854`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:06:41.799332 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-56419453-88a8-45c3-9203-e92f137aa8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:41.807586 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1427/2822] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jun 23 11:06:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:06:41.820366 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829444c2-e7fe-4c8e-b682-25802ac40868 service swift] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:41.831454 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829444c2-e7fe-4c8e-b682-25802ac40868 service swift] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:41.836703 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ef4ab-85c0-4b62-9f96-ef85798396bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a54fa1c326f41e88688404a56b75c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:41.837354 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ef4ab-85c0-4b62-9f96-ef85798396bb service swift] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:41.837664 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ef4ab-85c0-4b62-9f96-ef85798396bb service swift] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:41.837943 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ef4ab-85c0-4b62-9f96-ef85798396bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:41.846181 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ef4ab-85c0-4b62-9f96-ef85798396bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:41.848460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ef4ab-85c0-4b62-9f96-ef85798396bb service swift] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:41.857398 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1396/2823] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 23 11:06:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:06:44.548546 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56419453-88a8-45c3-9203-e92f137aa8cd None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:44.548546 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-56419453-88a8-45c3-9203-e92f137aa8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:44.565522 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56419453-88a8-45c3-9203-e92f137aa8cd None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:44.577303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f544c1-9c73-439c-8e16-75acf3a2d793 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff588aaad264f9cbc5a80e73ef0c09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:44.577303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f544c1-9c73-439c-8e16-75acf3a2d793 service placement] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:44.577303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f544c1-9c73-439c-8e16-75acf3a2d793 service placement] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:44.577303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f544c1-9c73-439c-8e16-75acf3a2d793 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:44.577725 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-68f544c1-9c73-439c-8e16-75acf3a2d793 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:44.586788 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f544c1-9c73-439c-8e16-75acf3a2d793 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:44.588435 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f544c1-9c73-439c-8e16-75acf3a2d793 service placement] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:44.600096 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1428/2824] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:06:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:06:44.669773 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ef4ab-85c0-4b62-9f96-ef85798396bb service swift] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:44.671207 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-833ef4ab-85c0-4b62-9f96-ef85798396bb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:44.685376 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ef4ab-85c0-4b62-9f96-ef85798396bb service swift] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:44.690871 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c628ff-bf0e-4ce3-a9ab-1de1ea69ce2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:44.692076 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c628ff-bf0e-4ce3-a9ab-1de1ea69ce2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:44.692368 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c628ff-bf0e-4ce3-a9ab-1de1ea69ce2d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:44.692714 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c628ff-bf0e-4ce3-a9ab-1de1ea69ce2d admin admin] PATH_INFO: `/v3/users/bd27a78d5efe47a3bbcfb6b5c3adbb3d` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:44.693944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c628ff-bf0e-4ce3-a9ab-1de1ea69ce2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd27a78d5efe47a3bbcfb6b5c3adbb3d)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:44.695995 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c628ff-bf0e-4ce3-a9ab-1de1ea69ce2d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:44.836743 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-78c628ff-bf0e-4ce3-a9ab-1de1ea69ce2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd27a78d5efe47a3bbcfb6b5c3adbb3d'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:44.843217 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-78c628ff-bf0e-4ce3-a9ab-1de1ea69ce2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd27a78d5efe47a3bbcfb6b5c3adbb3d'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:44.843979 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-78c628ff-bf0e-4ce3-a9ab-1de1ea69ce2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd27a78d5efe47a3bbcfb6b5c3adbb3d'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:44.897048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-78c628ff-bf0e-4ce3-a9ab-1de1ea69ce2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd27a78d5efe47a3bbcfb6b5c3adbb3d'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:44.897645 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-78c628ff-bf0e-4ce3-a9ab-1de1ea69ce2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd27a78d5efe47a3bbcfb6b5c3adbb3d'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:44.914756 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1397/2825] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:06:44 2022] DELETE /identity/v3/users/bd27a78d5efe47a3bbcfb6b5c3adbb3d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:06:45.138957 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f544c1-9c73-439c-8e16-75acf3a2d793 service placement] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:45.154172 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f544c1-9c73-439c-8e16-75acf3a2d793 service placement] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:45.221710 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673355f-d90f-46f1-af4c-af55433c68f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:45.222710 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673355f-d90f-46f1-af4c-af55433c68f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:45.223026 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673355f-d90f-46f1-af4c-af55433c68f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:45.223352 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673355f-d90f-46f1-af4c-af55433c68f4 admin admin] PATH_INFO: `/v3/projects/273e5b0e61fe46989239b561c82cb255` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:45.224839 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673355f-d90f-46f1-af4c-af55433c68f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=273e5b0e61fe46989239b561c82cb255)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:45.226729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673355f-d90f-46f1-af4c-af55433c68f4 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:45.320748 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c673355f-d90f-46f1-af4c-af55433c68f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273e5b0e61fe46989239b561c82cb255', 'request_id': 'req-c673355f-d90f-46f1-af4c-af55433c68f4'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:45.326367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c673355f-d90f-46f1-af4c-af55433c68f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273e5b0e61fe46989239b561c82cb255', 'request_id': 'req-c673355f-d90f-46f1-af4c-af55433c68f4'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:45.405576 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c673355f-d90f-46f1-af4c-af55433c68f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273e5b0e61fe46989239b561c82cb255', 'request_id': 'req-c673355f-d90f-46f1-af4c-af55433c68f4'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:45.417898 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c673355f-d90f-46f1-af4c-af55433c68f4 admin admin] The token cache is being invalidate because project 273e5b0e61fe46989239b561c82cb255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:06:45.418132 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c673355f-d90f-46f1-af4c-af55433c68f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:45.419383 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c673355f-d90f-46f1-af4c-af55433c68f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:45.421217 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1429/2826] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:06:45 2022] DELETE /identity/v3/projects/273e5b0e61fe46989239b561c82cb255 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:06:45.426526 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc8e94-bbd4-444c-9001-03d4d56fc559 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:45.426834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc8e94-bbd4-444c-9001-03d4d56fc559 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:45.427121 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc8e94-bbd4-444c-9001-03d4d56fc559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:45.445742 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-2bfc8e94-bbd4-444c-9001-03d4d56fc559 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:06:45.447142 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-2bfc8e94-bbd4-444c-9001-03d4d56fc559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:45.512372 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1398/2827] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:06:45.534062 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a5006-d67b-4e36-b5b9-08d4a93b4d5f None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:45.534062 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a5006-d67b-4e36-b5b9-08d4a93b4d5f None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:45.534062 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a5006-d67b-4e36-b5b9-08d4a93b4d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:45.540936 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-d31a5006-d67b-4e36-b5b9-08d4a93b4d5f None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:06:45.542171 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-d31a5006-d67b-4e36-b5b9-08d4a93b4d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:45.550782 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1430/2828] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:06:45.555256 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc8e94-bbd4-444c-9001-03d4d56fc559 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:45.565254 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc8e94-bbd4-444c-9001-03d4d56fc559 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:45.570369 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f00f5-457d-4307-9e58-dc69e609caf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:45.571038 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f00f5-457d-4307-9e58-dc69e609caf0 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:45.571331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f00f5-457d-4307-9e58-dc69e609caf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:45.571608 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f00f5-457d-4307-9e58-dc69e609caf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:45.572334 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f00f5-457d-4307-9e58-dc69e609caf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:06:45.572663 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f00f5-457d-4307-9e58-dc69e609caf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:45.574267 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f00f5-457d-4307-9e58-dc69e609caf0 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:45.589559 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1399/2829] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:06:45.590718 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a5006-d67b-4e36-b5b9-08d4a93b4d5f None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:45.601004 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a5006-d67b-4e36-b5b9-08d4a93b4d5f None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:45.605780 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03feff2-3a4d-43bf-afcd-22a17c087814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:45.606440 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03feff2-3a4d-43bf-afcd-22a17c087814 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:45.606849 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03feff2-3a4d-43bf-afcd-22a17c087814 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:45.607133 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03feff2-3a4d-43bf-afcd-22a17c087814 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:45.607823 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03feff2-3a4d-43bf-afcd-22a17c087814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:45.609902 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03feff2-3a4d-43bf-afcd-22a17c087814 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:45.694241 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1431/2830] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:06:45 2022] POST /identity/v3/projects => generated 361 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:06:45.698262 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f00f5-457d-4307-9e58-dc69e609caf0 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:45.708741 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f00f5-457d-4307-9e58-dc69e609caf0 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:45.753184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:45.765928 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf851b-e6a3-4e84-a2b1-61ef604cedb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:45.766610 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf851b-e6a3-4e84-a2b1-61ef604cedb4 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:45.766902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf851b-e6a3-4e84-a2b1-61ef604cedb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:45.767186 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf851b-e6a3-4e84-a2b1-61ef604cedb4 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:45.767884 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf851b-e6a3-4e84-a2b1-61ef604cedb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:45.769990 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf851b-e6a3-4e84-a2b1-61ef604cedb4 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:45.823442 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1400/2831] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:06:45 2022] POST /identity/v3/users => generated 281 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:06:45.827270 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03feff2-3a4d-43bf-afcd-22a17c087814 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:45.837629 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03feff2-3a4d-43bf-afcd-22a17c087814 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:45.842250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539e3d6-7eac-4534-9a60-0e5836c926a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:45.842904 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539e3d6-7eac-4534-9a60-0e5836c926a1 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:45.843189 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539e3d6-7eac-4534-9a60-0e5836c926a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:45.843465 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539e3d6-7eac-4534-9a60-0e5836c926a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:45.844193 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539e3d6-7eac-4534-9a60-0e5836c926a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:45.845861 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539e3d6-7eac-4534-9a60-0e5836c926a1 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:45.860858 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1432/2832] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:06:45.862141 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf851b-e6a3-4e84-a2b1-61ef604cedb4 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:45.874239 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf851b-e6a3-4e84-a2b1-61ef604cedb4 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:45.879958 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205b8d9-192a-4966-b49d-2c200bad2ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:45.880994 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205b8d9-192a-4966-b49d-2c200bad2ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:45.881347 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205b8d9-192a-4966-b49d-2c200bad2ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:45.881693 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205b8d9-192a-4966-b49d-2c200bad2ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:45.882498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205b8d9-192a-4966-b49d-2c200bad2ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:45.884232 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205b8d9-192a-4966-b49d-2c200bad2ec9 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:45.895801 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1401/2833] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:06:45.899729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539e3d6-7eac-4534-9a60-0e5836c926a1 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:45.934934 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539e3d6-7eac-4534-9a60-0e5836c926a1 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:45.940585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b29d75-c2a2-46a2-b1b8-126eded60478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:45.941538 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b29d75-c2a2-46a2-b1b8-126eded60478 admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:45.941827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b29d75-c2a2-46a2-b1b8-126eded60478 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:45.942108 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b29d75-c2a2-46a2-b1b8-126eded60478 admin admin] PATH_INFO: `/v3/projects/f206898db6564d308bc33f6210448191/users/014cb80b55764a03a0aaed4a93a71286/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:45.963295 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b29d75-c2a2-46a2-b1b8-126eded60478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f206898db6564d308bc33f6210448191, user_id=014cb80b55764a03a0aaed4a93a71286, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:45.967418 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b29d75-c2a2-46a2-b1b8-126eded60478 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:46.091367 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1433/2834] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:06:45 2022] PUT /identity/v3/projects/f206898db6564d308bc33f6210448191/users/014cb80b55764a03a0aaed4a93a71286/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:06:46.103341 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea03b0-ecb5-413b-9bff-8231562a91aa None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:46.103638 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea03b0-ecb5-413b-9bff-8231562a91aa None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:46.103920 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea03b0-ecb5-413b-9bff-8231562a91aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:46.149584 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-75ea03b0-ecb5-413b-9bff-8231562a91aa None None] MFA Rules not processed for user `014cb80b55764a03a0aaed4a93a71286`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:06:46.150831 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-75ea03b0-ecb5-413b-9bff-8231562a91aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:46.243516 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1402/2835] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:06:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:06:46.255054 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b29d75-c2a2-46a2-b1b8-126eded60478 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:46.257439 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b5b29d75-c2a2-46a2-b1b8-126eded60478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:46.268594 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:46.333076 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b29d75-c2a2-46a2-b1b8-126eded60478 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:46.349415 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe4381-a90f-4117-babf-7dd6578b768c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:46.350271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe4381-a90f-4117-babf-7dd6578b768c service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:46.350624 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe4381-a90f-4117-babf-7dd6578b768c service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:46.350969 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe4381-a90f-4117-babf-7dd6578b768c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:46.361763 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe4381-a90f-4117-babf-7dd6578b768c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:46.363563 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe4381-a90f-4117-babf-7dd6578b768c service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:46.375034 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1434/2836] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:06:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:06:54.102269 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454e605-ef6e-4c15-991c-7b2e173a7515 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:54.102791 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454e605-ef6e-4c15-991c-7b2e173a7515 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:54.102893 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454e605-ef6e-4c15-991c-7b2e173a7515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:54.120944 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-7454e605-ef6e-4c15-991c-7b2e173a7515 None None] MFA Rules not processed for user `1b03d940626a449dbe904f02f3d70854`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:06:54.122128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-7454e605-ef6e-4c15-991c-7b2e173a7515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:54.177357 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1403/2837] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jun 23 11:06:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:06:54.189554 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe4381-a90f-4117-babf-7dd6578b768c service cinder] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:54.190962 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-a7fe4381-a90f-4117-babf-7dd6578b768c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:54.260612 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe4381-a90f-4117-babf-7dd6578b768c service cinder] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:54.265956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9547d8-8a55-466a-ae07-a5d484b176f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a54fa1c326f41e88688404a56b75c30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:54.266603 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9547d8-8a55-466a-ae07-a5d484b176f7 service swift] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:54.266896 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9547d8-8a55-466a-ae07-a5d484b176f7 service swift] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:54.267873 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9547d8-8a55-466a-ae07-a5d484b176f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:54.276687 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9547d8-8a55-466a-ae07-a5d484b176f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:54.278338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9547d8-8a55-466a-ae07-a5d484b176f7 service swift] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:54.287140 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1435/2838] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 23 11:06:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:07:02.784165 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454e605-ef6e-4c15-991c-7b2e173a7515 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:02.786438 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-7454e605-ef6e-4c15-991c-7b2e173a7515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:02.860978 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454e605-ef6e-4c15-991c-7b2e173a7515 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:02.865614 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9ec69-4ea9-4c73-aeed-ba5976bc3afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:02.866497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9ec69-4ea9-4c73-aeed-ba5976bc3afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:02.866889 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9ec69-4ea9-4c73-aeed-ba5976bc3afb admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:02.867174 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9ec69-4ea9-4c73-aeed-ba5976bc3afb admin admin] PATH_INFO: `/v3/users/8fa38ff2dae2460ea363f1c3448d533c` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:02.868421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9ec69-4ea9-4c73-aeed-ba5976bc3afb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fa38ff2dae2460ea363f1c3448d533c)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:02.870412 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9ec69-4ea9-4c73-aeed-ba5976bc3afb admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:02.871997 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:03.041880 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-0ad9ec69-4ea9-4c73-aeed-ba5976bc3afb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fa38ff2dae2460ea363f1c3448d533c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:03.048518 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-0ad9ec69-4ea9-4c73-aeed-ba5976bc3afb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fa38ff2dae2460ea363f1c3448d533c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:03.049197 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-0ad9ec69-4ea9-4c73-aeed-ba5976bc3afb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fa38ff2dae2460ea363f1c3448d533c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:03.097046 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-0ad9ec69-4ea9-4c73-aeed-ba5976bc3afb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fa38ff2dae2460ea363f1c3448d533c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:03.097666 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-0ad9ec69-4ea9-4c73-aeed-ba5976bc3afb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fa38ff2dae2460ea363f1c3448d533c'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:03.118243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1404/2839] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:07:02 2022] DELETE /identity/v3/users/8fa38ff2dae2460ea363f1c3448d533c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:07:03.335427 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9547d8-8a55-466a-ae07-a5d484b176f7 service swift] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:03.359814 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9547d8-8a55-466a-ae07-a5d484b176f7 service swift] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:03.423474 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3b1c3-93d9-4cdd-b75c-674c460ab0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:03.424359 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3b1c3-93d9-4cdd-b75c-674c460ab0b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:03.424667 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3b1c3-93d9-4cdd-b75c-674c460ab0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:03.424972 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3b1c3-93d9-4cdd-b75c-674c460ab0b2 admin admin] PATH_INFO: `/v3/projects/b1fb452952da4626b8811156dbb1e51b` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:03.426185 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3b1c3-93d9-4cdd-b75c-674c460ab0b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1fb452952da4626b8811156dbb1e51b)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:03.428265 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3b1c3-93d9-4cdd-b75c-674c460ab0b2 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:03.542553 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:03.548323 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-46e3b1c3-93d9-4cdd-b75c-674c460ab0b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1fb452952da4626b8811156dbb1e51b', 'request_id': 'req-46e3b1c3-93d9-4cdd-b75c-674c460ab0b2'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:03.553717 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-46e3b1c3-93d9-4cdd-b75c-674c460ab0b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1fb452952da4626b8811156dbb1e51b', 'request_id': 'req-46e3b1c3-93d9-4cdd-b75c-674c460ab0b2'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:03.634625 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-46e3b1c3-93d9-4cdd-b75c-674c460ab0b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1fb452952da4626b8811156dbb1e51b', 'request_id': 'req-46e3b1c3-93d9-4cdd-b75c-674c460ab0b2'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:03.646909 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-46e3b1c3-93d9-4cdd-b75c-674c460ab0b2 admin admin] The token cache is being invalidate because project b1fb452952da4626b8811156dbb1e51b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:07:03.647202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-46e3b1c3-93d9-4cdd-b75c-674c460ab0b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:03.647826 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-46e3b1c3-93d9-4cdd-b75c-674c460ab0b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:03.650067 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1436/2840] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:07:03 2022] DELETE /identity/v3/projects/b1fb452952da4626b8811156dbb1e51b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:07:03.654190 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9ec69-4ea9-4c73-aeed-ba5976bc3afb admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:03.655702 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-0ad9ec69-4ea9-4c73-aeed-ba5976bc3afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:03.669389 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9ec69-4ea9-4c73-aeed-ba5976bc3afb admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:03.727609 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b42f3d-eb0b-448c-9dcf-879b07a7edf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:03.728486 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b42f3d-eb0b-448c-9dcf-879b07a7edf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:03.728798 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b42f3d-eb0b-448c-9dcf-879b07a7edf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:03.729077 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b42f3d-eb0b-448c-9dcf-879b07a7edf6 admin admin] PATH_INFO: `/v3/users/e0c69d68dc2a46cbb04832174f3e8c40` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:03.730246 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b42f3d-eb0b-448c-9dcf-879b07a7edf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0c69d68dc2a46cbb04832174f3e8c40)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:03.732151 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b42f3d-eb0b-448c-9dcf-879b07a7edf6 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:03.940190 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c3b42f3d-eb0b-448c-9dcf-879b07a7edf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0c69d68dc2a46cbb04832174f3e8c40'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:03.947906 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c3b42f3d-eb0b-448c-9dcf-879b07a7edf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0c69d68dc2a46cbb04832174f3e8c40'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:03.948566 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c3b42f3d-eb0b-448c-9dcf-879b07a7edf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0c69d68dc2a46cbb04832174f3e8c40'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:04.033874 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c3b42f3d-eb0b-448c-9dcf-879b07a7edf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0c69d68dc2a46cbb04832174f3e8c40'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:04.034497 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-c3b42f3d-eb0b-448c-9dcf-879b07a7edf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0c69d68dc2a46cbb04832174f3e8c40'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:04.047876 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:04.053139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1405/2841] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:07:03 2022] DELETE /identity/v3/users/e0c69d68dc2a46cbb04832174f3e8c40 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:07:04.287002 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3b1c3-93d9-4cdd-b75c-674c460ab0b2 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:04.288460 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-46e3b1c3-93d9-4cdd-b75c-674c460ab0b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:04.303481 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3b1c3-93d9-4cdd-b75c-674c460ab0b2 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:04.370119 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b464f73-09e1-4af4-bf28-e29814794c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:04.370993 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b464f73-09e1-4af4-bf28-e29814794c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:04.371282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b464f73-09e1-4af4-bf28-e29814794c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:04.371564 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b464f73-09e1-4af4-bf28-e29814794c99 admin admin] PATH_INFO: `/v3/projects/d64c19a50c094bed875506686479b442` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:04.372785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b464f73-09e1-4af4-bf28-e29814794c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d64c19a50c094bed875506686479b442)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:04.374708 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b464f73-09e1-4af4-bf28-e29814794c99 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:04.477744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-8b464f73-09e1-4af4-bf28-e29814794c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd64c19a50c094bed875506686479b442', 'request_id': 'req-8b464f73-09e1-4af4-bf28-e29814794c99'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:04.483601 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-8b464f73-09e1-4af4-bf28-e29814794c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd64c19a50c094bed875506686479b442', 'request_id': 'req-8b464f73-09e1-4af4-bf28-e29814794c99'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:04.525297 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-8b464f73-09e1-4af4-bf28-e29814794c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd64c19a50c094bed875506686479b442', 'request_id': 'req-8b464f73-09e1-4af4-bf28-e29814794c99'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:04.536966 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-8b464f73-09e1-4af4-bf28-e29814794c99 admin admin] The token cache is being invalidate because project d64c19a50c094bed875506686479b442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:07:04.537191 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-8b464f73-09e1-4af4-bf28-e29814794c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:04.537824 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-8b464f73-09e1-4af4-bf28-e29814794c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:04.539882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1437/2842] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:07:04 2022] DELETE /identity/v3/projects/d64c19a50c094bed875506686479b442 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:07:04.544834 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b6198-0fa9-422d-809c-7e258579deba None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:04.545153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b6198-0fa9-422d-809c-7e258579deba None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:04.545438 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b6198-0fa9-422d-809c-7e258579deba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:04.563592 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-682b6198-0fa9-422d-809c-7e258579deba None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:04.564875 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-682b6198-0fa9-422d-809c-7e258579deba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:04.627279 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1406/2843] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:04.635083 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f461302-d696-4c5f-812d-1d07b130ee30 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:04.635378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f461302-d696-4c5f-812d-1d07b130ee30 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:04.635656 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f461302-d696-4c5f-812d-1d07b130ee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:04.656045 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-6f461302-d696-4c5f-812d-1d07b130ee30 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:04.657309 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-6f461302-d696-4c5f-812d-1d07b130ee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:04.665723 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1438/2844] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:04.669982 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b6198-0fa9-422d-809c-7e258579deba None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:04.680067 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b6198-0fa9-422d-809c-7e258579deba None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:04.684869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e69e6-c106-4b0d-926d-22627ff5ef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:04.685543 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e69e6-c106-4b0d-926d-22627ff5ef39 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:04.685832 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e69e6-c106-4b0d-926d-22627ff5ef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:04.686108 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e69e6-c106-4b0d-926d-22627ff5ef39 admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:04.686857 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e69e6-c106-4b0d-926d-22627ff5ef39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:07:04.687166 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e69e6-c106-4b0d-926d-22627ff5ef39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:04.688797 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e69e6-c106-4b0d-926d-22627ff5ef39 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:04.701546 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1407/2845] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:07:04.705681 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f461302-d696-4c5f-812d-1d07b130ee30 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:04.716043 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f461302-d696-4c5f-812d-1d07b130ee30 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:04.721709 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae2158-0990-4fc3-a909-2cf5d59668cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:04.722593 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae2158-0990-4fc3-a909-2cf5d59668cd admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:04.722881 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae2158-0990-4fc3-a909-2cf5d59668cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:04.723415 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae2158-0990-4fc3-a909-2cf5d59668cd admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:04.724146 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae2158-0990-4fc3-a909-2cf5d59668cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:04.726751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae2158-0990-4fc3-a909-2cf5d59668cd admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:04.801784 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1439/2846] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:07:04 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:07:04.806196 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e69e6-c106-4b0d-926d-22627ff5ef39 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:04.816828 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e69e6-c106-4b0d-926d-22627ff5ef39 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:04.875035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef73ef0-e9ca-4134-ac14-2a4c0ac9ec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:04.875711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef73ef0-e9ca-4134-ac14-2a4c0ac9ec85 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:04.875998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef73ef0-e9ca-4134-ac14-2a4c0ac9ec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:04.876277 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef73ef0-e9ca-4134-ac14-2a4c0ac9ec85 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:04.876998 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef73ef0-e9ca-4134-ac14-2a4c0ac9ec85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:04.878919 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef73ef0-e9ca-4134-ac14-2a4c0ac9ec85 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:04.948134 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1408/2847] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:07:04 2022] POST /identity/v3/users => generated 286 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:07:04.949428 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae2158-0990-4fc3-a909-2cf5d59668cd admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:04.959770 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae2158-0990-4fc3-a909-2cf5d59668cd admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:04.965198 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a353c6-f352-4afd-8fa7-87f9e2761abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:04.965940 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a353c6-f352-4afd-8fa7-87f9e2761abc admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:04.966272 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a353c6-f352-4afd-8fa7-87f9e2761abc admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:04.966579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a353c6-f352-4afd-8fa7-87f9e2761abc admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:04.967304 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a353c6-f352-4afd-8fa7-87f9e2761abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:04.968920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a353c6-f352-4afd-8fa7-87f9e2761abc admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:04.980260 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1440/2848] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:07:04.985389 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef73ef0-e9ca-4134-ac14-2a4c0ac9ec85 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:04.996597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef73ef0-e9ca-4134-ac14-2a4c0ac9ec85 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:05.001524 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188214e-a972-481b-b6a3-a7ae87d15d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:05.002274 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188214e-a972-481b-b6a3-a7ae87d15d10 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:05.002563 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188214e-a972-481b-b6a3-a7ae87d15d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:05.002869 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188214e-a972-481b-b6a3-a7ae87d15d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:05.003630 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188214e-a972-481b-b6a3-a7ae87d15d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:05.005296 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188214e-a972-481b-b6a3-a7ae87d15d10 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:05.017350 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1409/2849] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:07:05.021327 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a353c6-f352-4afd-8fa7-87f9e2761abc admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:05.032338 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a353c6-f352-4afd-8fa7-87f9e2761abc admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:05.037225 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c817c-63cd-41eb-ab21-772e696dd78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:05.038180 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c817c-63cd-41eb-ab21-772e696dd78b admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:05.038464 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c817c-63cd-41eb-ab21-772e696dd78b admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:05.038769 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c817c-63cd-41eb-ab21-772e696dd78b admin admin] PATH_INFO: `/v3/projects/b2545f270d1f469fb2877225737a2a09/users/a3a3d010c4804a8daff248c28ee9960e/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:05.057492 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c817c-63cd-41eb-ab21-772e696dd78b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2545f270d1f469fb2877225737a2a09, user_id=a3a3d010c4804a8daff248c28ee9960e, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:05.057492 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c817c-63cd-41eb-ab21-772e696dd78b admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:05.060210 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:05.166751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1441/2850] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:07:05 2022] PUT /identity/v3/projects/b2545f270d1f469fb2877225737a2a09/users/a3a3d010c4804a8daff248c28ee9960e/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:07:05.172377 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871e2af-ac36-4e2e-afa4-3402216945ad None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:05.172701 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871e2af-ac36-4e2e-afa4-3402216945ad None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:05.173014 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871e2af-ac36-4e2e-afa4-3402216945ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:05.191222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-e871e2af-ac36-4e2e-afa4-3402216945ad None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:05.192504 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-e871e2af-ac36-4e2e-afa4-3402216945ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:05.255986 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1410/2851] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:05.266737 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c817c-63cd-41eb-ab21-772e696dd78b admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:05.268543 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-fa6c817c-63cd-41eb-ab21-772e696dd78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:05.330625 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c817c-63cd-41eb-ab21-772e696dd78b admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:05.334230 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea436866-5d3a-4ef9-a9de-fd0882ae2476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:05.334912 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea436866-5d3a-4ef9-a9de-fd0882ae2476 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:05.335202 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea436866-5d3a-4ef9-a9de-fd0882ae2476 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:05.335482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea436866-5d3a-4ef9-a9de-fd0882ae2476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:05.345915 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea436866-5d3a-4ef9-a9de-fd0882ae2476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:05.347358 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea436866-5d3a-4ef9-a9de-fd0882ae2476 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:05.357369 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1442/2852] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:07:10.675522 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181d93e-d4b1-4d5c-a63d-2d6479e97e49 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:10.675997 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181d93e-d4b1-4d5c-a63d-2d6479e97e49 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:10.676271 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181d93e-d4b1-4d5c-a63d-2d6479e97e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:10.683539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:10.706597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-a181d93e-d4b1-4d5c-a63d-2d6479e97e49 None None] MFA Rules not processed for user `a3a3d010c4804a8daff248c28ee9960e`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:10.707878 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a181d93e-d4b1-4d5c-a63d-2d6479e97e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:10.786420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1411/2853] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:07:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:10.792278 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea436866-5d3a-4ef9-a9de-fd0882ae2476 service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:10.801928 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea436866-5d3a-4ef9-a9de-fd0882ae2476 service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:10.806602 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd02a98-149a-44d9-9056-f145d14c3cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:10.807250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd02a98-149a-44d9-9056-f145d14c3cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:10.807539 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd02a98-149a-44d9-9056-f145d14c3cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:10.807821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd02a98-149a-44d9-9056-f145d14c3cc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:10.808520 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd02a98-149a-44d9-9056-f145d14c3cc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:10.810486 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd02a98-149a-44d9-9056-f145d14c3cc0 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:11.058280 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1443/2854] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:07:10 2022] POST /identity/v3/projects => generated 371 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:07:11.062347 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181d93e-d4b1-4d5c-a63d-2d6479e97e49 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:11.073738 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181d93e-d4b1-4d5c-a63d-2d6479e97e49 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:11.129778 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99da92-fb3b-43a4-911a-2b2fabd55359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:11.130432 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99da92-fb3b-43a4-911a-2b2fabd55359 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:11.130717 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99da92-fb3b-43a4-911a-2b2fabd55359 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:11.130994 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99da92-fb3b-43a4-911a-2b2fabd55359 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:11.131687 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99da92-fb3b-43a4-911a-2b2fabd55359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:11.134243 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99da92-fb3b-43a4-911a-2b2fabd55359 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:11.212200 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1412/2855] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:07:11 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:07:11.216282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd02a98-149a-44d9-9056-f145d14c3cc0 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:11.227468 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd02a98-149a-44d9-9056-f145d14c3cc0 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:11.231973 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19073a-5813-47e3-90f1-c965d94de9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:11.232744 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19073a-5813-47e3-90f1-c965d94de9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:11.239551 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19073a-5813-47e3-90f1-c965d94de9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:11.239551 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19073a-5813-47e3-90f1-c965d94de9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:11.239551 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19073a-5813-47e3-90f1-c965d94de9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:11.239551 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19073a-5813-47e3-90f1-c965d94de9c1 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:11.246315 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1444/2856] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:07:11.250776 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99da92-fb3b-43a4-911a-2b2fabd55359 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:11.262341 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99da92-fb3b-43a4-911a-2b2fabd55359 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:11.267052 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73741150-e88e-4da1-91ec-f53d36494c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:11.267951 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73741150-e88e-4da1-91ec-f53d36494c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:11.268246 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73741150-e88e-4da1-91ec-f53d36494c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:11.268525 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73741150-e88e-4da1-91ec-f53d36494c68 admin admin] PATH_INFO: `/v3/projects/8f8580a25be6410299bafd48ed8cce12/users/9b6141155bd64b8aa306f0146c345951/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:11.285276 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73741150-e88e-4da1-91ec-f53d36494c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8580a25be6410299bafd48ed8cce12, user_id=9b6141155bd64b8aa306f0146c345951, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:11.287928 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73741150-e88e-4da1-91ec-f53d36494c68 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:11.354346 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1413/2857] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:07:11 2022] PUT /identity/v3/projects/8f8580a25be6410299bafd48ed8cce12/users/9b6141155bd64b8aa306f0146c345951/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:07:11.358381 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19073a-5813-47e3-90f1-c965d94de9c1 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:11.369395 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19073a-5813-47e3-90f1-c965d94de9c1 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:11.428392 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697ceb9-7a5a-45d3-b28e-1714ac936dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:11.429100 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697ceb9-7a5a-45d3-b28e-1714ac936dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:11.429390 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697ceb9-7a5a-45d3-b28e-1714ac936dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:11.429747 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697ceb9-7a5a-45d3-b28e-1714ac936dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:11.431234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697ceb9-7a5a-45d3-b28e-1714ac936dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:11.432918 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697ceb9-7a5a-45d3-b28e-1714ac936dc6 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:11.442650 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1445/2858] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:07:11.449006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73741150-e88e-4da1-91ec-f53d36494c68 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:11.459130 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73741150-e88e-4da1-91ec-f53d36494c68 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:11.464213 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43a952-0d89-4708-8a13-c1f2fd0bd804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:11.465149 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a952-0d89-4708-8a13-c1f2fd0bd804 admin admin] REQUEST_METHOD: `PUT` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:11.465433 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a952-0d89-4708-8a13-c1f2fd0bd804 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:11.465711 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a952-0d89-4708-8a13-c1f2fd0bd804 admin admin] PATH_INFO: `/v3/projects/8f8580a25be6410299bafd48ed8cce12/users/9b6141155bd64b8aa306f0146c345951/roles/6fc3d1eef0284133bc43fb1e63e842ff` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:11.467675 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43a952-0d89-4708-8a13-c1f2fd0bd804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8580a25be6410299bafd48ed8cce12, user_id=9b6141155bd64b8aa306f0146c345951, role_id=6fc3d1eef0284133bc43fb1e63e842ff)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:11.470496 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43a952-0d89-4708-8a13-c1f2fd0bd804 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:11.482329 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1414/2859] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:07:11 2022] PUT /identity/v3/projects/8f8580a25be6410299bafd48ed8cce12/users/9b6141155bd64b8aa306f0146c345951/roles/6fc3d1eef0284133bc43fb1e63e842ff => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:07:16.816199 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48631f89-1c68-4757-a0da-3f3f15d6c686 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:16.816805 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48631f89-1c68-4757-a0da-3f3f15d6c686 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:16.816910 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48631f89-1c68-4757-a0da-3f3f15d6c686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:16.848348 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-48631f89-1c68-4757-a0da-3f3f15d6c686 None None] MFA Rules not processed for user `9b6141155bd64b8aa306f0146c345951`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:16.849527 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-48631f89-1c68-4757-a0da-3f3f15d6c686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:16.907846 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:16.927178 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1446/2860] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:07:16 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:16.947883 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43a952-0d89-4708-8a13-c1f2fd0bd804 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:16.949860 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-db43a952-0d89-4708-8a13-c1f2fd0bd804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:17.012060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:17.040153 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43a952-0d89-4708-8a13-c1f2fd0bd804 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:17.046674 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f666c-df49-47c0-93d9-a08807f7c82c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:17.047424 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f666c-df49-47c0-93d9-a08807f7c82c service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:17.047720 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f666c-df49-47c0-93d9-a08807f7c82c service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:17.048005 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f666c-df49-47c0-93d9-a08807f7c82c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:17.111135 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f666c-df49-47c0-93d9-a08807f7c82c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:17.112782 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f666c-df49-47c0-93d9-a08807f7c82c service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:17.123559 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1415/2861] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:07:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:07:18.947629 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48631f89-1c68-4757-a0da-3f3f15d6c686 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:18.949263 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-48631f89-1c68-4757-a0da-3f3f15d6c686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:19.022584 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48631f89-1c68-4757-a0da-3f3f15d6c686 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:19.028208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09545a6-c829-4772-88cf-040f324a0131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:19.029364 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09545a6-c829-4772-88cf-040f324a0131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:19.030845 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09545a6-c829-4772-88cf-040f324a0131 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:19.031142 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09545a6-c829-4772-88cf-040f324a0131 admin admin] PATH_INFO: `/v3/users/014cb80b55764a03a0aaed4a93a71286` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:19.032628 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09545a6-c829-4772-88cf-040f324a0131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=014cb80b55764a03a0aaed4a93a71286)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:19.035104 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09545a6-c829-4772-88cf-040f324a0131 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:19.206495 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a09545a6-c829-4772-88cf-040f324a0131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '014cb80b55764a03a0aaed4a93a71286'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:19.231821 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a09545a6-c829-4772-88cf-040f324a0131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '014cb80b55764a03a0aaed4a93a71286'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:19.302140 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a09545a6-c829-4772-88cf-040f324a0131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '014cb80b55764a03a0aaed4a93a71286'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:19.302995 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a09545a6-c829-4772-88cf-040f324a0131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '014cb80b55764a03a0aaed4a93a71286'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:19.303713 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-a09545a6-c829-4772-88cf-040f324a0131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '014cb80b55764a03a0aaed4a93a71286'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:19.323506 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1447/2862] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:07:18 2022] DELETE /identity/v3/users/014cb80b55764a03a0aaed4a93a71286 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:07:19.327920 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bddf4e-7db4-4dca-98c3-bcb1797fd6cd None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:19.328420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bddf4e-7db4-4dca-98c3-bcb1797fd6cd None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:19.328542 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bddf4e-7db4-4dca-98c3-bcb1797fd6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:19.354487 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-26bddf4e-7db4-4dca-98c3-bcb1797fd6cd None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:19.355750 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-26bddf4e-7db4-4dca-98c3-bcb1797fd6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:19.423379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1416/2863] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:19.433608 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09545a6-c829-4772-88cf-040f324a0131 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:19.435108 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-a09545a6-c829-4772-88cf-040f324a0131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:19.503921 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09545a6-c829-4772-88cf-040f324a0131 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:19.508530 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc3de7-8e7d-466e-b7f4-69792f2c2a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:19.509314 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc3de7-8e7d-466e-b7f4-69792f2c2a78 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:19.509887 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc3de7-8e7d-466e-b7f4-69792f2c2a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:19.510250 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc3de7-8e7d-466e-b7f4-69792f2c2a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:19.520935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc3de7-8e7d-466e-b7f4-69792f2c2a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:19.522452 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc3de7-8e7d-466e-b7f4-69792f2c2a78 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:19.533524 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1448/2864] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:07:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:07:19.749948 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce37ff-02b7-4cc5-a753-a9d2d2535df9 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:19.750234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce37ff-02b7-4cc5-a753-a9d2d2535df9 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:19.753870 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce37ff-02b7-4cc5-a753-a9d2d2535df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:19.785737 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-86ce37ff-02b7-4cc5-a753-a9d2d2535df9 None None] MFA Rules not processed for user `a3a3d010c4804a8daff248c28ee9960e`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:19.787285 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-86ce37ff-02b7-4cc5-a753-a9d2d2535df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:19.880688 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1417/2865] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:07:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:20.018254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc3de7-8e7d-466e-b7f4-69792f2c2a78 service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:20.018254 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-46dc3de7-8e7d-466e-b7f4-69792f2c2a78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:20.053179 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc3de7-8e7d-466e-b7f4-69792f2c2a78 service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:20.059675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa98cbe-1d39-4fc0-b14d-d88688c5d071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:20.060553 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa98cbe-1d39-4fc0-b14d-d88688c5d071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:20.061573 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa98cbe-1d39-4fc0-b14d-d88688c5d071 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:20.061573 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa98cbe-1d39-4fc0-b14d-d88688c5d071 admin admin] PATH_INFO: `/v3/projects/f206898db6564d308bc33f6210448191` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:20.062935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa98cbe-1d39-4fc0-b14d-d88688c5d071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f206898db6564d308bc33f6210448191)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:20.065124 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa98cbe-1d39-4fc0-b14d-d88688c5d071 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:20.067951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:20.199716 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-afa98cbe-1d39-4fc0-b14d-d88688c5d071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f206898db6564d308bc33f6210448191', 'request_id': 'req-afa98cbe-1d39-4fc0-b14d-d88688c5d071'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:20.206518 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-afa98cbe-1d39-4fc0-b14d-d88688c5d071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f206898db6564d308bc33f6210448191', 'request_id': 'req-afa98cbe-1d39-4fc0-b14d-d88688c5d071'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:20.275005 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-afa98cbe-1d39-4fc0-b14d-d88688c5d071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f206898db6564d308bc33f6210448191', 'request_id': 'req-afa98cbe-1d39-4fc0-b14d-d88688c5d071'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:20.287883 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-afa98cbe-1d39-4fc0-b14d-d88688c5d071 admin admin] The token cache is being invalidate because project f206898db6564d308bc33f6210448191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:07:20.288350 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-afa98cbe-1d39-4fc0-b14d-d88688c5d071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:20.289158 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-afa98cbe-1d39-4fc0-b14d-d88688c5d071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:20.291340 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1449/2866] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:07:20 2022] DELETE /identity/v3/projects/f206898db6564d308bc33f6210448191 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:07:20.296460 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2591f7-197e-45f1-b2ab-79f157f36ef3 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:20.300043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2591f7-197e-45f1-b2ab-79f157f36ef3 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:20.300043 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2591f7-197e-45f1-b2ab-79f157f36ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:20.319516 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-2b2591f7-197e-45f1-b2ab-79f157f36ef3 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:20.321842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-2b2591f7-197e-45f1-b2ab-79f157f36ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:20.359184 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=100 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:20.399053 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1418/2867] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:20.407066 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f2fb6-df26-4d67-9eb0-6ded20c3b0a7 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:20.407424 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f2fb6-df26-4d67-9eb0-6ded20c3b0a7 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:20.407639 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f2fb6-df26-4d67-9eb0-6ded20c3b0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:20.449827 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-806f2fb6-df26-4d67-9eb0-6ded20c3b0a7 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:20.451212 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-806f2fb6-df26-4d67-9eb0-6ded20c3b0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:20.459706 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1450/2868] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:20.465475 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2591f7-197e-45f1-b2ab-79f157f36ef3 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:20.477358 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2591f7-197e-45f1-b2ab-79f157f36ef3 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:20.483273 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09750607-aa6c-4c13-b28c-54078aac8ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:20.484934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09750607-aa6c-4c13-b28c-54078aac8ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:20.484934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09750607-aa6c-4c13-b28c-54078aac8ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:20.485379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09750607-aa6c-4c13-b28c-54078aac8ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:20.486211 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09750607-aa6c-4c13-b28c-54078aac8ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:07:20.486603 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09750607-aa6c-4c13-b28c-54078aac8ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:20.488557 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09750607-aa6c-4c13-b28c-54078aac8ee4 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:20.509739 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1419/2869] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:07:20.509951 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f2fb6-df26-4d67-9eb0-6ded20c3b0a7 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:20.527214 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f2fb6-df26-4d67-9eb0-6ded20c3b0a7 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:20.534387 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c533e1a-7ba7-4226-8c2f-cc07f394a556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:20.535420 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c533e1a-7ba7-4226-8c2f-cc07f394a556 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:20.535713 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c533e1a-7ba7-4226-8c2f-cc07f394a556 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:20.536145 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c533e1a-7ba7-4226-8c2f-cc07f394a556 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:20.536950 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c533e1a-7ba7-4226-8c2f-cc07f394a556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:20.542425 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c533e1a-7ba7-4226-8c2f-cc07f394a556 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:20.647048 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1451/2870] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:07:20 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:07:20.651312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09750607-aa6c-4c13-b28c-54078aac8ee4 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:20.662181 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09750607-aa6c-4c13-b28c-54078aac8ee4 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:20.724856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6ed95-3281-4132-bb10-1417ce0b70ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:20.725501 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6ed95-3281-4132-bb10-1417ce0b70ee admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:20.725658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6ed95-3281-4132-bb10-1417ce0b70ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:20.726114 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6ed95-3281-4132-bb10-1417ce0b70ee admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:20.727489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6ed95-3281-4132-bb10-1417ce0b70ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:20.729661 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6ed95-3281-4132-bb10-1417ce0b70ee admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:20.800222 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1420/2871] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:07:20 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:07:20.804393 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c533e1a-7ba7-4226-8c2f-cc07f394a556 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:20.817404 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c533e1a-7ba7-4226-8c2f-cc07f394a556 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:20.822965 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184d8e5-078a-47e7-9d67-588f5f2f2c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:20.824713 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184d8e5-078a-47e7-9d67-588f5f2f2c73 admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:20.824713 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184d8e5-078a-47e7-9d67-588f5f2f2c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:20.824713 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184d8e5-078a-47e7-9d67-588f5f2f2c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:20.825029 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184d8e5-078a-47e7-9d67-588f5f2f2c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:20.826560 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184d8e5-078a-47e7-9d67-588f5f2f2c73 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:20.838115 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1452/2872] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:07:20.842007 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6ed95-3281-4132-bb10-1417ce0b70ee admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:20.852763 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6ed95-3281-4132-bb10-1417ce0b70ee admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:20.857463 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dada6e-855d-4ebc-b9e4-6f095e5131f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:20.858342 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dada6e-855d-4ebc-b9e4-6f095e5131f6 admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:20.858628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dada6e-855d-4ebc-b9e4-6f095e5131f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:20.858906 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dada6e-855d-4ebc-b9e4-6f095e5131f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:20.859639 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dada6e-855d-4ebc-b9e4-6f095e5131f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:20.861263 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dada6e-855d-4ebc-b9e4-6f095e5131f6 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:20.872483 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1421/2873] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:07:20.876704 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184d8e5-078a-47e7-9d67-588f5f2f2c73 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:20.887280 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184d8e5-078a-47e7-9d67-588f5f2f2c73 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:20.892530 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212462b3-c28f-4961-9364-553daa0b2d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:20.893340 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212462b3-c28f-4961-9364-553daa0b2d5c admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:20.893631 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212462b3-c28f-4961-9364-553daa0b2d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:20.893901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212462b3-c28f-4961-9364-553daa0b2d5c admin admin] PATH_INFO: `/v3/projects/4887cb93b91149af82d00820d0414f46/users/a853fa0351f44c35b874d2e3a9483c95/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:20.909889 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212462b3-c28f-4961-9364-553daa0b2d5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4887cb93b91149af82d00820d0414f46, user_id=a853fa0351f44c35b874d2e3a9483c95, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:20.912797 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212462b3-c28f-4961-9364-553daa0b2d5c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:21.022739 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1453/2874] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:07:20 2022] PUT /identity/v3/projects/4887cb93b91149af82d00820d0414f46/users/a853fa0351f44c35b874d2e3a9483c95/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:07:21.034132 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5938ea9-3bef-4084-8a8d-0c04e3a843c5 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:21.034422 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5938ea9-3bef-4084-8a8d-0c04e3a843c5 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:21.034704 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5938ea9-3bef-4084-8a8d-0c04e3a843c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:21.062947 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-d5938ea9-3bef-4084-8a8d-0c04e3a843c5 None None] MFA Rules not processed for user `a853fa0351f44c35b874d2e3a9483c95`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:21.064157 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-d5938ea9-3bef-4084-8a8d-0c04e3a843c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:21.129925 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1422/2875] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:07:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:21.142246 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212462b3-c28f-4961-9364-553daa0b2d5c admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:21.144301 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-212462b3-c28f-4961-9364-553daa0b2d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:21.205146 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212462b3-c28f-4961-9364-553daa0b2d5c admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:21.208964 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6eb91-9344-41af-9888-e74d62ad634d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:21.209585 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6eb91-9344-41af-9888-e74d62ad634d service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:21.209868 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6eb91-9344-41af-9888-e74d62ad634d service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:21.210144 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6eb91-9344-41af-9888-e74d62ad634d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:21.221375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6eb91-9344-41af-9888-e74d62ad634d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:21.223070 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6eb91-9344-41af-9888-e74d62ad634d service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:21.233245 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1454/2876] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:07:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:07:21.263449 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5938ea9-3bef-4084-8a8d-0c04e3a843c5 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:21.293461 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:21.329406 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5938ea9-3bef-4084-8a8d-0c04e3a843c5 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:21.333926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2001ba-55c2-4dd7-8898-107d0502d3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:21.334891 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2001ba-55c2-4dd7-8898-107d0502d3ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:21.335384 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2001ba-55c2-4dd7-8898-107d0502d3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:21.335830 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2001ba-55c2-4dd7-8898-107d0502d3ce admin admin] PATH_INFO: `/v3/users/a853fa0351f44c35b874d2e3a9483c95` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:21.338099 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2001ba-55c2-4dd7-8898-107d0502d3ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=a853fa0351f44c35b874d2e3a9483c95)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:21.340013 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2001ba-55c2-4dd7-8898-107d0502d3ce admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:21.533531 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-1d2001ba-55c2-4dd7-8898-107d0502d3ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a853fa0351f44c35b874d2e3a9483c95'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:21.540335 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-1d2001ba-55c2-4dd7-8898-107d0502d3ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a853fa0351f44c35b874d2e3a9483c95'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:21.541048 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-1d2001ba-55c2-4dd7-8898-107d0502d3ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a853fa0351f44c35b874d2e3a9483c95'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:21.620267 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-1d2001ba-55c2-4dd7-8898-107d0502d3ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a853fa0351f44c35b874d2e3a9483c95'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:21.621006 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-1d2001ba-55c2-4dd7-8898-107d0502d3ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a853fa0351f44c35b874d2e3a9483c95'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:21.639929 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1423/2877] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:07:21 2022] DELETE /identity/v3/users/a853fa0351f44c35b874d2e3a9483c95 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:07:21.644785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cbe5b-d196-4c7b-be65-bb8cd10d498b None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:21.645120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cbe5b-d196-4c7b-be65-bb8cd10d498b None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:21.645408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cbe5b-d196-4c7b-be65-bb8cd10d498b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:21.663370 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-091cbe5b-d196-4c7b-be65-bb8cd10d498b None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:21.664614 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-091cbe5b-d196-4c7b-be65-bb8cd10d498b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:21.691936 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:21.726815 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1455/2878] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:21.736833 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2001ba-55c2-4dd7-8898-107d0502d3ce admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:21.738445 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-1d2001ba-55c2-4dd7-8898-107d0502d3ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:21.804913 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2001ba-55c2-4dd7-8898-107d0502d3ce admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:21.811218 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa9042-be99-4bf4-8e35-e1cb3cbcfd3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:21.812025 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa9042-be99-4bf4-8e35-e1cb3cbcfd3f service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:21.812312 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa9042-be99-4bf4-8e35-e1cb3cbcfd3f service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:21.812593 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa9042-be99-4bf4-8e35-e1cb3cbcfd3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:21.826981 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa9042-be99-4bf4-8e35-e1cb3cbcfd3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:21.828532 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa9042-be99-4bf4-8e35-e1cb3cbcfd3f service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:21.838759 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1424/2879] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:07:22.271092 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cbe5b-d196-4c7b-be65-bb8cd10d498b None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:22.273336 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-091cbe5b-d196-4c7b-be65-bb8cd10d498b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:22.286765 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cbe5b-d196-4c7b-be65-bb8cd10d498b None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:22.293516 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0335c-75d3-48c9-9d5e-6d3fed080f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:22.294804 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0335c-75d3-48c9-9d5e-6d3fed080f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:22.295091 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0335c-75d3-48c9-9d5e-6d3fed080f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:22.295371 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0335c-75d3-48c9-9d5e-6d3fed080f2d admin admin] PATH_INFO: `/v3/projects/4887cb93b91149af82d00820d0414f46` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:22.296576 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0335c-75d3-48c9-9d5e-6d3fed080f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4887cb93b91149af82d00820d0414f46)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:22.298546 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0335c-75d3-48c9-9d5e-6d3fed080f2d admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:22.391181 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c6b0335c-75d3-48c9-9d5e-6d3fed080f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4887cb93b91149af82d00820d0414f46', 'request_id': 'req-c6b0335c-75d3-48c9-9d5e-6d3fed080f2d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:22.397080 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c6b0335c-75d3-48c9-9d5e-6d3fed080f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4887cb93b91149af82d00820d0414f46', 'request_id': 'req-c6b0335c-75d3-48c9-9d5e-6d3fed080f2d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:22.490409 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c6b0335c-75d3-48c9-9d5e-6d3fed080f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4887cb93b91149af82d00820d0414f46', 'request_id': 'req-c6b0335c-75d3-48c9-9d5e-6d3fed080f2d'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:22.503617 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c6b0335c-75d3-48c9-9d5e-6d3fed080f2d admin admin] The token cache is being invalidate because project 4887cb93b91149af82d00820d0414f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:07:22.504023 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c6b0335c-75d3-48c9-9d5e-6d3fed080f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:22.504618 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-c6b0335c-75d3-48c9-9d5e-6d3fed080f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:22.506298 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1456/2880] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:07:22 2022] DELETE /identity/v3/projects/4887cb93b91149af82d00820d0414f46 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:07:22.512021 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2c04b-0a70-4863-8139-69c4688eb6d7 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:22.512318 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2c04b-0a70-4863-8139-69c4688eb6d7 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:22.512594 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2c04b-0a70-4863-8139-69c4688eb6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:22.531205 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-d0b2c04b-0a70-4863-8139-69c4688eb6d7 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:22.532430 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-d0b2c04b-0a70-4863-8139-69c4688eb6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:22.574476 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:22.592166 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1425/2881] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:22.600169 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6d2fa-371f-463c-85d9-f0c7df3ff8cc None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:22.600463 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6d2fa-371f-463c-85d9-f0c7df3ff8cc None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:22.600794 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6d2fa-371f-463c-85d9-f0c7df3ff8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:22.620218 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-94d6d2fa-371f-463c-85d9-f0c7df3ff8cc None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:22.621593 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-94d6d2fa-371f-463c-85d9-f0c7df3ff8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:22.629760 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1457/2882] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:22.635191 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2c04b-0a70-4863-8139-69c4688eb6d7 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:22.646495 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2c04b-0a70-4863-8139-69c4688eb6d7 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:22.651656 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e273193-357b-4fdc-9cb4-e469cb7799ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:22.652327 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e273193-357b-4fdc-9cb4-e469cb7799ff admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:22.652615 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e273193-357b-4fdc-9cb4-e469cb7799ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:22.653282 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e273193-357b-4fdc-9cb4-e469cb7799ff admin admin] PATH_INFO: `/v3/domains` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:22.654152 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e273193-357b-4fdc-9cb4-e469cb7799ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92004) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:07:22.654468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e273193-357b-4fdc-9cb4-e469cb7799ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:22.656095 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e273193-357b-4fdc-9cb4-e469cb7799ff admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:22.669639 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1426/2883] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 23 11:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:07:22.674166 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6d2fa-371f-463c-85d9-f0c7df3ff8cc None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:22.684480 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6d2fa-371f-463c-85d9-f0c7df3ff8cc None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:22.689333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a16614-cce6-4ed9-8317-67976eb2c341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:22.690030 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a16614-cce6-4ed9-8317-67976eb2c341 admin admin] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:22.690316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a16614-cce6-4ed9-8317-67976eb2c341 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:22.690597 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a16614-cce6-4ed9-8317-67976eb2c341 admin admin] PATH_INFO: `/v3/projects` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:22.691294 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a16614-cce6-4ed9-8317-67976eb2c341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:22.693257 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a16614-cce6-4ed9-8317-67976eb2c341 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:22.807293 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1458/2884] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 23 11:07:22 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:07:22.811856 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e273193-357b-4fdc-9cb4-e469cb7799ff admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:22.823100 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e273193-357b-4fdc-9cb4-e469cb7799ff admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:22.892595 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e625d9c-fd19-4de5-ad3f-bf1a78cc0696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:22.893305 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e625d9c-fd19-4de5-ad3f-bf1a78cc0696 admin admin] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:22.893593 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e625d9c-fd19-4de5-ad3f-bf1a78cc0696 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:22.893873 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e625d9c-fd19-4de5-ad3f-bf1a78cc0696 admin admin] PATH_INFO: `/v3/users` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:22.894573 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e625d9c-fd19-4de5-ad3f-bf1a78cc0696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:22.896667 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e625d9c-fd19-4de5-ad3f-bf1a78cc0696 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:22.974410 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1427/2885] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 23 11:07:22 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:07:22.975900 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a16614-cce6-4ed9-8317-67976eb2c341 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:22.987303 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a16614-cce6-4ed9-8317-67976eb2c341 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:22.992022 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1957fa-7a3a-4a49-8490-ae4e29a0082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:22.993333 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1957fa-7a3a-4a49-8490-ae4e29a0082a admin admin] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:22.993668 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1957fa-7a3a-4a49-8490-ae4e29a0082a admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:22.993947 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1957fa-7a3a-4a49-8490-ae4e29a0082a admin admin] PATH_INFO: `/v3/roles` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:22.994676 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1957fa-7a3a-4a49-8490-ae4e29a0082a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:22.996271 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1957fa-7a3a-4a49-8490-ae4e29a0082a admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:23.007583 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1459/2886] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:07:23.012111 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e625d9c-fd19-4de5-ad3f-bf1a78cc0696 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:23.022405 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e625d9c-fd19-4de5-ad3f-bf1a78cc0696 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:23.028092 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367fa39-8aa1-4e90-a967-60f9cc356dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:23.028902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367fa39-8aa1-4e90-a967-60f9cc356dbf admin admin] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:23.029187 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367fa39-8aa1-4e90-a967-60f9cc356dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:23.029463 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367fa39-8aa1-4e90-a967-60f9cc356dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:23.030193 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367fa39-8aa1-4e90-a967-60f9cc356dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:23.031818 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367fa39-8aa1-4e90-a967-60f9cc356dbf admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:23.042438 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1428/2887] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 23 11:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:07:23.046710 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1957fa-7a3a-4a49-8490-ae4e29a0082a admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:23.057456 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1957fa-7a3a-4a49-8490-ae4e29a0082a admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:23.062039 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54eeeb-5ffb-414c-bf6f-23de2fb8db8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:23.062920 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54eeeb-5ffb-414c-bf6f-23de2fb8db8c admin admin] REQUEST_METHOD: `PUT` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:23.063201 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54eeeb-5ffb-414c-bf6f-23de2fb8db8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:23.063476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54eeeb-5ffb-414c-bf6f-23de2fb8db8c admin admin] PATH_INFO: `/v3/projects/40fc5dd7a2264d9c9e0e8d92f15f085d/users/f7c0e353fa6543dbb1dd47ae6ab012c8/roles/14edb03a6a644798bdbf762bb59f6ef9` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:23.079623 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54eeeb-5ffb-414c-bf6f-23de2fb8db8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=40fc5dd7a2264d9c9e0e8d92f15f085d, user_id=f7c0e353fa6543dbb1dd47ae6ab012c8, role_id=14edb03a6a644798bdbf762bb59f6ef9)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:23.082316 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54eeeb-5ffb-414c-bf6f-23de2fb8db8c admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:23.183716 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1460/2888] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 23 11:07:23 2022] PUT /identity/v3/projects/40fc5dd7a2264d9c9e0e8d92f15f085d/users/f7c0e353fa6543dbb1dd47ae6ab012c8/roles/14edb03a6a644798bdbf762bb59f6ef9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:07:23.194835 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fea65-3124-421f-9a90-57b29f2e5537 None None] REQUEST_METHOD: `POST` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:23.195128 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fea65-3124-421f-9a90-57b29f2e5537 None None] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:23.195410 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fea65-3124-421f-9a90-57b29f2e5537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:23.224923 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.auth.core [None req-f49fea65-3124-421f-9a90-57b29f2e5537 None None] MFA Rules not processed for user `f7c0e353fa6543dbb1dd47ae6ab012c8`. Rule list: `[]` (Enabled: `True`). {{(pid=92004) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:23.226200 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-f49fea65-3124-421f-9a90-57b29f2e5537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:23.296608 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1429/2889] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:07:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:23.307891 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54eeeb-5ffb-414c-bf6f-23de2fb8db8c admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:23.309682 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-3f54eeeb-5ffb-414c-bf6f-23de2fb8db8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:23.368732 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54eeeb-5ffb-414c-bf6f-23de2fb8db8c admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:23.372421 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fb8c6-cfda-4891-8a5a-1e6f1443dec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd804e11eb85e4050adaecfbaaa6e5a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:23.373120 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fb8c6-cfda-4891-8a5a-1e6f1443dec0 service cinder] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:23.373408 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fb8c6-cfda-4891-8a5a-1e6f1443dec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:23.373687 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fb8c6-cfda-4891-8a5a-1e6f1443dec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:23.379157 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:23.382882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78fb8c6-cfda-4891-8a5a-1e6f1443dec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:23.384998 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78fb8c6-cfda-4891-8a5a-1e6f1443dec0 service cinder] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:23.393963 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1461/2890] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:07:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:07:33.293634 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:33.479234 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=3 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:34.448842 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fea65-3124-421f-9a90-57b29f2e5537 None None] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:34.511858 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fea65-3124-421f-9a90-57b29f2e5537 None None] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:34.516540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ae7e1-d626-4d69-b3fb-28b8bb4c727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:34.517468 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ae7e1-d626-4d69-b3fb-28b8bb4c727e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:34.517756 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ae7e1-d626-4d69-b3fb-28b8bb4c727e admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:34.518033 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ae7e1-d626-4d69-b3fb-28b8bb4c727e admin admin] PATH_INFO: `/v3/users/f7c0e353fa6543dbb1dd47ae6ab012c8` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:34.519250 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ae7e1-d626-4d69-b3fb-28b8bb4c727e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c0e353fa6543dbb1dd47ae6ab012c8)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:34.521205 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ae7e1-d626-4d69-b3fb-28b8bb4c727e admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:34.688400 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-db7ae7e1-d626-4d69-b3fb-28b8bb4c727e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c0e353fa6543dbb1dd47ae6ab012c8'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:34.696086 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-db7ae7e1-d626-4d69-b3fb-28b8bb4c727e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c0e353fa6543dbb1dd47ae6ab012c8'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:34.696886 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-db7ae7e1-d626-4d69-b3fb-28b8bb4c727e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c0e353fa6543dbb1dd47ae6ab012c8'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:34.765902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-db7ae7e1-d626-4d69-b3fb-28b8bb4c727e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c0e353fa6543dbb1dd47ae6ab012c8'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:34.765902 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-db7ae7e1-d626-4d69-b3fb-28b8bb4c727e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c0e353fa6543dbb1dd47ae6ab012c8'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:34.778589 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1430/2891] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:07:34 2022] DELETE /identity/v3/users/f7c0e353fa6543dbb1dd47ae6ab012c8 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:07:34.783579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431bd52-55f8-4cfe-b481-abb76459c996 None None] REQUEST_METHOD: `POST` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:34.783579 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431bd52-55f8-4cfe-b481-abb76459c996 None None] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:34.784099 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431bd52-55f8-4cfe-b481-abb76459c996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:34.802351 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.auth.core [None req-3431bd52-55f8-4cfe-b481-abb76459c996 None None] MFA Rules not processed for user `587163b8ce4f4c51b7955cf5936eed6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92003) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:34.803557 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-3431bd52-55f8-4cfe-b481-abb76459c996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:34.869889 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1462/2892] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 23 11:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:34.880593 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ae7e1-d626-4d69-b3fb-28b8bb4c727e admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:34.882060 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-db7ae7e1-d626-4d69-b3fb-28b8bb4c727e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:34.951640 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ae7e1-d626-4d69-b3fb-28b8bb4c727e admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:34.957508 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb311dc-63d6-4242-8e3a-ce3592cee74a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:34.958303 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb311dc-63d6-4242-8e3a-ce3592cee74a service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:34.958658 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb311dc-63d6-4242-8e3a-ce3592cee74a service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:34.959010 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb311dc-63d6-4242-8e3a-ce3592cee74a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:34.970599 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb311dc-63d6-4242-8e3a-ce3592cee74a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:34.972133 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb311dc-63d6-4242-8e3a-ce3592cee74a service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:34.983101 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1431/2893] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:07:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:07:35.429147 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431bd52-55f8-4cfe-b481-abb76459c996 None None] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:35.430913 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-3431bd52-55f8-4cfe-b481-abb76459c996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:35.444493 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431bd52-55f8-4cfe-b481-abb76459c996 None None] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:35.464984 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131d6c0-9a9b-46d6-ab0c-d62fd2304f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:35.465901 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131d6c0-9a9b-46d6-ab0c-d62fd2304f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:35.466195 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131d6c0-9a9b-46d6-ab0c-d62fd2304f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:35.466482 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131d6c0-9a9b-46d6-ab0c-d62fd2304f26 admin admin] PATH_INFO: `/v3/projects/40fc5dd7a2264d9c9e0e8d92f15f085d` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:35.467751 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131d6c0-9a9b-46d6-ab0c-d62fd2304f26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40fc5dd7a2264d9c9e0e8d92f15f085d)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:35.469729 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131d6c0-9a9b-46d6-ab0c-d62fd2304f26 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:35.559789 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-9131d6c0-9a9b-46d6-ab0c-d62fd2304f26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40fc5dd7a2264d9c9e0e8d92f15f085d', 'request_id': 'req-9131d6c0-9a9b-46d6-ab0c-d62fd2304f26'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:35.565331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-9131d6c0-9a9b-46d6-ab0c-d62fd2304f26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40fc5dd7a2264d9c9e0e8d92f15f085d', 'request_id': 'req-9131d6c0-9a9b-46d6-ab0c-d62fd2304f26'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:35.615785 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-9131d6c0-9a9b-46d6-ab0c-d62fd2304f26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40fc5dd7a2264d9c9e0e8d92f15f085d', 'request_id': 'req-9131d6c0-9a9b-46d6-ab0c-d62fd2304f26'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:35.629321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-9131d6c0-9a9b-46d6-ab0c-d62fd2304f26 admin admin] The token cache is being invalidate because project 40fc5dd7a2264d9c9e0e8d92f15f085d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:07:35.629321 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-9131d6c0-9a9b-46d6-ab0c-d62fd2304f26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:35.629989 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-9131d6c0-9a9b-46d6-ab0c-d62fd2304f26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:35.631776 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1463/2894] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:07:35 2022] DELETE /identity/v3/projects/40fc5dd7a2264d9c9e0e8d92f15f085d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:07:44.978139 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:45.625693 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:46.210163 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb311dc-63d6-4242-8e3a-ce3592cee74a service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:46.211597 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ceb311dc-63d6-4242-8e3a-ce3592cee74a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:46.222926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb311dc-63d6-4242-8e3a-ce3592cee74a service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:46.271385 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1123a-ac54-4722-8a5a-897ed6d81c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:46.272035 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1123a-ac54-4722-8a5a-897ed6d81c2d service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:46.272324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1123a-ac54-4722-8a5a-897ed6d81c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:46.272618 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1123a-ac54-4722-8a5a-897ed6d81c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:46.274385 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ade1123a-ac54-4722-8a5a-897ed6d81c2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:46.335469 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1123a-ac54-4722-8a5a-897ed6d81c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:46.336927 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1123a-ac54-4722-8a5a-897ed6d81c2d service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:46.346324 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1432/2895] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:07:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:07:56.342347 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=50 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:09:08.995675 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131d6c0-9a9b-46d6-ab0c-d62fd2304f26 admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:09:08.997259 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-9131d6c0-9a9b-46d6-ab0c-d62fd2304f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:09:09.009843 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131d6c0-9a9b-46d6-ab0c-d62fd2304f26 admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:09:09.013378 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd5192-6ff2-468a-8d2c-2c188b587841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:09:09.014018 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd5192-6ff2-468a-8d2c-2c188b587841 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:09:09.014302 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd5192-6ff2-468a-8d2c-2c188b587841 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:09:09.014578 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd5192-6ff2-468a-8d2c-2c188b587841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:09:09.016295 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-eafd5192-6ff2-468a-8d2c-2c188b587841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:09:09.025627 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd5192-6ff2-468a-8d2c-2c188b587841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:09:09.027049 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd5192-6ff2-468a-8d2c-2c188b587841 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:09:09.034932 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1464/2896] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:09:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:09:19.031476 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=6 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:09:37.981896 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1123a-ac54-4722-8a5a-897ed6d81c2d service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:09:37.983418 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-ade1123a-ac54-4722-8a5a-897ed6d81c2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:09:37.994373 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1123a-ac54-4722-8a5a-897ed6d81c2d service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:09:37.998679 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895598e-8b25-4018-b65d-a2f7a0945764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:09:37.999322 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895598e-8b25-4018-b65d-a2f7a0945764 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:09:37.999628 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895598e-8b25-4018-b65d-a2f7a0945764 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:09:37.999926 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895598e-8b25-4018-b65d-a2f7a0945764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:09:38.001705 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-3895598e-8b25-4018-b65d-a2f7a0945764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:09:38.072349 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895598e-8b25-4018-b65d-a2f7a0945764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:09:38.074389 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895598e-8b25-4018-b65d-a2f7a0945764 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:09:38.085517 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1433/2897] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:09:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:09:39.266236 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd5192-6ff2-468a-8d2c-2c188b587841 service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:09:39.274740 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd5192-6ff2-468a-8d2c-2c188b587841 service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:09:39.278276 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac0de1-dcce-4c3f-ac49-bac36aaa4c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:09:39.278912 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac0de1-dcce-4c3f-ac49-bac36aaa4c82 service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:09:39.279196 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac0de1-dcce-4c3f-ac49-bac36aaa4c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:09:39.279472 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac0de1-dcce-4c3f-ac49-bac36aaa4c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:09:39.281339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-18ac0de1-dcce-4c3f-ac49-bac36aaa4c82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:09:39.295473 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac0de1-dcce-4c3f-ac49-bac36aaa4c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:09:39.297002 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac0de1-dcce-4c3f-ac49-bac36aaa4c82 service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:09:39.308423 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1465/2898] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:09:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:09:48.080489 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=34 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:09:49.302894 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=6 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:09:51.492959 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895598e-8b25-4018-b65d-a2f7a0945764 service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:09:51.502494 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895598e-8b25-4018-b65d-a2f7a0945764 service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:09:51.506574 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd1c8d-01da-406f-8a77-f6796c382b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:09:51.510182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd1c8d-01da-406f-8a77-f6796c382b18 service neutron] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:09:51.510182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd1c8d-01da-406f-8a77-f6796c382b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:09:51.510182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd1c8d-01da-406f-8a77-f6796c382b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:09:51.510182 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-0dfd1c8d-01da-406f-8a77-f6796c382b18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:09:51.521517 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd1c8d-01da-406f-8a77-f6796c382b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:09:51.522972 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd1c8d-01da-406f-8a77-f6796c382b18 service neutron] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:09:51.532080 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1434/2899] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:09:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:09:51.605770 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac0de1-dcce-4c3f-ac49-bac36aaa4c82 service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:09:51.615391 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac0de1-dcce-4c3f-ac49-bac36aaa4c82 service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:09:51.619138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60085c-8ed9-41a6-afb3-8b98ef1b50ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0348261a78984c62aced60af2768688e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:09:51.619781 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60085c-8ed9-41a6-afb3-8b98ef1b50ec service neutron] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:09:51.620063 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60085c-8ed9-41a6-afb3-8b98ef1b50ec service neutron] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:09:51.620339 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60085c-8ed9-41a6-afb3-8b98ef1b50ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:09:51.623023 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ce60085c-8ed9-41a6-afb3-8b98ef1b50ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:09:51.636662 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60085c-8ed9-41a6-afb3-8b98ef1b50ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:09:51.638970 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60085c-8ed9-41a6-afb3-8b98ef1b50ec service neutron] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:09:51.649939 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1466/2900] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:09:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:09:51.708927 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd1c8d-01da-406f-8a77-f6796c382b18 service neutron] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:09:51.710348 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-0dfd1c8d-01da-406f-8a77-f6796c382b18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:09:51.779540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd1c8d-01da-406f-8a77-f6796c382b18 service neutron] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:09:51.784539 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e8591-fa33-4d8e-87af-db29b05792e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff588aaad264f9cbc5a80e73ef0c09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:09:51.785219 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e8591-fa33-4d8e-87af-db29b05792e4 service placement] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:09:51.785502 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e8591-fa33-4d8e-87af-db29b05792e4 service placement] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:09:51.785780 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e8591-fa33-4d8e-87af-db29b05792e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:09:51.787550 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-0f5e8591-fa33-4d8e-87af-db29b05792e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:09:51.799331 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e8591-fa33-4d8e-87af-db29b05792e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:09:51.800956 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e8591-fa33-4d8e-87af-db29b05792e4 service placement] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:09:51.811371 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1435/2901] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:09:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:09:53.816138 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60085c-8ed9-41a6-afb3-8b98ef1b50ec service neutron] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:09:53.817883 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-ce60085c-8ed9-41a6-afb3-8b98ef1b50ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:09:53.833099 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60085c-8ed9-41a6-afb3-8b98ef1b50ec service neutron] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:09:53.838843 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ac18b-7683-41a0-848c-df392ff825d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:09:53.839561 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ac18b-7683-41a0-848c-df392ff825d9 service nova] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:09:53.839923 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ac18b-7683-41a0-848c-df392ff825d9 service nova] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:09:53.840546 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ac18b-7683-41a0-848c-df392ff825d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:09:53.842465 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b21ac18b-7683-41a0-848c-df392ff825d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:09:53.855934 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ac18b-7683-41a0-848c-df392ff825d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:09:53.857741 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ac18b-7683-41a0-848c-df392ff825d9 service nova] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:09:53.874267 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1467/2902] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:09:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:10:01.806500 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=38 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:03.864204 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=12 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:15.658409 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e8591-fa33-4d8e-87af-db29b05792e4 service placement] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:15.658409 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-0f5e8591-fa33-4d8e-87af-db29b05792e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:15.761340 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e8591-fa33-4d8e-87af-db29b05792e4 service placement] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:15.768234 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9736b6-95be-4cee-8160-15dce544f441 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39840f048d254831bdb963b38520f706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:15.768974 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9736b6-95be-4cee-8160-15dce544f441 service nova] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:15.769420 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9736b6-95be-4cee-8160-15dce544f441 service nova] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:15.769706 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9736b6-95be-4cee-8160-15dce544f441 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:15.771562 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-9b9736b6-95be-4cee-8160-15dce544f441 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:15.784900 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9736b6-95be-4cee-8160-15dce544f441 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:15.786510 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9736b6-95be-4cee-8160-15dce544f441 service nova] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:15.797498 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1436/2903] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:17.341118 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ac18b-7683-41a0-848c-df392ff825d9 service nova] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:17.342566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-b21ac18b-7683-41a0-848c-df392ff825d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:17.445375 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ac18b-7683-41a0-848c-df392ff825d9 service nova] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:17.450641 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0c9c8-c231-40ba-8111-8abf600f6a21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff588aaad264f9cbc5a80e73ef0c09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:17.451342 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0c9c8-c231-40ba-8111-8abf600f6a21 service placement] REQUEST_METHOD: `GET` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:17.451630 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0c9c8-c231-40ba-8111-8abf600f6a21 service placement] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:17.451911 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0c9c8-c231-40ba-8111-8abf600f6a21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:17.453725 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-12d0c9c8-c231-40ba-8111-8abf600f6a21 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:17.465947 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0c9c8-c231-40ba-8111-8abf600f6a21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:17.467531 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0c9c8-c231-40ba-8111-8abf600f6a21 service placement] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:17.477967 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1468/2904] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:25.793516 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=40 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:26.833136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9736b6-95be-4cee-8160-15dce544f441 service nova] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:26.833136 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-9b9736b6-95be-4cee-8160-15dce544f441 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:26.928421 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9736b6-95be-4cee-8160-15dce544f441 service nova] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:26.933483 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fed31-d803-43e3-88c0-c6724d8c3b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:26.934356 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fed31-d803-43e3-88c0-c6724d8c3b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:26.934639 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fed31-d803-43e3-88c0-c6724d8c3b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:26.934918 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fed31-d803-43e3-88c0-c6724d8c3b7d admin admin] PATH_INFO: `/v3/users/a3a3d010c4804a8daff248c28ee9960e` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:26.936231 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fed31-d803-43e3-88c0-c6724d8c3b7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a3d010c4804a8daff248c28ee9960e)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:26.938185 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fed31-d803-43e3-88c0-c6724d8c3b7d admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:27.101852 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a04fed31-d803-43e3-88c0-c6724d8c3b7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a3d010c4804a8daff248c28ee9960e'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.109474 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a04fed31-d803-43e3-88c0-c6724d8c3b7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a3d010c4804a8daff248c28ee9960e'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.110149 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a04fed31-d803-43e3-88c0-c6724d8c3b7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a3d010c4804a8daff248c28ee9960e'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.235540 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a04fed31-d803-43e3-88c0-c6724d8c3b7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a3d010c4804a8daff248c28ee9960e'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.236134 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-a04fed31-d803-43e3-88c0-c6724d8c3b7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a3d010c4804a8daff248c28ee9960e'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.253979 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1437/2905] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:26 2022] DELETE /identity/v3/users/a3a3d010c4804a8daff248c28ee9960e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:27.473616 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=37 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:27.509566 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0c9c8-c231-40ba-8111-8abf600f6a21 service placement] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:27.516793 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0c9c8-c231-40ba-8111-8abf600f6a21 service placement] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:27.574669 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b843c1-3b98-4396-b442-911de8bf14fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:27.575535 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b843c1-3b98-4396-b442-911de8bf14fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:27.575820 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b843c1-3b98-4396-b442-911de8bf14fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:27.576098 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b843c1-3b98-4396-b442-911de8bf14fb admin admin] PATH_INFO: `/v3/projects/b2545f270d1f469fb2877225737a2a09` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:27.577282 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b843c1-3b98-4396-b442-911de8bf14fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2545f270d1f469fb2877225737a2a09)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:27.579208 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b843c1-3b98-4396-b442-911de8bf14fb admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:27.675310 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-83b843c1-3b98-4396-b442-911de8bf14fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2545f270d1f469fb2877225737a2a09', 'request_id': 'req-83b843c1-3b98-4396-b442-911de8bf14fb'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.680719 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-83b843c1-3b98-4396-b442-911de8bf14fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2545f270d1f469fb2877225737a2a09', 'request_id': 'req-83b843c1-3b98-4396-b442-911de8bf14fb'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.753713 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-83b843c1-3b98-4396-b442-911de8bf14fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2545f270d1f469fb2877225737a2a09', 'request_id': 'req-83b843c1-3b98-4396-b442-911de8bf14fb'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.765067 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-83b843c1-3b98-4396-b442-911de8bf14fb admin admin] The token cache is being invalidate because project b2545f270d1f469fb2877225737a2a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:27.765360 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-83b843c1-3b98-4396-b442-911de8bf14fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.766001 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-83b843c1-3b98-4396-b442-911de8bf14fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.767564 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1469/2906] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:27 2022] DELETE /identity/v3/projects/b2545f270d1f469fb2877225737a2a09 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:27.771549 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fed31-d803-43e3-88c0-c6724d8c3b7d admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:27.773018 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a04fed31-d803-43e3-88c0-c6724d8c3b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:27.786699 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fed31-d803-43e3-88c0-c6724d8c3b7d admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:27.832407 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:27.842485 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e626a-1a3c-4e2b-9b41-a96007111b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:27.843723 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e626a-1a3c-4e2b-9b41-a96007111b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:27.843920 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e626a-1a3c-4e2b-9b41-a96007111b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:27.844175 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e626a-1a3c-4e2b-9b41-a96007111b16 admin admin] PATH_INFO: `/v3/users/9b6141155bd64b8aa306f0146c345951` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:27.845391 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e626a-1a3c-4e2b-9b41-a96007111b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6141155bd64b8aa306f0146c345951)` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:27.847303 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e626a-1a3c-4e2b-9b41-a96007111b16 admin admin] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:28.041519 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-0e1e626a-1a3c-4e2b-9b41-a96007111b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6141155bd64b8aa306f0146c345951'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.048959 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-0e1e626a-1a3c-4e2b-9b41-a96007111b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6141155bd64b8aa306f0146c345951'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.049654 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-0e1e626a-1a3c-4e2b-9b41-a96007111b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6141155bd64b8aa306f0146c345951'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.121752 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-0e1e626a-1a3c-4e2b-9b41-a96007111b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6141155bd64b8aa306f0146c345951'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.122379 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.notifications [None req-0e1e626a-1a3c-4e2b-9b41-a96007111b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6141155bd64b8aa306f0146c345951'} {{(pid=92004) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.141041 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1438/2907] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:27 2022] DELETE /identity/v3/users/9b6141155bd64b8aa306f0146c345951 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:28.392801 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b843c1-3b98-4396-b442-911de8bf14fb admin admin] Authenticating user token {{(pid=92003) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:28.393131 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.fernet_utils [None req-83b843c1-3b98-4396-b442-911de8bf14fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92003) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:28.405956 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b843c1-3b98-4396-b442-911de8bf14fb admin admin] Validating token access rules against request {{(pid=92003) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:28.465073 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06c6ec-ebc6-4286-8fc5-a7977de784b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '587163b8ce4f4c51b7955cf5936eed6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7866f693106e4323a208242e01a5fef9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92003) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:28.465944 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06c6ec-ebc6-4286-8fc5-a7977de784b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:28.466229 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06c6ec-ebc6-4286-8fc5-a7977de784b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:28.466505 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06c6ec-ebc6-4286-8fc5-a7977de784b4 admin admin] PATH_INFO: `/v3/projects/8f8580a25be6410299bafd48ed8cce12` {{(pid=92003) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:28.467935 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06c6ec-ebc6-4286-8fc5-a7977de784b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f8580a25be6410299bafd48ed8cce12)` {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:28.469882 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06c6ec-ebc6-4286-8fc5-a7977de784b4 admin admin] RBAC: Authorization granted {{(pid=92003) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:28.555876 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:28.567195 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-4f06c6ec-ebc6-4286-8fc5-a7977de784b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f8580a25be6410299bafd48ed8cce12', 'request_id': 'req-4f06c6ec-ebc6-4286-8fc5-a7977de784b4'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.572459 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-4f06c6ec-ebc6-4286-8fc5-a7977de784b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f8580a25be6410299bafd48ed8cce12', 'request_id': 'req-4f06c6ec-ebc6-4286-8fc5-a7977de784b4'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.646866 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-4f06c6ec-ebc6-4286-8fc5-a7977de784b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f8580a25be6410299bafd48ed8cce12', 'request_id': 'req-4f06c6ec-ebc6-4286-8fc5-a7977de784b4'} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.659750 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-4f06c6ec-ebc6-4286-8fc5-a7977de784b4 admin admin] The token cache is being invalidate because project 8f8580a25be6410299bafd48ed8cce12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92003) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:28.660078 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-4f06c6ec-ebc6-4286-8fc5-a7977de784b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.660768 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG keystone.notifications [None req-4f06c6ec-ebc6-4286-8fc5-a7977de784b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92003) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.662331 dv-cinder-846146-4-smb devstack@keystone.service[92003]: [pid: 92003|app: 0|req: 1470/2908] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:28 2022] DELETE /identity/v3/projects/8f8580a25be6410299bafd48ed8cce12 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:38.137547 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG dbcounter [-] [92004] Writing DB stats keystone:SELECT=30,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92004) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:38.795892 dv-cinder-846146-4-smb devstack@keystone.service[92003]: DEBUG dbcounter [-] [92003] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:22.201472 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e626a-1a3c-4e2b-9b41-a96007111b16 admin admin] Authenticating user token {{(pid=92004) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:22.203050 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-0e1e626a-1a3c-4e2b-9b41-a96007111b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:22.290271 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e626a-1a3c-4e2b-9b41-a96007111b16 admin admin] Validating token access rules against request {{(pid=92004) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:22.357725 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7222c22-ac88-4e4b-aa92-7ede946deddf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff588aaad264f9cbc5a80e73ef0c09d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7a9c82a62044db884e547da9a523927', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92004) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:22.358860 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7222c22-ac88-4e4b-aa92-7ede946deddf service placement] REQUEST_METHOD: `GET` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:22.358860 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7222c22-ac88-4e4b-aa92-7ede946deddf service placement] SCRIPT_NAME: `/identity` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:22.359163 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7222c22-ac88-4e4b-aa92-7ede946deddf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92004) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:22.361399 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.fernet_utils [None req-a7222c22-ac88-4e4b-aa92-7ede946deddf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92004) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:22.373934 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7222c22-ac88-4e4b-aa92-7ede946deddf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:22.375566 dv-cinder-846146-4-smb devstack@keystone.service[92004]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7222c22-ac88-4e4b-aa92-7ede946deddf service placement] RBAC: Authorization granted {{(pid=92004) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:22.387441 dv-cinder-846146-4-smb devstack@keystone.service[92004]: [pid: 92004|app: 0|req: 1439/2909] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)